Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
2026-03-17T20:57:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-03-17T20:57:10Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskbzIMi0/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskbzIMi0/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/security.properties
2026-03-17 20:57:18: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskbzIMi0/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskbzIMi0/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260317 20:57:29.081943 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.254:45865
--webserver_interface=127.0.102.254
--webserver_port=0
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260317 20:57:29.194518 698 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:29.194834 698 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:29.194929 698 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:29.198642 698 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:29.198746 698 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:29.198781 698 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:29.198822 698 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:29.203011 698 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.254:45865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.102.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.698
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:29.204272 698 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:29.205495 698 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:29.212051 703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:29.212550 698 server_base.cc:1060] running on GCE node
W20260317 20:57:29.212566 704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:29.213727 706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:29.214614 698 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:29.216333 698 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:29.217557 698 hybrid_clock.cc:648] HybridClock initialized: now 1773781049217494 us; error 90 us; skew 500 ppm
I20260317 20:57:29.221112 698 webserver.cc:492] Webserver started at http://127.0.102.254:37411/ using document root <none> and password file <none>
I20260317 20:57:29.221899 698 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:29.221974 698 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:29.222273 698 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260317 20:57:29.224135 698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/instance:
uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:29.224713 698 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal/instance:
uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:29.228699 698 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260317 20:57:29.231393 712 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:29.232591 698 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:29.232793 698 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:29.232937 698 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:29.255873 698 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:29.256731 698 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:29.256983 698 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:29.265765 698 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.254:45865
I20260317 20:57:29.265761 764 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.254:45865 every 8 connection(s)
I20260317 20:57:29.267030 698 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
I20260317 20:57:29.269374 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 698
I20260317 20:57:29.269543 411 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal/instance
I20260317 20:57:29.270916 765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:29.271485 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.253:38969
--webserver_interface=127.0.102.253
--webserver_port=0
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260317 20:57:29.275156 765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } has no permanent_uuid. Determining permanent_uuid...
I20260317 20:57:29.289482 765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } has no permanent_uuid. Determining permanent_uuid...
W20260317 20:57:29.290759 715 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:29.292424 765 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:29.341717 765 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } attempt: 1
W20260317 20:57:29.343439 765 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:29.391597 766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:29.391871 766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:29.391913 766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:29.396392 766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:29.396488 766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:29.396510 766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:29.396529 766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:29.401008 766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.253:38969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.102.253
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:29.402275 766 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:29.403530 766 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:29.409334 775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:29.409469 774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:29.409334 777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:29.409621 766 server_base.cc:1060] running on GCE node
I20260317 20:57:29.410326 766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:29.411669 765 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } attempt: 2
I20260317 20:57:29.412109 766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:29.413321 766 hybrid_clock.cc:648] HybridClock initialized: now 1773781049413303 us; error 33 us; skew 500 ppm
W20260317 20:57:29.413304 765 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:29.415501 766 webserver.cc:492] Webserver started at http://127.0.102.253:45191/ using document root <none> and password file <none>
I20260317 20:57:29.416188 766 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:29.416294 766 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:29.416555 766 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260317 20:57:29.418363 766 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/instance:
uuid: "db5e708fd6404c0daa842bfc7e8f4806"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:29.418895 766 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal/instance:
uuid: "db5e708fd6404c0daa842bfc7e8f4806"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:29.423345 766 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260317 20:57:29.427251 783 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:29.428525 766 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260317 20:57:29.428726 766 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
uuid: "db5e708fd6404c0daa842bfc7e8f4806"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:29.428877 766 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:29.456115 766 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:29.456874 766 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:29.457091 766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:29.466148 835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.253:38969 every 8 connection(s)
I20260317 20:57:29.466166 766 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.253:38969
I20260317 20:57:29.467314 766 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
I20260317 20:57:29.468390 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 766
I20260317 20:57:29.468485 411 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal/instance
I20260317 20:57:29.469180 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.252:34639
--webserver_interface=127.0.102.252
--webserver_port=0
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260317 20:57:29.470640 836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:29.475472 836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } has no permanent_uuid. Determining permanent_uuid...
I20260317 20:57:29.487932 836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } has no permanent_uuid. Determining permanent_uuid...
I20260317 20:57:29.496057 836 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } has no permanent_uuid. Determining permanent_uuid...
W20260317 20:57:29.497002 785 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 20:57:29.498080 836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.252:34639: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:57:29.504585 765 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } attempt: 3
I20260317 20:57:29.509544 765 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } has no permanent_uuid. Determining permanent_uuid...
W20260317 20:57:29.511053 765 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.252:34639: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:57:29.542240 765 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } attempt: 1
W20260317 20:57:29.543812 765 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.252:34639: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:57:29.547336 836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } attempt: 1
W20260317 20:57:29.548815 836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.252:34639: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 20:57:29.589850 837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:29.590232 837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:29.590283 837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:29.593925 837 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:29.594015 837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:29.594116 837 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:29.594165 837 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:29.598598 837 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.252:34639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.102.252
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:29.599815 837 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:29.601024 837 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:29.607100 848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:29.607187 846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:29.607095 845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:29.607421 837 server_base.cc:1060] running on GCE node
I20260317 20:57:29.608001 837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:29.609098 837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:29.610304 837 hybrid_clock.cc:648] HybridClock initialized: now 1773781049610283 us; error 55 us; skew 500 ppm
I20260317 20:57:29.612656 837 webserver.cc:492] Webserver started at http://127.0.102.252:38583/ using document root <none> and password file <none>
I20260317 20:57:29.613443 837 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:29.613561 837 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:29.613821 837 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260317 20:57:29.617062 836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } attempt: 2
I20260317 20:57:29.617552 837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/instance:
uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:29.618284 837 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal/instance:
uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
W20260317 20:57:29.618630 836 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.252:34639: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:57:29.619004 765 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } attempt: 2
W20260317 20:57:29.620440 765 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.0.102.252:34639: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:57:29.622782 837 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260317 20:57:29.625316 854 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:29.626557 837 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260317 20:57:29.626770 837 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:29.626929 837 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:29.638757 837 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:29.639463 837 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:29.639667 837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:29.648752 906 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.252:34639 every 8 connection(s)
I20260317 20:57:29.648753 837 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.252:34639
I20260317 20:57:29.649989 837 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
I20260317 20:57:29.653108 907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:29.656715 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 837
I20260317 20:57:29.656965 411 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal/instance
I20260317 20:57:29.656584 907 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } has no permanent_uuid. Determining permanent_uuid...
I20260317 20:57:29.667297 907 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } has no permanent_uuid. Determining permanent_uuid...
I20260317 20:57:29.672255 907 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } has no permanent_uuid. Determining permanent_uuid...
I20260317 20:57:29.680505 907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap starting.
I20260317 20:57:29.683300 907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:29.684127 907 log.cc:826] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:29.686151 907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: No bootstrap required, opened a new log
I20260317 20:57:29.689460 907 raft_consensus.cc:359] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.689692 907 raft_consensus.cc:385] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:29.689785 907 raft_consensus.cc:740] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a5313a52eb40a3ab5d14d0d8be52f7, State: Initialized, Role: FOLLOWER
I20260317 20:57:29.690346 907 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.690863 915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.690984 915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:29.691581 907 sys_catalog.cc:565] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:29.696969 837 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: OK, instance_id { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" instance_seqno: 1773781049262720 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260317 20:57:29.699009 837 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:57:29.703671 929 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260317 20:57:29.704238 929 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260317 20:57:29.709859 836 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } attempt: 3
I20260317 20:57:29.719614 765 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } attempt: 3
I20260317 20:57:29.720628 836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap starting.
I20260317 20:57:29.733250 765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap starting.
I20260317 20:57:29.736621 765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:29.740744 836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:29.742007 765 log.cc:826] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:29.743256 836 log.cc:826] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:29.746869 836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: No bootstrap required, opened a new log
I20260317 20:57:29.751775 836 raft_consensus.cc:359] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.752180 836 raft_consensus.cc:385] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:29.752287 836 raft_consensus.cc:740] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db5e708fd6404c0daa842bfc7e8f4806, State: Initialized, Role: FOLLOWER
I20260317 20:57:29.752987 836 consensus_queue.cc:260] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.756294 765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: No bootstrap required, opened a new log
I20260317 20:57:29.756280 934 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.756532 934 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:29.759256 836 sys_catalog.cc:565] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:29.759972 765 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.760295 765 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:29.760412 765 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5022d9ddb45c41faa9f114e2a0a31fc3, State: Initialized, Role: FOLLOWER
I20260317 20:57:29.761106 765 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.762609 765 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:29.765846 766 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: OK, instance_id { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" instance_seqno: 1773781049262720 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260317 20:57:29.768407 766 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:29.768719 943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.773990 943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:29.776289 698 master_runner.cc:263] No leader master found from master 5022d9ddb45c41faa9f114e2a0a31fc3
I20260317 20:57:29.776389 698 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:57:29.776706 949 catalog_manager.cc:1568] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260317 20:57:29.776868 949 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260317 20:57:29.778234 963 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260317 20:57:29.788244 963 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260317 20:57:29.846096 934 raft_consensus.cc:493] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:29.846343 934 raft_consensus.cc:515] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.847523 934 leader_election.cc:290] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:29.848099 739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" is_pre_election: true
I20260317 20:57:29.848305 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" is_pre_election: true
I20260317 20:57:29.848423 739 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 0.
I20260317 20:57:29.848579 881 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 0.
I20260317 20:57:29.849035 785 leader_election.cc:304] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806; no voters:
I20260317 20:57:29.849478 934 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:29.849556 934 raft_consensus.cc:493] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:29.849610 934 raft_consensus.cc:3060] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:29.851409 934 raft_consensus.cc:515] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.852201 739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
I20260317 20:57:29.852262 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
I20260317 20:57:29.852349 739 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:29.852401 881 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:29.853561 881 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 1.
I20260317 20:57:29.853561 739 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 1.
I20260317 20:57:29.853977 785 leader_election.cc:304] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806; no voters:
I20260317 20:57:29.854322 934 leader_election.cc:290] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 1 election: Requested vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:29.854494 934 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:29.854566 934 raft_consensus.cc:697] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 1 LEADER]: Becoming Leader. State: Replica: db5e708fd6404c0daa842bfc7e8f4806, State: Running, Role: LEADER
I20260317 20:57:29.854915 934 consensus_queue.cc:237] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:29.856853 934 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.856997 934 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:29.864416 970 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260317 20:57:29.866214 970 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260317 20:57:29.890069 881 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 1 FOLLOWER]: Refusing update from remote peer db5e708fd6404c0daa842bfc7e8f4806: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260317 20:57:29.890936 860 tablet.cc:2379] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260317 20:57:29.890985 968 consensus_queue.cc:1048] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:29.895702 915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.895877 915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:29.899986 739 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Refusing update from remote peer db5e708fd6404c0daa842bfc7e8f4806: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:29.900803 968 consensus_queue.cc:1048] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:29.905339 943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.905489 943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:29.912457 968 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.912611 968 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:29.914129 943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.914276 943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:29.915371 971 mvcc.cc:204] Tried to move back new op lower bound from 7265407180340334592 to 7265407180208992256. Current Snapshot: MvccSnapshot[applied={T|T < 7265407180340334592}]
I20260317 20:57:29.916572 934 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.916695 934 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:29.918089 915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:29.918221 915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:29.921535 974 mvcc.cc:204] Tried to move back new op lower bound from 7265407180340334592 to 7265407180208992256. Current Snapshot: MvccSnapshot[applied={T|T < 7265407180340334592}]
I20260317 20:57:29.921792 972 mvcc.cc:204] Tried to move back new op lower bound from 7265407180340334592 to 7265407180208992256. Current Snapshot: MvccSnapshot[applied={T|T < 7265407180340334592}]
I20260317 20:57:29.935892 970 catalog_manager.cc:1357] Generated new cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:29.935993 970 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260317 20:57:29.980124 970 catalog_manager.cc:1380] Generated new certificate authority record
I20260317 20:57:29.981566 970 catalog_manager.cc:1514] Loading token signing keys...
I20260317 20:57:29.995137 970 catalog_manager.cc:6044] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Generated new TSK 0
I20260317 20:57:29.996240 970 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260317 20:57:29.996968 970 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260317 20:57:29.997509 970 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: -1
I20260317 20:57:30.001726 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.102.193:0
--local_ip_for_outbound_sockets=127.0.102.193
--webserver_interface=127.0.102.193
--webserver_port=0
--tserver_master_addrs=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260317 20:57:30.153169 979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:30.153429 979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:30.153483 979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:30.157279 979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:30.157480 979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.102.193
I20260317 20:57:30.162020 979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.102.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.0.102.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--never_fsync=true
--heap_profile_path=/tmp/kudu.979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.102.193
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:30.163259 979 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:30.164528 979 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:30.171509 984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:30.171509 985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:30.171520 987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:30.172161 979 server_base.cc:1060] running on GCE node
I20260317 20:57:30.172580 979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:30.173244 979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:30.174417 979 hybrid_clock.cc:648] HybridClock initialized: now 1773781050174387 us; error 51 us; skew 500 ppm
I20260317 20:57:30.176666 979 webserver.cc:492] Webserver started at http://127.0.102.193:45861/ using document root <none> and password file <none>
I20260317 20:57:30.177386 979 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:30.177484 979 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:30.177711 979 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260317 20:57:30.179534 979 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/data/instance:
uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.180109 979 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/instance:
uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.183948 979 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260317 20:57:30.186487 993 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.187513 979 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260317 20:57:30.187675 979 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal
uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.187794 979 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:30.203421 979 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:30.204154 979 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:30.204385 979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:30.205104 979 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260317 20:57:30.206252 979 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260317 20:57:30.206303 979 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.206343 979 ts_tablet_manager.cc:616] Registered 0 tablets
I20260317 20:57:30.206365 979 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.217999 979 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.193:34743
I20260317 20:57:30.218017 1106 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.193:34743 every 8 connection(s)
I20260317 20:57:30.219079 979 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/data/info.pb
I20260317 20:57:30.220346 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 979
I20260317 20:57:30.220495 411 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/instance
I20260317 20:57:30.224201 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.102.194:0
--local_ip_for_outbound_sockets=127.0.102.194
--webserver_interface=127.0.102.194
--webserver_port=0
--tserver_master_addrs=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260317 20:57:30.231133 1107 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:30.231139 1108 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:30.231133 1109 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:30.231482 1108 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.231480 1107 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.231480 1109 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.232297 1108 heartbeater.cc:507] Master 127.0.102.254:45865 requested a full tablet report, sending...
I20260317 20:57:30.232378 1109 heartbeater.cc:507] Master 127.0.102.253:38969 requested a full tablet report, sending...
I20260317 20:57:30.232939 1107 heartbeater.cc:507] Master 127.0.102.252:34639 requested a full tablet report, sending...
I20260317 20:57:30.233868 800 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:30.233868 729 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:30.234274 871 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:30.235348 800 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.102.193:52439
W20260317 20:57:30.352548 1116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:30.352787 1116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:30.352839 1116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:30.356482 1116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:30.356644 1116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.102.194
I20260317 20:57:30.360818 1116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.102.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.0.102.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--never_fsync=true
--heap_profile_path=/tmp/kudu.1116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.102.194
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:30.362023 1116 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:30.363240 1116 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:30.370342 1122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:30.370342 1121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:30.370716 1116 server_base.cc:1060] running on GCE node
W20260317 20:57:30.370344 1124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:30.371302 1116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:30.371891 1116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:30.373064 1116 hybrid_clock.cc:648] HybridClock initialized: now 1773781050373041 us; error 46 us; skew 500 ppm
I20260317 20:57:30.375330 1116 webserver.cc:492] Webserver started at http://127.0.102.194:38961/ using document root <none> and password file <none>
I20260317 20:57:30.376080 1116 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:30.376173 1116 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:30.376441 1116 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260317 20:57:30.378149 1116 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/data/instance:
uuid: "35518b51259b46d1b9b5e82b6841057b"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.378657 1116 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/instance:
uuid: "35518b51259b46d1b9b5e82b6841057b"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.381940 1116 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s
I20260317 20:57:30.384205 1130 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.385349 1116 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:30.385499 1116 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal
uuid: "35518b51259b46d1b9b5e82b6841057b"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.385625 1116 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:30.398332 1116 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:30.399072 1116 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:30.399296 1116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:30.399901 1116 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260317 20:57:30.401000 1116 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260317 20:57:30.401082 1116 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.401153 1116 ts_tablet_manager.cc:616] Registered 0 tablets
I20260317 20:57:30.401212 1116 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.412774 1116 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.194:40679
I20260317 20:57:30.412803 1243 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.194:40679 every 8 connection(s)
I20260317 20:57:30.413848 1116 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/data/info.pb
I20260317 20:57:30.415345 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 1116
I20260317 20:57:30.415470 411 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/instance
I20260317 20:57:30.419096 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.0.102.195:0
--local_ip_for_outbound_sockets=127.0.102.195
--webserver_interface=127.0.102.195
--webserver_port=0
--tserver_master_addrs=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260317 20:57:30.424635 1244 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:30.424656 1246 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:30.424628 1245 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:30.424971 1245 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.424971 1246 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.425673 1245 heartbeater.cc:507] Master 127.0.102.254:45865 requested a full tablet report, sending...
I20260317 20:57:30.425670 1246 heartbeater.cc:507] Master 127.0.102.253:38969 requested a full tablet report, sending...
I20260317 20:57:30.424973 1244 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.426338 1244 heartbeater.cc:507] Master 127.0.102.252:34639 requested a full tablet report, sending...
I20260317 20:57:30.426918 800 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:30.426972 729 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:30.427290 871 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:30.427666 800 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.102.194:52003
I20260317 20:57:30.495390 1252 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:30.495659 1252 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:30.496650 1252 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:30.497172 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" is_pre_election: true
I20260317 20:57:30.497190 810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "db5e708fd6404c0daa842bfc7e8f4806" is_pre_election: true
I20260317 20:57:30.498131 714 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:30.498456 1252 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:57:30.538141 1251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:30.538367 1251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:30.538458 1251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:30.541960 1251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:30.542171 1251 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.102.195
I20260317 20:57:30.546108 1251 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.0.102.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.0.102.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--never_fsync=true
--heap_profile_path=/tmp/kudu.1251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.0.102.195
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:30.547215 1251 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:30.548348 1251 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:30.555176 1258 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:30.555250 1260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:30.555197 1257 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:30.555532 1251 server_base.cc:1060] running on GCE node
I20260317 20:57:30.555935 1251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:30.556556 1251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:30.557749 1251 hybrid_clock.cc:648] HybridClock initialized: now 1773781050557733 us; error 32 us; skew 500 ppm
I20260317 20:57:30.559722 1251 webserver.cc:492] Webserver started at http://127.0.102.195:35061/ using document root <none> and password file <none>
I20260317 20:57:30.560346 1251 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:30.560506 1251 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:30.560773 1251 server_base.cc:908] This appears to be a new deployment of Kudu; creating new FS layout
I20260317 20:57:30.562553 1251 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/data/instance:
uuid: "630e777e97c141a69e35660f32b26f6d"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.563090 1251 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/instance:
uuid: "630e777e97c141a69e35660f32b26f6d"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.567036 1251 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260317 20:57:30.569603 1266 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.570775 1251 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260317 20:57:30.570932 1251 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal
uuid: "630e777e97c141a69e35660f32b26f6d"
format_stamp: "Formatted at 2026-03-17 20:57:30 on dist-test-slave-kxrc"
I20260317 20:57:30.571063 1251 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:30.589527 1251 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:30.590302 1251 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:30.590492 1251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:30.591043 1251 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260317 20:57:30.592047 1251 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260317 20:57:30.592120 1251 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.592238 1251 ts_tablet_manager.cc:616] Registered 0 tablets
I20260317 20:57:30.592276 1251 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:30.603111 1251 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.195:46847
I20260317 20:57:30.603132 1379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.195:46847 every 8 connection(s)
I20260317 20:57:30.604135 1251 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/data/info.pb
I20260317 20:57:30.607717 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 1251
I20260317 20:57:30.607834 411 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/instance
I20260317 20:57:30.615546 1382 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:30.615764 1382 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.616255 1382 heartbeater.cc:507] Master 127.0.102.253:38969 requested a full tablet report, sending...
I20260317 20:57:30.616648 1380 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:30.616708 1380 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.616932 1380 heartbeater.cc:507] Master 127.0.102.252:34639 requested a full tablet report, sending...
I20260317 20:57:30.617133 1381 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:30.617192 1381 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:30.617268 800 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:30.617358 1381 heartbeater.cc:507] Master 127.0.102.254:45865 requested a full tablet report, sending...
I20260317 20:57:30.617655 871 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:30.617930 800 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.102.195:55481
I20260317 20:57:30.618081 729 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:30.628669 411 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20260317 20:57:30.648203 411 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu with pid 698
I20260317 20:57:30.648627 800 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_f6840de3a5bb48dda47e8b19e6d003f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.654536 799 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_3c0c77756ed5410faefa920adf64821f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.654999 798 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_14970f3e82f542c3ac28906af0b81693"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.661003 797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_7d4fb7b8d8a84fa4b89f045e59a9c77c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.661089 795 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_e5d6d92a3e994614a3975dcf29c3db11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.661118 793 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_85e2216401ff46efa6722e98254db955"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.661414 796 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_4dbc50b14c244bfba10bd8a152d0ad78"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.661692 794 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_546787ba946048329e14e21785ced611"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.666898 792 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_8e39f763b78b443eb64d97cb4d88570a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:30.666919 791 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_0ef0ec042f05496c9732c4a2d7e9b991"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260317 20:57:30.699049 800 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f6840de3a5bb48dda47e8b19e6d003f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:30.705860 929 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:30.705957 929 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: loading cluster ID for follower catalog manager: success
I20260317 20:57:30.708679 929 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: acquiring CA information for follower catalog manager: success
I20260317 20:57:30.710803 929 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260317 20:57:30.736758 1108 heartbeater.cc:646] Failed to heartbeat to 127.0.102.254:45865 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:30.737360 1109 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:30.929454 1246 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
W20260317 20:57:30.934916 1245 heartbeater.cc:646] Failed to heartbeat to 127.0.102.254:45865 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:31.119911 1382 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
W20260317 20:57:31.121897 1381 heartbeater.cc:646] Failed to heartbeat to 127.0.102.254:45865 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:31.146234 800 catalog_manager.cc:2174] created HMS catalog entry for table [id=06a4801fbead41c6adfb06c624d3c9ad]
W20260317 20:57:31.149657 787 consensus_peers.cc:597] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 -> Peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Couldn't send request to peer 5022d9ddb45c41faa9f114e2a0a31fc3. Status: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260317 20:57:31.150377 799 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3c0c77756ed5410faefa920adf64821f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:31.151306 798 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_14970f3e82f542c3ac28906af0b81693 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:31.152092 797 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:31.152630 795 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e5d6d92a3e994614a3975dcf29c3db11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:31.153129 793 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_85e2216401ff46efa6722e98254db955 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:31.153684 796 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4dbc50b14c244bfba10bd8a152d0ad78 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:31.154247 794 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_546787ba946048329e14e21785ced611 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:31.154829 792 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8e39f763b78b443eb64d97cb4d88570a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:31.155519 791 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0ef0ec042f05496c9732c4a2d7e9b991 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:31.162405 800 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_f6840de3a5bb48dda47e8b19e6d003f3" } new_table_name: "default.Table_9e4d286026a74f549f1874d0f1b908de" modify_external_catalogs: true
I20260317 20:57:31.174535 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 6583759e2da241cdacedd57415538924 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.176010 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6583759e2da241cdacedd57415538924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.182411 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 6583759e2da241cdacedd57415538924 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.183526 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6583759e2da241cdacedd57415538924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.184223 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6583759e2da241cdacedd57415538924 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.185292 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6583759e2da241cdacedd57415538924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.186967 1443 tablet_bootstrap.cc:492] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.190160 1443 tablet_bootstrap.cc:654] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.191208 1443 log.cc:826] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:31.191645 1444 tablet_bootstrap.cc:492] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.192839 1445 tablet_bootstrap.cc:492] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.194316 1444 tablet_bootstrap.cc:654] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.195245 1445 tablet_bootstrap.cc:654] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.195441 1444 log.cc:826] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:31.196120 1445 log.cc:826] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:31.197388 1444 tablet_bootstrap.cc:492] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.197593 1444 ts_tablet_manager.cc:1403] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260317 20:57:31.197922 1443 tablet_bootstrap.cc:492] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.198163 1443 ts_tablet_manager.cc:1403] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260317 20:57:31.201149 1444 raft_consensus.cc:359] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.201395 1444 raft_consensus.cc:385] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.201450 1444 raft_consensus.cc:740] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.201902 1443 raft_consensus.cc:359] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.202167 1443 raft_consensus.cc:385] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.202234 1443 raft_consensus.cc:740] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.202651 1443 consensus_queue.cc:260] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.202401 1444 consensus_queue.cc:260] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.203686 1443 ts_tablet_manager.cc:1434] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260317 20:57:31.206270 1444 ts_tablet_manager.cc:1434] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260317 20:57:31.212347 1445 tablet_bootstrap.cc:492] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.212630 1445 ts_tablet_manager.cc:1403] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.000s
I20260317 20:57:31.216229 799 catalog_manager.cc:2174] created HMS catalog entry for table [id=a845787d86674dcb8420c53e3d2c2e70]
I20260317 20:57:31.216091 1445 raft_consensus.cc:359] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.216380 1445 raft_consensus.cc:385] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.216444 1445 raft_consensus.cc:740] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.217052 1445 consensus_queue.cc:260] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.218261 1445 ts_tablet_manager.cc:1434] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260317 20:57:31.221345 1110 tablet.cc:2379] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260317 20:57:31.225732 1450 raft_consensus.cc:493] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.226018 1450 raft_consensus.cc:515] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.227569 1178 tablet_service.cc:1511] Processing CreateTablet for tablet b11d10f48472444bbd662af1c02c6bb9 (DEFAULT_TABLE table=default.table_3c0c77756ed5410faefa920adf64821f [id=a845787d86674dcb8420c53e3d2c2e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.227684 1041 tablet_service.cc:1511] Processing CreateTablet for tablet b11d10f48472444bbd662af1c02c6bb9 (DEFAULT_TABLE table=default.table_3c0c77756ed5410faefa920adf64821f [id=a845787d86674dcb8420c53e3d2c2e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.227891 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11d10f48472444bbd662af1c02c6bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.227898 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11d10f48472444bbd662af1c02c6bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.228196 799 master_service.cc:954] ReplaceTablet: received request to replace tablet 6583759e2da241cdacedd57415538924 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.230225 1443 tablet_bootstrap.cc:492] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.230333 1314 tablet_service.cc:1511] Processing CreateTablet for tablet b11d10f48472444bbd662af1c02c6bb9 (DEFAULT_TABLE table=default.table_3c0c77756ed5410faefa920adf64821f [id=a845787d86674dcb8420c53e3d2c2e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.230613 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b11d10f48472444bbd662af1c02c6bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.231359 1443 tablet_bootstrap.cc:654] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.232995 1444 tablet_bootstrap.cc:492] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.234563 1444 tablet_bootstrap.cc:654] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.234670 1445 tablet_bootstrap.cc:492] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.235771 1445 tablet_bootstrap.cc:654] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.235883 1444 tablet_bootstrap.cc:492] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.235977 1444 ts_tablet_manager.cc:1403] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260317 20:57:31.236655 1444 raft_consensus.cc:359] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.236775 1444 raft_consensus.cc:385] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.236805 1444 raft_consensus.cc:740] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.236934 1444 consensus_queue.cc:260] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.237339 1444 ts_tablet_manager.cc:1434] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.240132 1451 raft_consensus.cc:493] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.240510 1445 tablet_bootstrap.cc:492] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.240435 1451 raft_consensus.cc:515] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.240614 1445 ts_tablet_manager.cc:1403] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:31.241133 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6583759e2da241cdacedd57415538924" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.241297 1445 raft_consensus.cc:359] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.241400 1445 raft_consensus.cc:385] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.241365 1061 raft_consensus.cc:2468] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.241431 1445 raft_consensus.cc:740] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.241585 1445 consensus_queue.cc:260] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.241875 1269 leader_election.cc:304] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.242090 1445 ts_tablet_manager.cc:1434] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.242452 1455 raft_consensus.cc:2804] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.242568 1455 raft_consensus.cc:493] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.242651 1455 raft_consensus.cc:3060] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.243831 1455 raft_consensus.cc:515] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.244537 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6583759e2da241cdacedd57415538924" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.244660 1061 raft_consensus.cc:3060] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.245155 1451 leader_election.cc:290] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.245805 1061 raft_consensus.cc:2468] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.246290 1269 leader_election.cc:304] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.246820 1455 leader_election.cc:290] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.246990 1455 raft_consensus.cc:2804] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.247139 1455 raft_consensus.cc:697] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:31.247550 1455 consensus_queue.cc:237] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.250813 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6583759e2da241cdacedd57415538924" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.250818 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6583759e2da241cdacedd57415538924" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:31.251227 1198 raft_consensus.cc:2468] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.253134 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6583759e2da241cdacedd57415538924" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.253329 1196 raft_consensus.cc:2468] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:31.253822 995 leader_election.cc:304] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.254223 1458 raft_consensus.cc:2764] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260317 20:57:31.258478 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6583759e2da241cdacedd57415538924" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:31.269217 799 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 6583759e2da241cdacedd57415538924
I20260317 20:57:31.269800 799 catalog_manager.cc:6741] ReplaceTablet: tablet 6583759e2da241cdacedd57415538924 deleted and replaced by tablet 6eecb8a5cd8243a19ecce3d396e719a6
I20260317 20:57:31.270327 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet 6583759e2da241cdacedd57415538924 with delete_type TABLET_DATA_DELETED (replaced by tablet 6eecb8a5cd8243a19ecce3d396e719a6) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:31.271862 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 6583759e2da241cdacedd57415538924 with delete_type TABLET_DATA_DELETED (replaced by tablet 6eecb8a5cd8243a19ecce3d396e719a6) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:31.272591 798 catalog_manager.cc:2174] created HMS catalog entry for table [id=262f037e46644a98890abee1b764ba1e]
I20260317 20:57:31.272696 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet 6583759e2da241cdacedd57415538924 with delete_type TABLET_DATA_DELETED (replaced by tablet 6eecb8a5cd8243a19ecce3d396e719a6) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:31.273382 1466 tablet_replica.cc:333] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:31.273658 1467 tablet_replica.cc:333] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:31.274108 1467 raft_consensus.cc:2243] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:31.274516 1466 raft_consensus.cc:2243] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.276842 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6eecb8a5cd8243a19ecce3d396e719a6 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.277187 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eecb8a5cd8243a19ecce3d396e719a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.279814 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 6eecb8a5cd8243a19ecce3d396e719a6 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.280192 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eecb8a5cd8243a19ecce3d396e719a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.280191 1445 tablet_bootstrap.cc:492] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.281751 1445 tablet_bootstrap.cc:654] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.283557 1445 tablet_bootstrap.cc:492] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.283677 1445 ts_tablet_manager.cc:1403] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:31.284302 1445 raft_consensus.cc:359] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.284462 1445 raft_consensus.cc:385] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.284507 1445 raft_consensus.cc:740] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.284649 1445 consensus_queue.cc:260] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.285004 1445 ts_tablet_manager.cc:1434] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:31.286078 799 master_service.cc:954] ReplaceTablet: received request to replace tablet 6583759e2da241cdacedd57415538924 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.286386 798 master_service.cc:954] ReplaceTablet: received request to replace tablet 6583759e2da241cdacedd57415538924 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.286749 798 master_service.cc:954] ReplaceTablet: received request to replace tablet 6583759e2da241cdacedd57415538924 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.279858 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 6eecb8a5cd8243a19ecce3d396e719a6 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.285089 1450 leader_election.cc:290] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.287308 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eecb8a5cd8243a19ecce3d396e719a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.287734 798 master_service.cc:954] ReplaceTablet: received request to replace tablet 6583759e2da241cdacedd57415538924 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.288028 798 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_3c0c77756ed5410faefa920adf64821f" } new_table_name: "default.Table_3e019f83132e4014bc96f1473937b0aa" modify_external_catalogs: true
I20260317 20:57:31.290472 1444 tablet_bootstrap.cc:492] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.291729 1444 tablet_bootstrap.cc:654] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.293390 799 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_14970f3e82f542c3ac28906af0b81693" } new_table_name: "default.Table_7ebd9bdc267143a699de00438360c54a" modify_external_catalogs: true
I20260317 20:57:31.294549 1467 pending_rounds.cc:70] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Trying to abort 1 pending ops.
I20260317 20:57:31.294687 1467 pending_rounds.cc:77] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265407185914408960 op_type: NO_OP noop_request { }
I20260317 20:57:31.294806 1467 raft_consensus.cc:2889] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260317 20:57:31.294903 1467 raft_consensus.cc:2272] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.296682 1444 tablet_bootstrap.cc:492] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.296821 1444 ts_tablet_manager.cc:1403] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:31.297461 1444 raft_consensus.cc:359] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.297592 1444 raft_consensus.cc:385] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.297631 1444 raft_consensus.cc:740] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.297775 1444 consensus_queue.cc:260] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.298144 1444 ts_tablet_manager.cc:1434] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:31.299368 1466 raft_consensus.cc:2272] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.300699 1443 tablet_bootstrap.cc:492] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.300819 1443 ts_tablet_manager.cc:1403] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.000s
I20260317 20:57:31.301028 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 6891158271934f21b1f08d094622976e (DEFAULT_TABLE table=default.table_14970f3e82f542c3ac28906af0b81693 [id=262f037e46644a98890abee1b764ba1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.301100 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6891158271934f21b1f08d094622976e (DEFAULT_TABLE table=default.table_14970f3e82f542c3ac28906af0b81693 [id=262f037e46644a98890abee1b764ba1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.301402 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891158271934f21b1f08d094622976e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.301402 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891158271934f21b1f08d094622976e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.301491 1443 raft_consensus.cc:359] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.301617 1443 raft_consensus.cc:385] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.301664 1443 raft_consensus.cc:740] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.301807 1443 consensus_queue.cc:260] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.302127 1443 ts_tablet_manager.cc:1434] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:31.302367 1443 tablet_bootstrap.cc:492] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.303351 1443 tablet_bootstrap.cc:654] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.304214 1445 tablet_bootstrap.cc:492] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.304752 1466 ts_tablet_manager.cc:1916] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.305212 1445 tablet_bootstrap.cc:654] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.306028 1443 tablet_bootstrap.cc:492] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.306181 1443 ts_tablet_manager.cc:1403] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:31.306669 1443 raft_consensus.cc:359] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.306777 1443 raft_consensus.cc:385] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.306816 1443 raft_consensus.cc:740] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.306879 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 6891158271934f21b1f08d094622976e (DEFAULT_TABLE table=default.table_14970f3e82f542c3ac28906af0b81693 [id=262f037e46644a98890abee1b764ba1e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.307006 1466 ts_tablet_manager.cc:1929] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.306975 1443 consensus_queue.cc:260] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.307094 1466 log.cc:1199] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/6583759e2da241cdacedd57415538924
I20260317 20:57:31.307195 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6891158271934f21b1f08d094622976e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.307353 1466 ts_tablet_manager.cc:1950] T 6583759e2da241cdacedd57415538924 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:31.308661 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 6583759e2da241cdacedd57415538924 (table default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:31.308908 1465 tablet_replica.cc:333] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:31.309202 1465 raft_consensus.cc:2243] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.309464 1465 raft_consensus.cc:2272] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.310302 1445 tablet_bootstrap.cc:492] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.310328 1444 tablet_bootstrap.cc:492] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.310408 1445 ts_tablet_manager.cc:1403] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:31.310926 1445 raft_consensus.cc:359] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.311054 1445 raft_consensus.cc:385] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.311086 1445 raft_consensus.cc:740] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.311214 1445 consensus_queue.cc:260] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.311452 1444 tablet_bootstrap.cc:654] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.313117 1467 ts_tablet_manager.cc:1916] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.313488 1445 ts_tablet_manager.cc:1434] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260317 20:57:31.315392 1465 ts_tablet_manager.cc:1916] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.315616 1443 ts_tablet_manager.cc:1434] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20260317 20:57:31.315709 1467 ts_tablet_manager.cc:1929] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:31.315804 1467 log.cc:1199] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/6583759e2da241cdacedd57415538924
I20260317 20:57:31.316131 1467 ts_tablet_manager.cc:1950] T 6583759e2da241cdacedd57415538924 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:31.317449 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 6583759e2da241cdacedd57415538924 (table default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:31.317760 1443 tablet_bootstrap.cc:492] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.317806 1465 ts_tablet_manager.cc:1929] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.317904 1465 log.cc:1199] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/6583759e2da241cdacedd57415538924
I20260317 20:57:31.318197 1465 ts_tablet_manager.cc:1950] T 6583759e2da241cdacedd57415538924 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:31.318521 1444 tablet_bootstrap.cc:492] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.318615 1444 ts_tablet_manager.cc:1403] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:31.318876 1443 tablet_bootstrap.cc:654] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.319068 1444 raft_consensus.cc:359] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.319198 1444 raft_consensus.cc:385] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.319240 1444 raft_consensus.cc:740] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.319382 1444 consensus_queue.cc:260] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.319399 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 6583759e2da241cdacedd57415538924 (table default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:31.319684 1444 ts_tablet_manager.cc:1434] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:31.327682 1443 tablet_bootstrap.cc:492] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.327826 1443 ts_tablet_manager.cc:1403] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20260317 20:57:31.328413 1443 raft_consensus.cc:359] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.328553 1443 raft_consensus.cc:385] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.328594 1443 raft_consensus.cc:740] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.328768 1443 consensus_queue.cc:260] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.331563 1443 ts_tablet_manager.cc:1434] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:31.336750 797 catalog_manager.cc:2174] created HMS catalog entry for table [id=8f5019afc57c4b86bf898f058e3bf9d9]
I20260317 20:57:31.348261 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 64b829b5386c4ed39f581fdce1dbd0b7 (DEFAULT_TABLE table=default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.348626 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b829b5386c4ed39f581fdce1dbd0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.348827 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 64b829b5386c4ed39f581fdce1dbd0b7 (DEFAULT_TABLE table=default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.349138 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b829b5386c4ed39f581fdce1dbd0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.351079 1443 tablet_bootstrap.cc:492] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.351392 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 64b829b5386c4ed39f581fdce1dbd0b7 (DEFAULT_TABLE table=default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.351471 1445 tablet_bootstrap.cc:492] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.351701 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b829b5386c4ed39f581fdce1dbd0b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.352257 1443 tablet_bootstrap.cc:654] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.352546 1445 tablet_bootstrap.cc:654] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.353983 1444 tablet_bootstrap.cc:492] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.355089 1444 tablet_bootstrap.cc:654] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
W20260317 20:57:31.355875 1383 tablet.cc:2379] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260317 20:57:31.355911 797 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_7d4fb7b8d8a84fa4b89f045e59a9c77c" } new_table_name: "default.Table_17c2097cd322498e80bb464abfd17703" modify_external_catalogs: true
I20260317 20:57:31.357477 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet 6583759e2da241cdacedd57415538924 with delete_type TABLET_DATA_DELETED (replaced by tablet 6eecb8a5cd8243a19ecce3d396e719a6) from {username='slave'} at 127.0.0.1:60100
W20260317 20:57:31.358234 786 catalog_manager.cc:4969] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet 6583759e2da241cdacedd57415538924 because the tablet was not found. No further retry: Not found: Tablet not found: 6583759e2da241cdacedd57415538924
I20260317 20:57:31.362082 1445 tablet_bootstrap.cc:492] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.362110 1444 tablet_bootstrap.cc:492] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.362203 1444 ts_tablet_manager.cc:1403] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:31.362203 1445 ts_tablet_manager.cc:1403] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20260317 20:57:31.362728 1444 raft_consensus.cc:359] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.362728 1445 raft_consensus.cc:359] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.362844 1444 raft_consensus.cc:385] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.362844 1445 raft_consensus.cc:385] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.362879 1444 raft_consensus.cc:740] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.362879 1445 raft_consensus.cc:740] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.363013 1445 consensus_queue.cc:260] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.363013 1444 consensus_queue.cc:260] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.363301 1444 ts_tablet_manager.cc:1434] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:31.363312 1445 ts_tablet_manager.cc:1434] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.364200 1443 tablet_bootstrap.cc:492] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.364339 1443 ts_tablet_manager.cc:1403] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260317 20:57:31.364894 1443 raft_consensus.cc:359] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.365022 1443 raft_consensus.cc:385] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.365063 1443 raft_consensus.cc:740] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.365206 1443 consensus_queue.cc:260] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.365509 1443 ts_tablet_manager.cc:1434] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.369376 1458 raft_consensus.cc:493] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.369527 1458 raft_consensus.cc:515] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.370675 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b829b5386c4ed39f581fdce1dbd0b7" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:31.370819 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b829b5386c4ed39f581fdce1dbd0b7" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.370878 1334 raft_consensus.cc:2468] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:31.370988 1197 raft_consensus.cc:2468] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:31.370019 1458 leader_election.cc:290] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.371378 995 leader_election.cc:304] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.371860 1458 raft_consensus.cc:2804] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.371937 1458 raft_consensus.cc:493] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.371975 1458 raft_consensus.cc:3060] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.373116 1458 raft_consensus.cc:515] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.373548 1458 leader_election.cc:290] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.374179 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b829b5386c4ed39f581fdce1dbd0b7" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:31.374318 1334 raft_consensus.cc:3060] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.375412 1334 raft_consensus.cc:2468] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:31.375829 996 leader_election.cc:304] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.376428 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b829b5386c4ed39f581fdce1dbd0b7" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:31.376586 1197 raft_consensus.cc:3060] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.377830 1197 raft_consensus.cc:2468] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:31.378439 1458 raft_consensus.cc:2804] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.379675 1458 raft_consensus.cc:697] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:31.379997 1458 consensus_queue.cc:237] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.387965 795 catalog_manager.cc:2174] created HMS catalog entry for table [id=1cd283f53e8044d59ad724ebe7f9bb93]
I20260317 20:57:31.394398 1449 raft_consensus.cc:493] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.394568 1449 raft_consensus.cc:515] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.395792 795 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_a26747a8e2de47f5a6f00cfc3fa59c1f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:31.396023 1449 leader_election.cc:290] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.405467 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3efed8b3631c4b5f8f779e95a33a4155 (DEFAULT_TABLE table=default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.405826 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efed8b3631c4b5f8f779e95a33a4155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.405820 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 3efed8b3631c4b5f8f779e95a33a4155 (DEFAULT_TABLE table=default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.406102 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efed8b3631c4b5f8f779e95a33a4155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.408186 1445 tablet_bootstrap.cc:492] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.408243 1450 raft_consensus.cc:493] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.408314 1450 raft_consensus.cc:515] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.408664 1444 tablet_bootstrap.cc:492] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.408712 1450 leader_election.cc:290] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.409304 1445 tablet_bootstrap.cc:654] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.409826 1444 tablet_bootstrap.cc:654] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.409909 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 3efed8b3631c4b5f8f779e95a33a4155 (DEFAULT_TABLE table=default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.410190 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecb8a5cd8243a19ecce3d396e719a6" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.410347 1197 raft_consensus.cc:2468] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.410567 1458 raft_consensus.cc:493] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.410636 1458 raft_consensus.cc:515] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.410987 1458 leader_election.cc:290] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.411586 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecb8a5cd8243a19ecce3d396e719a6" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:31.411705 1334 raft_consensus.cc:2468] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:31.412264 996 leader_election.cc:304] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.412588 1268 leader_election.cc:304] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:31.412748 1450 raft_consensus.cc:2804] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.412786 1450 raft_consensus.cc:493] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.412818 1450 raft_consensus.cc:3060] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.413833 1450 raft_consensus.cc:515] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.414258 1450 leader_election.cc:290] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.415009 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecb8a5cd8243a19ecce3d396e719a6" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:31.415148 1196 raft_consensus.cc:3060] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.416230 1196 raft_consensus.cc:2468] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.416661 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecb8a5cd8243a19ecce3d396e719a6" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.416821 1197 raft_consensus.cc:2393] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92d68c1a3a2642cca908f2c7e9d7e13a in current term 1: Already voted for candidate 630e777e97c141a69e35660f32b26f6d in this term.
W20260317 20:57:31.417569 1247 tablet.cc:2379] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260317 20:57:31.418347 1268 leader_election.cc:304] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:31.418972 1455 raft_consensus.cc:2804] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.419093 1455 raft_consensus.cc:697] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:31.419134 1462 raft_consensus.cc:493] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.419195 1462 raft_consensus.cc:515] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.419267 1455 consensus_queue.cc:237] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.419498 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecb8a5cd8243a19ecce3d396e719a6" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.419600 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891158271934f21b1f08d094622976e" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:31.419644 1060 raft_consensus.cc:3060] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.419718 1334 raft_consensus.cc:2468] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:31.419611 1462 leader_election.cc:290] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.420375 1058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11d10f48472444bbd662af1c02c6bb9" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.420496 1058 raft_consensus.cc:2468] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.420847 1060 raft_consensus.cc:2468] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.421082 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891158271934f21b1f08d094622976e" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.421193 1059 raft_consensus.cc:2468] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:31.419494 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecb8a5cd8243a19ecce3d396e719a6" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.421466 1061 raft_consensus.cc:2376] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1. Re-sending same reply.
I20260317 20:57:31.410244 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3efed8b3631c4b5f8f779e95a33a4155. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.424319 1443 tablet_bootstrap.cc:492] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.424499 1458 raft_consensus.cc:2764] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260317 20:57:31.424950 1133 leader_election.cc:304] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:31.425582 1443 tablet_bootstrap.cc:654] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.425559 1449 raft_consensus.cc:2804] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.425625 1449 raft_consensus.cc:493] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.425663 1449 raft_consensus.cc:3060] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.426807 1449 raft_consensus.cc:515] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.427224 1449 leader_election.cc:290] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.427836 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891158271934f21b1f08d094622976e" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.427966 1061 raft_consensus.cc:3060] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.429000 1061 raft_consensus.cc:2468] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:31.429723 1133 leader_election.cc:304] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.429989 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11d10f48472444bbd662af1c02c6bb9" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.430163 1197 raft_consensus.cc:2468] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.430536 1269 leader_election.cc:304] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.430774 1462 raft_consensus.cc:2804] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.430843 1462 raft_consensus.cc:493] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.430877 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6891158271934f21b1f08d094622976e" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:31.430996 1334 raft_consensus.cc:3060] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.431609 1449 raft_consensus.cc:2804] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.431854 1449 raft_consensus.cc:697] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:31.432026 1334 raft_consensus.cc:2468] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:31.432155 1449 consensus_queue.cc:237] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.430884 1462 raft_consensus.cc:3060] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.433184 1462 raft_consensus.cc:515] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.433564 1462 leader_election.cc:290] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.434314 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11d10f48472444bbd662af1c02c6bb9" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:31.434448 1197 raft_consensus.cc:3060] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.435395 1197 raft_consensus.cc:2468] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.435756 1268 leader_election.cc:304] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:31.436610 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b11d10f48472444bbd662af1c02c6bb9" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.436753 1061 raft_consensus.cc:3060] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.436877 1444 tablet_bootstrap.cc:492] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.437000 1444 ts_tablet_manager.cc:1403] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20260317 20:57:31.437578 1444 raft_consensus.cc:359] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.437708 1444 raft_consensus.cc:385] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.437698 1061 raft_consensus.cc:2468] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.437753 1444 raft_consensus.cc:740] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.437903 1444 consensus_queue.cc:260] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.438262 1444 ts_tablet_manager.cc:1434] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:31.438436 1450 raft_consensus.cc:2804] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.438525 1450 raft_consensus.cc:697] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:31.438670 1450 consensus_queue.cc:237] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.442811 1443 tablet_bootstrap.cc:492] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.442942 1443 ts_tablet_manager.cc:1403] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260317 20:57:31.443452 1443 raft_consensus.cc:359] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.443583 1443 raft_consensus.cc:385] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.443621 1443 raft_consensus.cc:740] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.443747 1443 consensus_queue.cc:260] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.444024 1443 ts_tablet_manager.cc:1434] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.454203 1445 tablet_bootstrap.cc:492] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.454365 1445 ts_tablet_manager.cc:1403] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.000s
I20260317 20:57:31.454980 1445 raft_consensus.cc:359] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.455138 1445 raft_consensus.cc:385] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.455189 1445 raft_consensus.cc:740] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.455353 1445 consensus_queue.cc:260] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.455929 1445 ts_tablet_manager.cc:1434] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.478629 793 catalog_manager.cc:2174] created HMS catalog entry for table [id=4f4af9891c564a5b8d43526c2e917ae7]
I20260317 20:57:31.484407 793 catalog_manager.cc:5671] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:31.504791 1041 tablet_service.cc:1511] Processing CreateTablet for tablet eb1d6f3d7d174730bd8c32e89bb5c984 (DEFAULT_TABLE table=default.table_85e2216401ff46efa6722e98254db955 [id=4f4af9891c564a5b8d43526c2e917ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.505134 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1d6f3d7d174730bd8c32e89bb5c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.506330 1314 tablet_service.cc:1511] Processing CreateTablet for tablet eb1d6f3d7d174730bd8c32e89bb5c984 (DEFAULT_TABLE table=default.table_85e2216401ff46efa6722e98254db955 [id=4f4af9891c564a5b8d43526c2e917ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.506634 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1d6f3d7d174730bd8c32e89bb5c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.509044 1444 tablet_bootstrap.cc:492] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.510288 1444 tablet_bootstrap.cc:654] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.513550 1445 tablet_bootstrap.cc:492] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.513805 1178 tablet_service.cc:1511] Processing CreateTablet for tablet eb1d6f3d7d174730bd8c32e89bb5c984 (DEFAULT_TABLE table=default.table_85e2216401ff46efa6722e98254db955 [id=4f4af9891c564a5b8d43526c2e917ae7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.514163 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb1d6f3d7d174730bd8c32e89bb5c984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.515727 1445 tablet_bootstrap.cc:654] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.516578 1443 tablet_bootstrap.cc:492] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.517870 1443 tablet_bootstrap.cc:654] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.518765 796 catalog_manager.cc:2174] created HMS catalog entry for table [id=51ef4172c7b74b36881a86b814419bb6]
I20260317 20:57:31.519613 793 catalog_manager.cc:5671] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:31.521152 1444 tablet_bootstrap.cc:492] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.521255 1444 ts_tablet_manager.cc:1403] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260317 20:57:31.521796 1444 raft_consensus.cc:359] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.521929 1444 raft_consensus.cc:385] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.521971 1444 raft_consensus.cc:740] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.522138 1444 consensus_queue.cc:260] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.522775 1443 tablet_bootstrap.cc:492] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.522926 1443 ts_tablet_manager.cc:1403] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:31.522992 1445 tablet_bootstrap.cc:492] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.523089 1445 ts_tablet_manager.cc:1403] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260317 20:57:31.523499 1443 raft_consensus.cc:359] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.523608 1443 raft_consensus.cc:385] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.523641 1443 raft_consensus.cc:740] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.523607 1445 raft_consensus.cc:359] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.523705 1445 raft_consensus.cc:385] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.523738 1445 raft_consensus.cc:740] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.523766 1443 consensus_queue.cc:260] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.523856 1445 consensus_queue.cc:260] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.524092 1443 ts_tablet_manager.cc:1434] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.527345 1444 ts_tablet_manager.cc:1434] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260317 20:57:31.527700 1445 ts_tablet_manager.cc:1434] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260317 20:57:31.530457 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.254:45865
--webserver_interface=127.0.102.254
--webserver_port=37411
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260317 20:57:31.537489 793 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_e5d6d92a3e994614a3975dcf29c3db11" } modify_external_catalogs: true
I20260317 20:57:31.538736 793 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_e5d6d92a3e994614a3975dcf29c3db11" } modify_external_catalogs: true
I20260317 20:57:31.542520 796 catalog_manager.cc:5671] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:31.542882 796 catalog_manager.cc:5671] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:31.543969 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 6f594a73e1d84d37813e71ee70b81800 (DEFAULT_TABLE table=default.table_4dbc50b14c244bfba10bd8a152d0ad78 [id=51ef4172c7b74b36881a86b814419bb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.544318 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f594a73e1d84d37813e71ee70b81800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.546480 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6f594a73e1d84d37813e71ee70b81800 (DEFAULT_TABLE table=default.table_4dbc50b14c244bfba10bd8a152d0ad78 [id=51ef4172c7b74b36881a86b814419bb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.546797 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f594a73e1d84d37813e71ee70b81800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.550537 1445 tablet_bootstrap.cc:492] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.550787 1444 tablet_bootstrap.cc:492] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.552057 1445 tablet_bootstrap.cc:654] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.553435 1444 tablet_bootstrap.cc:654] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.555342 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 6f594a73e1d84d37813e71ee70b81800 (DEFAULT_TABLE table=default.table_4dbc50b14c244bfba10bd8a152d0ad78 [id=51ef4172c7b74b36881a86b814419bb6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.555706 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f594a73e1d84d37813e71ee70b81800. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.558441 1443 tablet_bootstrap.cc:492] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.559633 1443 tablet_bootstrap.cc:654] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.565877 794 catalog_manager.cc:2174] created HMS catalog entry for table [id=4e5a8129f6854a90b31140e70ff041c8]
I20260317 20:57:31.568874 796 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_a4bf6942f68c4cf1b3a98aa499f6d466"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:31.571888 794 master_service.cc:954] ReplaceTablet: received request to replace tablet 6eecb8a5cd8243a19ecce3d396e719a6 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.575934 794 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 6eecb8a5cd8243a19ecce3d396e719a6
I20260317 20:57:31.576257 794 catalog_manager.cc:6741] ReplaceTablet: tablet 6eecb8a5cd8243a19ecce3d396e719a6 deleted and replaced by tablet 5ed1b9bbdeb04e44a548aca0800d9198
I20260317 20:57:31.576476 794 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_85e2216401ff46efa6722e98254db955" } modify_external_catalogs: true
I20260317 20:57:31.576630 794 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_85e2216401ff46efa6722e98254db955" } modify_external_catalogs: true
I20260317 20:57:31.577611 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eecb8a5cd8243a19ecce3d396e719a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ed1b9bbdeb04e44a548aca0800d9198) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:31.577888 1467 tablet_replica.cc:333] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:31.577898 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eecb8a5cd8243a19ecce3d396e719a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ed1b9bbdeb04e44a548aca0800d9198) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:31.578075 1467 raft_consensus.cc:2243] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:31.578272 1467 pending_rounds.cc:70] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Trying to abort 1 pending ops.
I20260317 20:57:31.578297 1466 tablet_replica.cc:333] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:31.578328 1467 pending_rounds.cc:77] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265407186614534144 op_type: NO_OP noop_request { }
I20260317 20:57:31.578394 1467 raft_consensus.cc:2889] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260317 20:57:31.578419 1466 raft_consensus.cc:2243] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.578455 1467 raft_consensus.cc:2272] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.578522 1466 raft_consensus.cc:2272] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.579149 1466 ts_tablet_manager.cc:1916] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.579149 1467 ts_tablet_manager.cc:1916] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.581454 1466 ts_tablet_manager.cc:1929] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.581454 1467 ts_tablet_manager.cc:1929] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:31.581537 1466 log.cc:1199] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/6eecb8a5cd8243a19ecce3d396e719a6
I20260317 20:57:31.581537 1467 log.cc:1199] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/6eecb8a5cd8243a19ecce3d396e719a6
I20260317 20:57:31.581764 1466 ts_tablet_manager.cc:1950] T 6eecb8a5cd8243a19ecce3d396e719a6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:31.581789 1467 ts_tablet_manager.cc:1950] T 6eecb8a5cd8243a19ecce3d396e719a6 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:31.582779 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 6eecb8a5cd8243a19ecce3d396e719a6 (table default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:31.583012 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 6eecb8a5cd8243a19ecce3d396e719a6 (table default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:31.583735 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eecb8a5cd8243a19ecce3d396e719a6 with delete_type TABLET_DATA_DELETED (replaced by tablet 5ed1b9bbdeb04e44a548aca0800d9198) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:31.583941 1465 tablet_replica.cc:333] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:31.584065 1465 raft_consensus.cc:2243] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.584190 1465 raft_consensus.cc:2272] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.584885 1465 ts_tablet_manager.cc:1916] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.587244 934 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:31.587404 934 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:31.587489 1465 ts_tablet_manager.cc:1929] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.587569 1465 log.cc:1199] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/6eecb8a5cd8243a19ecce3d396e719a6
I20260317 20:57:31.587781 1465 ts_tablet_manager.cc:1950] T 6eecb8a5cd8243a19ecce3d396e719a6 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:31.590512 1041 tablet_service.cc:1511] Processing CreateTablet for tablet cd2bbbaf425c4998a6913b1444740bb4 (DEFAULT_TABLE table=default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.590899 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2bbbaf425c4998a6913b1444740bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.592490 1314 tablet_service.cc:1511] Processing CreateTablet for tablet cd2bbbaf425c4998a6913b1444740bb4 (DEFAULT_TABLE table=default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.593036 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2bbbaf425c4998a6913b1444740bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.596686 1178 tablet_service.cc:1511] Processing CreateTablet for tablet cd2bbbaf425c4998a6913b1444740bb4 (DEFAULT_TABLE table=default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.597100 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd2bbbaf425c4998a6913b1444740bb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.601085 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 6eecb8a5cd8243a19ecce3d396e719a6 (table default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:31.607064 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.607172 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.607455 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed1b9bbdeb04e44a548aca0800d9198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.607455 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed1b9bbdeb04e44a548aca0800d9198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.611431 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (DEFAULT_TABLE table=default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.611778 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ed1b9bbdeb04e44a548aca0800d9198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.619032 1443 tablet_bootstrap.cc:492] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.619176 1443 ts_tablet_manager.cc:1403] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.000s
I20260317 20:57:31.619172 792 catalog_manager.cc:2174] created HMS catalog entry for table [id=151f2703b99946fb99c43b1ac473b677]
I20260317 20:57:31.619689 1443 raft_consensus.cc:359] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.619810 1443 raft_consensus.cc:385] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.619838 1443 raft_consensus.cc:740] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.619968 1443 consensus_queue.cc:260] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.620254 1443 ts_tablet_manager.cc:1434] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.620467 1443 tablet_bootstrap.cc:492] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.621608 1443 tablet_bootstrap.cc:654] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.631261 792 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_e904ff4d06de42e3a58e46251d6e96f4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:31.635659 1444 tablet_bootstrap.cc:492] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.635789 1444 ts_tablet_manager.cc:1403] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.085s user 0.002s sys 0.000s
I20260317 20:57:31.636341 1444 raft_consensus.cc:359] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.636488 1444 raft_consensus.cc:385] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.636529 1444 raft_consensus.cc:740] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.636693 1444 consensus_queue.cc:260] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.640106 1444 ts_tablet_manager.cc:1434] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:31.642386 1444 tablet_bootstrap.cc:492] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.643437 1444 tablet_bootstrap.cc:654] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.645774 1445 tablet_bootstrap.cc:492] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.645874 1443 tablet_bootstrap.cc:492] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.645910 1445 ts_tablet_manager.cc:1403] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.095s user 0.002s sys 0.000s
I20260317 20:57:31.645965 1443 ts_tablet_manager.cc:1403] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20260317 20:57:31.646534 1445 raft_consensus.cc:359] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.646683 1445 raft_consensus.cc:385] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.646723 1445 raft_consensus.cc:740] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.646659 1443 raft_consensus.cc:359] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.646771 1443 raft_consensus.cc:385] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.646807 1443 raft_consensus.cc:740] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.646915 1445 consensus_queue.cc:260] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.647006 1443 consensus_queue.cc:260] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.647416 1443 ts_tablet_manager.cc:1434] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260317 20:57:31.647720 1443 tablet_bootstrap.cc:492] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.650714 1443 tablet_bootstrap.cc:654] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.652853 1445 ts_tablet_manager.cc:1434] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260317 20:57:31.655125 1445 tablet_bootstrap.cc:492] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.656275 1445 tablet_bootstrap.cc:654] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.660157 791 catalog_manager.cc:2174] created HMS catalog entry for table [id=a4ba9bce277146cc8c2a1cfcbf90f951]
I20260317 20:57:31.660671 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 4dcaf5ab229445bda791c6e807c60034 (DEFAULT_TABLE table=default.table_8e39f763b78b443eb64d97cb4d88570a [id=151f2703b99946fb99c43b1ac473b677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.660709 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 4dcaf5ab229445bda791c6e807c60034 (DEFAULT_TABLE table=default.table_8e39f763b78b443eb64d97cb4d88570a [id=151f2703b99946fb99c43b1ac473b677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.660997 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dcaf5ab229445bda791c6e807c60034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.660997 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dcaf5ab229445bda791c6e807c60034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.663219 1450 raft_consensus.cc:493] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.663352 1450 raft_consensus.cc:515] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.663820 1450 leader_election.cc:290] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.664294 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1d6f3d7d174730bd8c32e89bb5c984" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.664429 1061 raft_consensus.cc:2468] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.664712 1269 leader_election.cc:304] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.665271 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1d6f3d7d174730bd8c32e89bb5c984" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.665422 1197 raft_consensus.cc:2468] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.666031 1450 raft_consensus.cc:2804] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.666131 1450 raft_consensus.cc:493] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.666183 1450 raft_consensus.cc:3060] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.667215 1450 raft_consensus.cc:515] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.667641 1450 leader_election.cc:290] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.668188 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1d6f3d7d174730bd8c32e89bb5c984" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.668287 1443 tablet_bootstrap.cc:492] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.668334 1061 raft_consensus.cc:3060] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.668412 1443 ts_tablet_manager.cc:1403] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.001s
I20260317 20:57:31.668972 1443 raft_consensus.cc:359] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.669112 1443 raft_consensus.cc:385] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.669149 1443 raft_consensus.cc:740] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.669327 1443 consensus_queue.cc:260] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.669406 1061 raft_consensus.cc:2468] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.669694 1443 ts_tablet_manager.cc:1434] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.669816 1269 leader_election.cc:304] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.671638 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb1d6f3d7d174730bd8c32e89bb5c984" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:31.671809 1197 raft_consensus.cc:3060] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.673102 1197 raft_consensus.cc:2468] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.674865 791 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 10) took 1008 ms. Trace:
I20260317 20:57:31.674993 791 rpcz_store.cc:276] 0317 20:57:30.666729 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:30.666767 (+ 38us) service_pool.cc:225] Handling call
0317 20:57:31.155618 (+488851us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:31.155907 (+ 289us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:31.660148 (+504241us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:31.674626 (+ 14478us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:31.674743 (+ 117us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:31.674839 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:31.660665 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:31.660773 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:31.660777 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:31.660779 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:31.660845 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:31.660855 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:31.660858 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:31.660910 (+ 52us) tablet.cc:700] Row locks acquired
0317 20:57:31.660911 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:31.660937 (+ 26us) write_op.cc:270] Start()
0317 20:57:31.660959 (+ 22us) write_op.cc:276] Timestamp: P: 1773781051660890 usec, L: 0
0317 20:57:31.660961 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:31.661128 (+ 167us) log.cc:844] Serialized 432 byte log entry
0317 20:57:31.664567 (+ 3439us) op_driver.cc:464] REPLICATION: finished
0317 20:57:31.674098 (+ 9531us) write_op.cc:301] APPLY: starting
0317 20:57:31.674137 (+ 39us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:31.674176 (+ 39us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:31.674194 (+ 18us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:31.674302 (+ 108us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:31.674342 (+ 40us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:31.674351 (+ 9us) write_op.cc:312] APPLY: finished
0317 20:57:31.674445 (+ 94us) log.cc:844] Serialized 28 byte log entry
0317 20:57:31.674508 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:31.674528 (+ 20us) write_op.cc:454] Released schema lock
0317 20:57:31.674536 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:31.674622 (+ 86us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:31.674625 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":463019,"Hive Metastore.run_cpu_time_us":183,"Hive Metastore.run_wall_time_us":41009,"spinlock_wait_cycles":33152,"child_traces":[["op",{"apply.queue_time_us":9410,"apply.run_cpu_time_us":530,"apply.run_wall_time_us":532,"num_ops":2,"prepare.queue_time_us":85,"prepare.run_cpu_time_us":546,"prepare.run_wall_time_us":547,"raft.queue_time_us":678,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":168,"replication_time_us":3577}]]}
I20260317 20:57:31.678841 791 master_service.cc:954] ReplaceTablet: received request to replace tablet 64b829b5386c4ed39f581fdce1dbd0b7 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.683614 1450 raft_consensus.cc:2804] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.683766 1450 raft_consensus.cc:697] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:31.683912 1450 consensus_queue.cc:237] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.686221 1444 tablet_bootstrap.cc:492] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.686352 1444 ts_tablet_manager.cc:1403] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20260317 20:57:31.686916 1444 raft_consensus.cc:359] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.687052 1444 raft_consensus.cc:385] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.687093 1444 raft_consensus.cc:740] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.689429 1443 tablet_bootstrap.cc:492] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.689459 791 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 64b829b5386c4ed39f581fdce1dbd0b7
I20260317 20:57:31.689806 791 catalog_manager.cc:6741] ReplaceTablet: tablet 64b829b5386c4ed39f581fdce1dbd0b7 deleted and replaced by tablet 487a2d92c3614dbe801d9e4d478ce9ac
I20260317 20:57:31.689917 1445 tablet_bootstrap.cc:492] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.690006 1445 ts_tablet_manager.cc:1403] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20260317 20:57:31.690598 1445 raft_consensus.cc:359] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.690716 1443 tablet_bootstrap.cc:654] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.690734 1445 raft_consensus.cc:385] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.690774 1445 raft_consensus.cc:740] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.690908 1445 consensus_queue.cc:260] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.691222 1445 ts_tablet_manager.cc:1434] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:31.691466 1445 tablet_bootstrap.cc:492] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.691960 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 64b829b5386c4ed39f581fdce1dbd0b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 487a2d92c3614dbe801d9e4d478ce9ac) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:31.692052 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 64b829b5386c4ed39f581fdce1dbd0b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 487a2d92c3614dbe801d9e4d478ce9ac) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:31.692137 1466 tablet_replica.cc:333] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:31.692255 1466 raft_consensus.cc:2243] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:31.692580 1466 pending_rounds.cc:70] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Trying to abort 1 pending ops.
I20260317 20:57:31.692706 1466 pending_rounds.cc:77] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265407186456547328 op_type: NO_OP noop_request { }
I20260317 20:57:31.692826 1466 raft_consensus.cc:2889] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260317 20:57:31.692903 1466 raft_consensus.cc:2272] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.693097 1467 tablet_replica.cc:333] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:31.693250 1467 raft_consensus.cc:2243] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.693444 1467 raft_consensus.cc:2272] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.693244 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 4dcaf5ab229445bda791c6e807c60034 (DEFAULT_TABLE table=default.table_8e39f763b78b443eb64d97cb4d88570a [id=151f2703b99946fb99c43b1ac473b677]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.693807 1466 ts_tablet_manager.cc:1916] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.693841 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dcaf5ab229445bda791c6e807c60034. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.695191 1444 consensus_queue.cc:260] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.696236 1466 ts_tablet_manager.cc:1929] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:31.696321 1466 log.cc:1199] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/64b829b5386c4ed39f581fdce1dbd0b7
I20260317 20:57:31.696408 1041 tablet_service.cc:1511] Processing CreateTablet for tablet e7a541291c504f98a7e6c887d6ef695b (DEFAULT_TABLE table=default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.696586 1466 ts_tablet_manager.cc:1950] T 64b829b5386c4ed39f581fdce1dbd0b7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:31.696723 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a541291c504f98a7e6c887d6ef695b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.696878 1444 ts_tablet_manager.cc:1434] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.010s user 0.000s sys 0.001s
I20260317 20:57:31.697907 1467 ts_tablet_manager.cc:1916] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.698159 791 master_service.cc:954] ReplaceTablet: received request to replace tablet 64b829b5386c4ed39f581fdce1dbd0b7 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.698439 791 master_service.cc:954] ReplaceTablet: received request to replace tablet 3efed8b3631c4b5f8f779e95a33a4155 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.698529 1444 tablet_bootstrap.cc:492] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.699818 1444 tablet_bootstrap.cc:654] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.699877 1313 tablet_service.cc:1511] Processing CreateTablet for tablet e7a541291c504f98a7e6c887d6ef695b (DEFAULT_TABLE table=default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.700201 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a541291c504f98a7e6c887d6ef695b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.700603 1467 ts_tablet_manager.cc:1929] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.700663 1467 log.cc:1199] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/64b829b5386c4ed39f581fdce1dbd0b7
I20260317 20:57:31.700862 1467 ts_tablet_manager.cc:1950] T 64b829b5386c4ed39f581fdce1dbd0b7 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:31.702280 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 64b829b5386c4ed39f581fdce1dbd0b7 (table default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
I20260317 20:57:31.702721 1445 tablet_bootstrap.cc:654] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.702730 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 64b829b5386c4ed39f581fdce1dbd0b7 (table default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
I20260317 20:57:31.702993 1177 tablet_service.cc:1511] Processing CreateTablet for tablet e7a541291c504f98a7e6c887d6ef695b (DEFAULT_TABLE table=default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.703372 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7a541291c504f98a7e6c887d6ef695b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.705209 1444 tablet_bootstrap.cc:492] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.705327 1444 ts_tablet_manager.cc:1403] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260317 20:57:31.705834 1444 raft_consensus.cc:359] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.705960 1444 raft_consensus.cc:385] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.706000 1444 raft_consensus.cc:740] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.706811 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet 64b829b5386c4ed39f581fdce1dbd0b7 with delete_type TABLET_DATA_DELETED (replaced by tablet 487a2d92c3614dbe801d9e4d478ce9ac) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:31.706995 1465 tablet_replica.cc:333] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:31.707001 1445 tablet_bootstrap.cc:492] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.707101 1445 ts_tablet_manager.cc:1403] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260317 20:57:31.707139 1465 raft_consensus.cc:2243] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.707253 1465 raft_consensus.cc:2272] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.707720 1465 ts_tablet_manager.cc:1916] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.708686 1445 raft_consensus.cc:359] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.708811 1445 raft_consensus.cc:385] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.708854 1445 raft_consensus.cc:740] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.709038 1444 consensus_queue.cc:260] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.709595 1443 tablet_bootstrap.cc:492] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.709676 1443 ts_tablet_manager.cc:1403] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.002s
I20260317 20:57:31.709728 791 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 3efed8b3631c4b5f8f779e95a33a4155
I20260317 20:57:31.709903 1465 ts_tablet_manager.cc:1929] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.709969 1465 log.cc:1199] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/64b829b5386c4ed39f581fdce1dbd0b7
I20260317 20:57:31.710259 1465 ts_tablet_manager.cc:1950] T 64b829b5386c4ed39f581fdce1dbd0b7 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:31.710215 1443 raft_consensus.cc:359] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.710331 1443 raft_consensus.cc:385] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.710371 1443 raft_consensus.cc:740] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.710522 1443 consensus_queue.cc:260] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.710817 791 catalog_manager.cc:6741] ReplaceTablet: tablet 3efed8b3631c4b5f8f779e95a33a4155 deleted and replaced by tablet 05afc5b78c3b4724850eb1f994b4ccf3
I20260317 20:57:31.710860 1443 ts_tablet_manager.cc:1434] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260317 20:57:31.710899 1444 ts_tablet_manager.cc:1434] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260317 20:57:31.711058 1443 tablet_bootstrap.cc:492] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.711865 791 catalog_manager.cc:5671] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:31.712272 1443 tablet_bootstrap.cc:654] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.712766 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 64b829b5386c4ed39f581fdce1dbd0b7 (table default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
I20260317 20:57:31.714270 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 3efed8b3631c4b5f8f779e95a33a4155 with delete_type TABLET_DATA_DELETED (replaced by tablet 05afc5b78c3b4724850eb1f994b4ccf3) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:31.715169 1445 consensus_queue.cc:260] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.715265 1465 tablet_replica.cc:333] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:31.715387 1465 raft_consensus.cc:2243] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.715487 1465 raft_consensus.cc:2272] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.716164 1444 tablet_bootstrap.cc:492] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.716410 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 3efed8b3631c4b5f8f779e95a33a4155 with delete_type TABLET_DATA_DELETED (replaced by tablet 05afc5b78c3b4724850eb1f994b4ccf3) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:31.716645 1465 ts_tablet_manager.cc:1916] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.716663 1466 tablet_replica.cc:333] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:31.716799 1466 raft_consensus.cc:2243] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.716955 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 3efed8b3631c4b5f8f779e95a33a4155 with delete_type TABLET_DATA_DELETED (replaced by tablet 05afc5b78c3b4724850eb1f994b4ccf3) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:31.717125 1467 tablet_replica.cc:333] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:31.717242 1467 raft_consensus.cc:2243] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:31.717357 1467 raft_consensus.cc:2272] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.717824 1467 ts_tablet_manager.cc:1916] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.718494 1466 raft_consensus.cc:2272] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:31.718815 1445 ts_tablet_manager.cc:1434] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20260317 20:57:31.718990 1466 ts_tablet_manager.cc:1916] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:31.719575 1445 tablet_bootstrap.cc:492] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.720024 1467 ts_tablet_manager.cc:1929] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.720085 1467 log.cc:1199] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/3efed8b3631c4b5f8f779e95a33a4155
I20260317 20:57:31.720280 1467 ts_tablet_manager.cc:1950] T 3efed8b3631c4b5f8f779e95a33a4155 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:31.720592 1445 tablet_bootstrap.cc:654] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.721022 1466 ts_tablet_manager.cc:1929] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.717257 1444 tablet_bootstrap.cc:654] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.721087 1466 log.cc:1199] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/3efed8b3631c4b5f8f779e95a33a4155
I20260317 20:57:31.721297 1466 ts_tablet_manager.cc:1950] T 3efed8b3631c4b5f8f779e95a33a4155 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:31.722113 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 3efed8b3631c4b5f8f779e95a33a4155 (table default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]) successfully deleted
I20260317 20:57:31.723043 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 3efed8b3631c4b5f8f779e95a33a4155 (table default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]) successfully deleted
I20260317 20:57:31.723142 1443 tablet_bootstrap.cc:492] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.723245 1443 ts_tablet_manager.cc:1403] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20260317 20:57:31.723800 1443 raft_consensus.cc:359] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.723954 1443 raft_consensus.cc:385] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.723995 1443 raft_consensus.cc:740] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.724119 1443 consensus_queue.cc:260] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.724447 1443 ts_tablet_manager.cc:1434] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.725909 1465 ts_tablet_manager.cc:1929] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:31.726017 1465 log.cc:1199] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/3efed8b3631c4b5f8f779e95a33a4155
I20260317 20:57:31.726257 1465 ts_tablet_manager.cc:1950] T 3efed8b3631c4b5f8f779e95a33a4155 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:31.726926 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 3efed8b3631c4b5f8f779e95a33a4155 (table default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]) successfully deleted
I20260317 20:57:31.727898 1445 tablet_bootstrap.cc:492] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.727996 1445 ts_tablet_manager.cc:1403] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:31.728467 1444 tablet_bootstrap.cc:492] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.728557 1444 ts_tablet_manager.cc:1403] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260317 20:57:31.728519 1445 raft_consensus.cc:359] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.728618 1445 raft_consensus.cc:385] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.728659 1445 raft_consensus.cc:740] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.728926 1445 consensus_queue.cc:260] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.729048 1444 raft_consensus.cc:359] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.729157 1444 raft_consensus.cc:385] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.729194 1444 raft_consensus.cc:740] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.729339 1444 consensus_queue.cc:260] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.731041 1444 ts_tablet_manager.cc:1434] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:31.732321 1445 ts_tablet_manager.cc:1434] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260317 20:57:31.734249 1444 tablet_bootstrap.cc:492] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.734443 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 487a2d92c3614dbe801d9e4d478ce9ac (DEFAULT_TABLE table=default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.734508 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 487a2d92c3614dbe801d9e4d478ce9ac (DEFAULT_TABLE table=default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.734699 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487a2d92c3614dbe801d9e4d478ce9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.734745 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487a2d92c3614dbe801d9e4d478ce9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.735235 1444 tablet_bootstrap.cc:654] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.737564 1445 tablet_bootstrap.cc:492] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.738438 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 487a2d92c3614dbe801d9e4d478ce9ac (DEFAULT_TABLE table=default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.738623 1445 tablet_bootstrap.cc:654] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.738737 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 487a2d92c3614dbe801d9e4d478ce9ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.741220 1443 tablet_bootstrap.cc:492] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.741667 1445 tablet_bootstrap.cc:492] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.741744 1445 ts_tablet_manager.cc:1403] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260317 20:57:31.742280 1443 tablet_bootstrap.cc:654] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.742254 1445 raft_consensus.cc:359] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.742359 1445 raft_consensus.cc:385] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.742406 1445 raft_consensus.cc:740] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.742569 1445 consensus_queue.cc:260] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.744340 1445 ts_tablet_manager.cc:1434] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260317 20:57:31.744330 791 master_service.cc:954] ReplaceTablet: received request to replace tablet 64b829b5386c4ed39f581fdce1dbd0b7 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:31.744643 791 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_4dbc50b14c244bfba10bd8a152d0ad78" } modify_external_catalogs: true
I20260317 20:57:31.744766 791 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_4dbc50b14c244bfba10bd8a152d0ad78" } modify_external_catalogs: true
I20260317 20:57:31.745321 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 05afc5b78c3b4724850eb1f994b4ccf3 (DEFAULT_TABLE table=default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.745487 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 05afc5b78c3b4724850eb1f994b4ccf3 (DEFAULT_TABLE table=default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.745594 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05afc5b78c3b4724850eb1f994b4ccf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.745769 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05afc5b78c3b4724850eb1f994b4ccf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.745858 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 05afc5b78c3b4724850eb1f994b4ccf3 (DEFAULT_TABLE table=default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:31.746151 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05afc5b78c3b4724850eb1f994b4ccf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:31.746311 1444 tablet_bootstrap.cc:492] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.746392 1444 ts_tablet_manager.cc:1403] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260317 20:57:31.746889 1444 raft_consensus.cc:359] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.746981 1444 raft_consensus.cc:385] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.747009 1444 raft_consensus.cc:740] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.747164 1444 consensus_queue.cc:260] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.747952 1444 ts_tablet_manager.cc:1434] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:31.748255 1444 tablet_bootstrap.cc:492] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.749454 1444 tablet_bootstrap.cc:654] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.750425 1445 tablet_bootstrap.cc:492] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.750730 1444 tablet_bootstrap.cc:492] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.750826 1444 ts_tablet_manager.cc:1403] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:31.751384 1444 raft_consensus.cc:359] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.751493 1444 raft_consensus.cc:385] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.751477 1445 tablet_bootstrap.cc:654] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.751523 1444 raft_consensus.cc:740] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.751674 1444 consensus_queue.cc:260] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.751945 1444 ts_tablet_manager.cc:1434] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.752112 1444 tablet_bootstrap.cc:492] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:31.757653 1449 raft_consensus.cc:493] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.757818 1449 raft_consensus.cc:515] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.758270 1445 tablet_bootstrap.cc:492] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.758350 1449 leader_election.cc:290] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.758404 1445 ts_tablet_manager.cc:1403] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20260317 20:57:31.759145 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2bbbaf425c4998a6913b1444740bb4" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.759300 1061 raft_consensus.cc:2468] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:31.759564 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2bbbaf425c4998a6913b1444740bb4" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:31.759711 1334 raft_consensus.cc:2468] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:31.760178 1133 leader_election.cc:304] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.760458 1445 raft_consensus.cc:359] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.760578 1445 raft_consensus.cc:385] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.760566 1449 raft_consensus.cc:2804] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.760622 1445 raft_consensus.cc:740] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.760628 1449 raft_consensus.cc:493] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.760671 1449 raft_consensus.cc:3060] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.760819 1445 consensus_queue.cc:260] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.761795 1449 raft_consensus.cc:515] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.762245 1449 leader_election.cc:290] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.762838 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2bbbaf425c4998a6913b1444740bb4" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:31.762969 1334 raft_consensus.cc:3060] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.763710 1445 ts_tablet_manager.cc:1434] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20260317 20:57:31.763942 1444 tablet_bootstrap.cc:654] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.764128 1334 raft_consensus.cc:2468] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:31.764647 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd2bbbaf425c4998a6913b1444740bb4" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.764786 1061 raft_consensus.cc:3060] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.765133 1445 tablet_bootstrap.cc:492] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:31.765748 1061 raft_consensus.cc:2468] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:31.766399 1133 leader_election.cc:304] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.766727 1449 raft_consensus.cc:2804] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.766820 1449 raft_consensus.cc:697] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:31.766958 1449 consensus_queue.cc:237] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.767457 1445 tablet_bootstrap.cc:654] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.769860 1443 tablet_bootstrap.cc:492] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.769955 1443 ts_tablet_manager.cc:1403] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20260317 20:57:31.770478 1443 raft_consensus.cc:359] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.770589 1443 raft_consensus.cc:385] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.770620 1443 raft_consensus.cc:740] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.770733 1443 consensus_queue.cc:260] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.771047 1443 ts_tablet_manager.cc:1434] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.771255 1443 tablet_bootstrap.cc:492] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:31.772282 1443 tablet_bootstrap.cc:654] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:31.773427 1443 tablet_bootstrap.cc:492] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:31.773775 1443 ts_tablet_manager.cc:1403] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:31.774310 1443 raft_consensus.cc:359] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.774549 1443 raft_consensus.cc:385] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.774631 1443 raft_consensus.cc:740] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.774842 1443 consensus_queue.cc:260] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.775185 1443 ts_tablet_manager.cc:1434] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.777348 1450 raft_consensus.cc:493] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.777483 1450 raft_consensus.cc:515] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.777905 1450 leader_election.cc:290] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.778301 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1b9bbdeb04e44a548aca0800d9198" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.778455 1197 raft_consensus.cc:2468] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.778719 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1b9bbdeb04e44a548aca0800d9198" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.778823 1268 leader_election.cc:304] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:31.778890 1061 raft_consensus.cc:2468] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.779000 1450 raft_consensus.cc:2804] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.779053 1450 raft_consensus.cc:493] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.779091 1450 raft_consensus.cc:3060] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.780198 1450 raft_consensus.cc:515] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.780623 1450 leader_election.cc:290] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:31.781174 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1b9bbdeb04e44a548aca0800d9198" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:31.781333 1197 raft_consensus.cc:3060] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.782260 1197 raft_consensus.cc:2468] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.782246 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ed1b9bbdeb04e44a548aca0800d9198" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.782385 1061 raft_consensus.cc:3060] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.782653 1268 leader_election.cc:304] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:31.782862 1450 raft_consensus.cc:2804] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.782938 1450 raft_consensus.cc:697] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:31.783073 1450 consensus_queue.cc:237] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.783381 1061 raft_consensus.cc:2468] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.787984 1444 tablet_bootstrap.cc:492] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:31.788098 1444 ts_tablet_manager.cc:1403] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20260317 20:57:31.788548 1444 raft_consensus.cc:359] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.788643 1444 raft_consensus.cc:385] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.788664 1444 raft_consensus.cc:740] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.788817 1444 consensus_queue.cc:260] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.789155 1444 ts_tablet_manager.cc:1434] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:31.789736 1445 tablet_bootstrap.cc:492] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:31.789853 1445 ts_tablet_manager.cc:1403] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.001s
I20260317 20:57:31.790453 1445 raft_consensus.cc:359] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.790557 1445 raft_consensus.cc:385] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:31.790585 1445 raft_consensus.cc:740] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:31.790702 1445 consensus_queue.cc:260] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.790949 1445 ts_tablet_manager.cc:1434] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:31.799932 1450 raft_consensus.cc:493] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.800101 1450 raft_consensus.cc:515] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.800594 1450 leader_election.cc:290] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:31.801223 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f594a73e1d84d37813e71ee70b81800" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.801385 1061 raft_consensus.cc:2468] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.801729 1269 leader_election.cc:304] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.802314 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f594a73e1d84d37813e71ee70b81800" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.802470 1197 raft_consensus.cc:2468] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:31.802950 1450 raft_consensus.cc:2804] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.803020 1450 raft_consensus.cc:493] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.803064 1450 raft_consensus.cc:3060] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.804141 1450 raft_consensus.cc:515] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.804555 1450 leader_election.cc:290] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:31.805162 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f594a73e1d84d37813e71ee70b81800" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.805306 1061 raft_consensus.cc:3060] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.806435 1061 raft_consensus.cc:2468] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.806900 1269 leader_election.cc:304] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.807126 1450 raft_consensus.cc:2804] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.807217 1450 raft_consensus.cc:697] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:31.807176 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f594a73e1d84d37813e71ee70b81800" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:31.807307 1197 raft_consensus.cc:3060] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.807389 1450 consensus_queue.cc:237] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.808413 1197 raft_consensus.cc:2468] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:31.831868 1458 raft_consensus.cc:493] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.832026 1458 raft_consensus.cc:515] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.832559 1458 leader_election.cc:290] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.833973 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dcaf5ab229445bda791c6e807c60034" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:31.834179 1197 raft_consensus.cc:2468] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:31.834511 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dcaf5ab229445bda791c6e807c60034" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:31.834648 1334 raft_consensus.cc:2468] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:31.837007 996 leader_election.cc:304] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.837952 1449 consensus_queue.cc:1048] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:31.839464 1451 raft_consensus.cc:2804] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.839560 1451 raft_consensus.cc:493] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.839600 1451 raft_consensus.cc:3060] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.840880 1451 raft_consensus.cc:515] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.841337 1451 leader_election.cc:290] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.841904 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dcaf5ab229445bda791c6e807c60034" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:31.842105 1334 raft_consensus.cc:3060] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.843360 1334 raft_consensus.cc:2468] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:31.844527 996 leader_election.cc:304] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.844596 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dcaf5ab229445bda791c6e807c60034" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:31.844731 1197 raft_consensus.cc:3060] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.844771 1451 raft_consensus.cc:2804] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.844854 1451 raft_consensus.cc:697] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:31.845011 1451 consensus_queue.cc:237] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.845906 1197 raft_consensus.cc:2468] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:31.863163 1483 consensus_queue.cc:1048] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:31.882475 1449 raft_consensus.cc:493] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.882620 1449 raft_consensus.cc:515] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.883085 1449 leader_election.cc:290] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.884073 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a541291c504f98a7e6c887d6ef695b" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.884238 1061 raft_consensus.cc:2468] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:31.884479 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a541291c504f98a7e6c887d6ef695b" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:31.884603 1334 raft_consensus.cc:2468] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:31.885164 1133 leader_election.cc:304] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.885588 1483 raft_consensus.cc:2804] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.885644 1483 raft_consensus.cc:493] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.885681 1483 raft_consensus.cc:3060] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.886861 1483 raft_consensus.cc:515] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.887253 1483 leader_election.cc:290] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.888119 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a541291c504f98a7e6c887d6ef695b" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:31.888247 1334 raft_consensus.cc:3060] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.889256 1334 raft_consensus.cc:2468] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:31.889750 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7a541291c504f98a7e6c887d6ef695b" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.889895 1061 raft_consensus.cc:3060] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.890962 1061 raft_consensus.cc:2468] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:31.891562 1133 leader_election.cc:304] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.894551 1449 raft_consensus.cc:2804] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.894685 1449 raft_consensus.cc:697] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:31.894840 1449 consensus_queue.cc:237] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:31.937912 1483 raft_consensus.cc:493] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:31.938097 1483 raft_consensus.cc:515] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.938593 1483 leader_election.cc:290] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.939726 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487a2d92c3614dbe801d9e4d478ce9ac" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:31.939903 1061 raft_consensus.cc:2468] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:31.940184 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487a2d92c3614dbe801d9e4d478ce9ac" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:31.940320 1334 raft_consensus.cc:2468] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:31.940943 1133 leader_election.cc:304] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.941380 1483 raft_consensus.cc:2804] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:31.941454 1483 raft_consensus.cc:493] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:31.941496 1483 raft_consensus.cc:3060] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.942898 1483 raft_consensus.cc:515] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.943397 1483 leader_election.cc:290] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:31.944445 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487a2d92c3614dbe801d9e4d478ce9ac" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:31.944598 1334 raft_consensus.cc:3060] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.945662 1334 raft_consensus.cc:2468] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:31.946081 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "487a2d92c3614dbe801d9e4d478ce9ac" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:31.946231 1061 raft_consensus.cc:3060] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:31.947233 1061 raft_consensus.cc:2468] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:31.947958 1133 leader_election.cc:304] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:31.948392 1483 raft_consensus.cc:2804] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:31.949889 1483 raft_consensus.cc:697] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:31.950196 1483 consensus_queue.cc:237] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:31.972834 1450 consensus_queue.cc:1048] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:31.995417 1450 consensus_queue.cc:1048] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.028684 1529 raft_consensus.cc:493] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:32.028869 1529 raft_consensus.cc:515] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.029409 1529 leader_election.cc:290] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:32.030122 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05afc5b78c3b4724850eb1f994b4ccf3" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:32.030354 1061 raft_consensus.cc:2468] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:32.030342 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05afc5b78c3b4724850eb1f994b4ccf3" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:32.030503 1197 raft_consensus.cc:2468] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:32.030893 1268 leader_election.cc:304] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:32.031188 1529 raft_consensus.cc:2804] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:32.031251 1529 raft_consensus.cc:493] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:32.031303 1529 raft_consensus.cc:3060] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:32.032512 1529 raft_consensus.cc:515] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.032954 1529 leader_election.cc:290] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:32.033601 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05afc5b78c3b4724850eb1f994b4ccf3" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:32.033669 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05afc5b78c3b4724850eb1f994b4ccf3" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:32.033756 1061 raft_consensus.cc:3060] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:32.033797 1197 raft_consensus.cc:3060] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:32.034816 1197 raft_consensus.cc:2468] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:32.035038 1061 raft_consensus.cc:2468] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:32.035205 1268 leader_election.cc:304] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:32.035399 1529 raft_consensus.cc:2804] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:32.035472 1529 raft_consensus.cc:697] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:32.035614 1529 consensus_queue.cc:237] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
W20260317 20:57:32.040804 1489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:32.041145 1489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:32.041231 1489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:32.054929 1489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:32.055027 1489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:32.055064 1489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:32.055095 1489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:32.071190 1489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.254:45865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.102.254
--webserver_port=37411
--never_fsync=true
--heap_profile_path=/tmp/kudu.1489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:32.072774 1489 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:32.074440 1489 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260317 20:57:32.090313 800 catalog_manager.cc:3502] renamed table default.table_f6840de3a5bb48dda47e8b19e6d003f3 [id=06a4801fbead41c6adfb06c624d3c9ad] in HMS: new name default.table_9e4d286026a74f549f1874d0f1b908de
W20260317 20:57:32.094102 795 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a26747a8e2de47f5a6f00cfc3fa59c1f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:32.095487 796 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a4bf6942f68c4cf1b3a98aa499f6d466 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:32.096452 792 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e904ff4d06de42e3a58e46251d6e96f4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:32.107831 948 catalog_manager.cc:5931] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5ed1b9bbdeb04e44a548aca0800d9198 consensus state has no leader
I20260317 20:57:32.112793 800 catalog_manager.cc:5671] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:32.119251 1529 consensus_queue.cc:1048] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.120396 800 catalog_manager.cc:5671] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:32.120779 800 catalog_manager.cc:5671] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:32.121091 800 catalog_manager.cc:5671] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:32.129748 800 catalog_manager.cc:5671] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
W20260317 20:57:32.129827 1537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:32.130095 1536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:32.130537 800 catalog_manager.cc:5671] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:32.130832 800 catalog_manager.cc:5671] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:32.131031 800 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_9e4d286026a74f549f1874d0f1b908de [id=06a4801fbead41c6adfb06c624d3c9ad]). Expected version 1 got 0
W20260317 20:57:32.131692 1539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:32.138636 1462 consensus_queue.cc:1048] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.139659 1489 server_base.cc:1060] running on GCE node
I20260317 20:57:32.140512 1489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:32.141772 1489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:32.147346 800 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_6c133cda464b48309d86571d465a0367"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:32.157320 1489 hybrid_clock.cc:648] HybridClock initialized: now 1773781052157252 us; error 91 us; skew 500 ppm
I20260317 20:57:32.160303 1489 webserver.cc:492] Webserver started at http://127.0.102.254:37411/ using document root <none> and password file <none>
I20260317 20:57:32.161424 1489 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:32.161547 1489 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:32.165405 1061 raft_consensus.cc:1275] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Refusing update from remote peer 630e777e97c141a69e35660f32b26f6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:32.166088 1450 consensus_queue.cc:1048] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.166713 1489 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260317 20:57:32.167270 1197 raft_consensus.cc:1275] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Refusing update from remote peer 630e777e97c141a69e35660f32b26f6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:32.168185 1450 consensus_queue.cc:1048] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.178126 1525 mvcc.cc:204] Tried to move back new op lower bound from 7265407189662924800 to 7265407188109766656. Current Snapshot: MvccSnapshot[applied={T|T < 7265407189662924800}]
I20260317 20:57:32.179594 1522 mvcc.cc:204] Tried to move back new op lower bound from 7265407189662924800 to 7265407188109766656. Current Snapshot: MvccSnapshot[applied={T|T < 7265407189662924800}]
I20260317 20:57:32.184859 1523 mvcc.cc:204] Tried to move back new op lower bound from 7265407189662924800 to 7265407188109766656. Current Snapshot: MvccSnapshot[applied={T|T < 7265407189662924800}]
I20260317 20:57:32.186082 1552 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:32.186553 1553 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:32.188369 1450 consensus_queue.cc:1048] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.192138 1554 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:32.194028 1549 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:32.202021 1489 fs_manager.cc:730] Time spent opening block manager: real 0.034s user 0.003s sys 0.000s
I20260317 20:57:32.202211 1489 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:32.202781 1489 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:32.217525 1483 consensus_queue.cc:1048] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.225296 1450 consensus_queue.cc:1048] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.228209 1451 consensus_queue.cc:1048] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.265115 1451 consensus_queue.cc:1048] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.277082 798 catalog_manager.cc:3502] renamed table default.table_3c0c77756ed5410faefa920adf64821f [id=a845787d86674dcb8420c53e3d2c2e70] in HMS: new name default.table_3e019f83132e4014bc96f1473937b0aa
I20260317 20:57:32.281649 1483 consensus_queue.cc:1048] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.304121 1449 consensus_queue.cc:1048] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.313498 1483 consensus_queue.cc:1048] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.319386 1489 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:32.320382 1489 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:32.320603 1489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:32.331470 1489 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.254:45865
I20260317 20:57:32.333007 1489 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
I20260317 20:57:32.334018 1616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.254:45865 every 8 connection(s)
I20260317 20:57:32.336906 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 1489
I20260317 20:57:32.340687 1617 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:32.342904 1617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap starting.
I20260317 20:57:32.346480 1565 consensus_queue.cc:1048] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.356017 1483 consensus_queue.cc:1048] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.367034 1617 log.cc:826] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:32.368446 1381 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:32.374027 1245 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:32.378700 1108 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:32.392480 1617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:32.393026 1617 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap complete.
I20260317 20:57:32.397301 1617 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:32.397775 1617 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5022d9ddb45c41faa9f114e2a0a31fc3, State: Initialized, Role: FOLLOWER
I20260317 20:57:32.398496 1617 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:32.399501 1626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:32.399751 1626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:32.400050 1617 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:32.422864 1640 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:32.422951 1640 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: loading cluster ID for follower catalog manager: success
I20260317 20:57:32.425551 1640 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: acquiring CA information for follower catalog manager: success
I20260317 20:57:32.427320 1640 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:57:32.440603 1450 consensus_queue.cc:1048] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.447026 1572 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:57103; Asking this server to re-register.
I20260317 20:57:32.448323 1245 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:32.450373 1572 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:32.461480 1572 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:49395; Asking this server to re-register.
I20260317 20:57:32.462417 1381 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:32.462489 1529 consensus_queue.cc:1048] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:32.464232 1572 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:32.469731 1572 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:43617; Asking this server to re-register.
I20260317 20:57:32.470506 1108 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:32.471625 1572 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:32.532160 799 catalog_manager.cc:3502] renamed table default.table_14970f3e82f542c3ac28906af0b81693 [id=262f037e46644a98890abee1b764ba1e] in HMS: new name default.table_7ebd9bdc267143a699de00438360c54a
I20260317 20:57:32.601918 797 catalog_manager.cc:3502] renamed table default.table_7d4fb7b8d8a84fa4b89f045e59a9c77c [id=8f5019afc57c4b86bf898f058e3bf9d9] in HMS: new name default.table_17c2097cd322498e80bb464abfd17703
I20260317 20:57:32.665315 795 catalog_manager.cc:2174] created HMS catalog entry for table [id=60e57136849e4d3f946131445d27a0c1]
I20260317 20:57:32.690426 795 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 20) took 1328 ms. Trace:
I20260317 20:57:32.690531 795 rpcz_store.cc:276] 0317 20:57:31.361851 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.395700 (+ 33849us) service_pool.cc:225] Handling call
0317 20:57:32.094247 (+698547us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:32.094883 (+ 636us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:32.665302 (+570419us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:32.690143 (+ 24841us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:32.690286 (+ 143us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:32.690398 (+ 112us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:32.672745 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:32.672874 (+ 129us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:32.672879 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:32.672880 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:32.672958 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:32.672968 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:32.672971 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:32.673028 (+ 57us) tablet.cc:700] Row locks acquired
0317 20:57:32.673030 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:32.673060 (+ 30us) write_op.cc:270] Start()
0317 20:57:32.673090 (+ 30us) write_op.cc:276] Timestamp: P: 1773781052672980 usec, L: 0
0317 20:57:32.673092 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:32.673264 (+ 172us) log.cc:844] Serialized 432 byte log entry
0317 20:57:32.677768 (+ 4504us) op_driver.cc:464] REPLICATION: finished
0317 20:57:32.680892 (+ 3124us) write_op.cc:301] APPLY: starting
0317 20:57:32.680913 (+ 21us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:32.680947 (+ 34us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:32.680967 (+ 20us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:32.681073 (+ 106us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:32.681108 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:32.681114 (+ 6us) write_op.cc:312] APPLY: finished
0317 20:57:32.681192 (+ 78us) log.cc:844] Serialized 28 byte log entry
0317 20:57:32.681616 (+ 424us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:32.681637 (+ 21us) write_op.cc:454] Released schema lock
0317 20:57:32.681644 (+ 7us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":506944,"Hive Metastore.run_cpu_time_us":258,"Hive Metastore.run_wall_time_us":62480,"child_traces":[["op",{"apply.queue_time_us":3051,"mutex_wait_us":2,"num_ops":2,"prepare.queue_time_us":6881,"prepare.run_cpu_time_us":811,"prepare.run_wall_time_us":2995,"raft.queue_time_us":316,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":243,"replication_time_us":4648,"spinlock_wait_cycles":17664,"thread_start_us":245,"threads_started":3}]]}
I20260317 20:57:32.691496 795 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_9e4d286026a74f549f1874d0f1b908de [id=06a4801fbead41c6adfb06c624d3c9ad]). Expected version 1 got 0
I20260317 20:57:32.692560 795 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_9e4d286026a74f549f1874d0f1b908de [id=06a4801fbead41c6adfb06c624d3c9ad]). Expected version 1 got 0
I20260317 20:57:32.693375 795 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_9e4d286026a74f549f1874d0f1b908de [id=06a4801fbead41c6adfb06c624d3c9ad]). Expected version 1 got 0
I20260317 20:57:32.693801 795 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_546787ba946048329e14e21785ced611" } modify_external_catalogs: true
I20260317 20:57:32.693928 795 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_546787ba946048329e14e21785ced611" } modify_external_catalogs: true
I20260317 20:57:32.698920 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 53bd2006d8e24f418a17e55cfec8fd21 (DEFAULT_TABLE table=default.table_a26747a8e2de47f5a6f00cfc3fa59c1f [id=60e57136849e4d3f946131445d27a0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:32.699174 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 53bd2006d8e24f418a17e55cfec8fd21 (DEFAULT_TABLE table=default.table_a26747a8e2de47f5a6f00cfc3fa59c1f [id=60e57136849e4d3f946131445d27a0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:32.699257 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bd2006d8e24f418a17e55cfec8fd21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:32.699220 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 53bd2006d8e24f418a17e55cfec8fd21 (DEFAULT_TABLE table=default.table_a26747a8e2de47f5a6f00cfc3fa59c1f [id=60e57136849e4d3f946131445d27a0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:32.699440 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bd2006d8e24f418a17e55cfec8fd21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:32.699544 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53bd2006d8e24f418a17e55cfec8fd21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:32.707401 1653 tablet_bootstrap.cc:492] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:32.708549 1653 tablet_bootstrap.cc:654] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:32.716375 1652 tablet_bootstrap.cc:492] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:32.717617 1652 tablet_bootstrap.cc:654] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:32.718720 1654 tablet_bootstrap.cc:492] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:32.719803 1654 tablet_bootstrap.cc:654] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:32.721066 1653 tablet_bootstrap.cc:492] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:32.721220 1653 ts_tablet_manager.cc:1403] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260317 20:57:32.721797 1653 raft_consensus.cc:359] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.722383 1653 raft_consensus.cc:385] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:32.722476 1653 raft_consensus.cc:740] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:32.722725 1653 consensus_queue.cc:260] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.725068 1653 ts_tablet_manager.cc:1434] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260317 20:57:32.730933 1652 tablet_bootstrap.cc:492] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:32.731225 1652 ts_tablet_manager.cc:1403] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.000s
I20260317 20:57:32.732131 1652 raft_consensus.cc:359] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.733237 1654 tablet_bootstrap.cc:492] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:32.733424 1652 raft_consensus.cc:385] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:32.733541 1652 raft_consensus.cc:740] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:32.733883 1652 consensus_queue.cc:260] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.734237 1654 ts_tablet_manager.cc:1403] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260317 20:57:32.737623 1652 ts_tablet_manager.cc:1434] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260317 20:57:32.738984 1654 raft_consensus.cc:359] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.739140 1654 raft_consensus.cc:385] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:32.739185 1654 raft_consensus.cc:740] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:32.739328 1654 consensus_queue.cc:260] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.739665 1654 ts_tablet_manager.cc:1434] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260317 20:57:32.759124 1626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:32.759274 1626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:32.937736 1449 raft_consensus.cc:493] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:32.937907 1449 raft_consensus.cc:515] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.938436 1449 leader_election.cc:290] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:32.939316 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bd2006d8e24f418a17e55cfec8fd21" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:32.939503 1061 raft_consensus.cc:2468] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:32.939837 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bd2006d8e24f418a17e55cfec8fd21" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:32.939991 1334 raft_consensus.cc:2468] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:32.940488 1133 leader_election.cc:304] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:32.940855 1449 raft_consensus.cc:2804] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:32.940927 1449 raft_consensus.cc:493] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:32.940971 1449 raft_consensus.cc:3060] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:32.942126 1449 raft_consensus.cc:515] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:32.942610 1449 leader_election.cc:290] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:32.948017 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bd2006d8e24f418a17e55cfec8fd21" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:32.948196 1334 raft_consensus.cc:3060] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:32.949334 1334 raft_consensus.cc:2468] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:32.949906 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53bd2006d8e24f418a17e55cfec8fd21" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:32.950075 1061 raft_consensus.cc:3060] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:32.951143 1061 raft_consensus.cc:2468] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:32.951566 1133 leader_election.cc:304] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:32.952979 1449 raft_consensus.cc:2804] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:32.953090 1449 raft_consensus.cc:697] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:32.953233 1449 consensus_queue.cc:237] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.159183 793 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]
I20260317 20:57:33.202416 796 catalog_manager.cc:2174] created HMS catalog entry for table [id=0e789a2f9f64400eb7e38a789e0ec299]
I20260317 20:57:33.204360 1648 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:33.204509 1648 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:33.208969 796 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 22) took 1784 ms. Trace:
I20260317 20:57:33.209071 796 rpcz_store.cc:276] 0317 20:57:31.424242 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.568782 (+144540us) service_pool.cc:225] Handling call
0317 20:57:32.095584 (+526802us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:32.095946 (+ 362us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:33.202403 (+1106457us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:33.208777 (+ 6374us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:33.208872 (+ 95us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:33.208950 (+ 78us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:33.203212 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:33.203327 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:33.203331 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:33.203333 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:33.203405 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:33.203415 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:33.203418 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:33.203475 (+ 57us) tablet.cc:700] Row locks acquired
0317 20:57:33.203476 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:33.203505 (+ 29us) write_op.cc:270] Start()
0317 20:57:33.203533 (+ 28us) write_op.cc:276] Timestamp: P: 1773781053203434 usec, L: 0
0317 20:57:33.203535 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:33.203702 (+ 167us) log.cc:844] Serialized 432 byte log entry
0317 20:57:33.208002 (+ 4300us) op_driver.cc:464] REPLICATION: finished
0317 20:57:33.208381 (+ 379us) write_op.cc:301] APPLY: starting
0317 20:57:33.208400 (+ 19us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:33.208435 (+ 35us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:33.208452 (+ 17us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:33.208529 (+ 77us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:33.208563 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:33.208584 (+ 21us) write_op.cc:312] APPLY: finished
0317 20:57:33.208647 (+ 63us) log.cc:844] Serialized 28 byte log entry
0317 20:57:33.208697 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.208711 (+ 14us) write_op.cc:454] Released schema lock
0317 20:57:33.208717 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":1063148,"Hive Metastore.run_cpu_time_us":264,"Hive Metastore.run_wall_time_us":43097,"child_traces":[["op",{"apply.queue_time_us":328,"leader-initialization.queue_time_us":320,"leader-initialization.run_cpu_time_us":10,"leader-initialization.run_wall_time_us":10,"num_ops":2,"prepare.queue_time_us":194,"prepare.run_cpu_time_us":616,"prepare.run_wall_time_us":1607,"raft.queue_time_us":248,"raft.run_cpu_time_us":745,"raft.run_wall_time_us":745,"replication_time_us":4436,"thread_start_us":310,"threads_started":4}]]}
I20260317 20:57:33.221863 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 1a900d232ebe465eb9fdecd6038cd37f (DEFAULT_TABLE table=default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.222080 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 1a900d232ebe465eb9fdecd6038cd37f (DEFAULT_TABLE table=default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.222235 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a900d232ebe465eb9fdecd6038cd37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.222378 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a900d232ebe465eb9fdecd6038cd37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.224412 1653 tablet_bootstrap.cc:492] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:33.224509 1652 tablet_bootstrap.cc:492] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:33.224757 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 1a900d232ebe465eb9fdecd6038cd37f (DEFAULT_TABLE table=default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.225035 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a900d232ebe465eb9fdecd6038cd37f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.225466 1652 tablet_bootstrap.cc:654] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.225466 1653 tablet_bootstrap.cc:654] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.228404 1654 tablet_bootstrap.cc:492] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:33.229575 1654 tablet_bootstrap.cc:654] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.229555 796 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_9e4d286026a74f549f1874d0f1b908de [id=06a4801fbead41c6adfb06c624d3c9ad] alter complete (version 1)
I20260317 20:57:33.230787 1652 tablet_bootstrap.cc:492] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:33.230898 1652 ts_tablet_manager.cc:1403] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:33.231462 1652 raft_consensus.cc:359] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.231585 1652 raft_consensus.cc:385] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.231619 1652 raft_consensus.cc:740] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.231751 1652 consensus_queue.cc:260] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.233035 1652 ts_tablet_manager.cc:1434] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:33.236559 1653 tablet_bootstrap.cc:492] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:33.236689 1653 ts_tablet_manager.cc:1403] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260317 20:57:33.237217 1653 raft_consensus.cc:359] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.237334 1653 raft_consensus.cc:385] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.237372 1653 raft_consensus.cc:740] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.237493 1653 consensus_queue.cc:260] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.237762 1653 ts_tablet_manager.cc:1434] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:33.242363 796 catalog_manager.cc:5671] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:33.246249 1654 tablet_bootstrap.cc:492] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:33.246394 1654 ts_tablet_manager.cc:1403] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.001s
I20260317 20:57:33.247292 1654 raft_consensus.cc:359] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.247445 1654 raft_consensus.cc:385] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.247495 1654 raft_consensus.cc:740] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.247642 1654 consensus_queue.cc:260] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.247946 1654 ts_tablet_manager.cc:1434] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:33.257504 796 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_c63b594cb8ad4d4bb2d094326fff5111"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:33.291359 794 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_85e2216401ff46efa6722e98254db955 [id=4f4af9891c564a5b8d43526c2e917ae7]
I20260317 20:57:33.319785 792 catalog_manager.cc:2174] created HMS catalog entry for table [id=59b6b39367414d8ea603015a4042a8a6]
I20260317 20:57:33.326896 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 25) took 1839 ms. Trace:
I20260317 20:57:33.327003 792 rpcz_store.cc:276] 0317 20:57:31.487910 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.631138 (+143228us) service_pool.cc:225] Handling call
0317 20:57:32.096535 (+465397us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:32.096855 (+ 320us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:33.319770 (+1222915us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:33.326674 (+ 6904us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:33.326788 (+ 114us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:33.326875 (+ 87us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:33.320500 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:33.320639 (+ 139us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:33.320646 (+ 7us) write_op.cc:435] Acquired schema lock
0317 20:57:33.320647 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:33.320726 (+ 79us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:33.320739 (+ 13us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:33.320742 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:33.320812 (+ 70us) tablet.cc:700] Row locks acquired
0317 20:57:33.320813 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:33.320848 (+ 35us) write_op.cc:270] Start()
0317 20:57:33.320877 (+ 29us) write_op.cc:276] Timestamp: P: 1773781053320753 usec, L: 0
0317 20:57:33.320878 (+ 1us) op_driver.cc:348] REPLICATION: starting
0317 20:57:33.321026 (+ 148us) log.cc:844] Serialized 432 byte log entry
0317 20:57:33.324778 (+ 3752us) op_driver.cc:464] REPLICATION: finished
0317 20:57:33.324871 (+ 93us) write_op.cc:301] APPLY: starting
0317 20:57:33.324890 (+ 19us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:33.324925 (+ 35us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:33.324943 (+ 18us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:33.325024 (+ 81us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:33.325057 (+ 33us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:33.325063 (+ 6us) write_op.cc:312] APPLY: finished
0317 20:57:33.325130 (+ 67us) log.cc:844] Serialized 28 byte log entry
0317 20:57:33.325187 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.325203 (+ 16us) write_op.cc:454] Released schema lock
0317 20:57:33.325209 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:33.325276 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.325278 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1194395,"Hive Metastore.run_cpu_time_us":280,"Hive Metastore.run_wall_time_us":28325,"child_traces":[["op",{"apply.queue_time_us":49,"apply.run_cpu_time_us":393,"apply.run_wall_time_us":393,"num_ops":2,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":639,"prepare.run_wall_time_us":641,"raft.queue_time_us":438,"raft.run_cpu_time_us":529,"raft.run_wall_time_us":529,"replication_time_us":3865}]]}
I20260317 20:57:33.327488 792 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_8e39f763b78b443eb64d97cb4d88570a" } modify_external_catalogs: true
I20260317 20:57:33.327648 792 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_8e39f763b78b443eb64d97cb4d88570a" } modify_external_catalogs: true
I20260317 20:57:33.334791 1041 tablet_service.cc:1511] Processing CreateTablet for tablet a80fa082afee4c3b93bbe757b61cb3ee (DEFAULT_TABLE table=default.table_e904ff4d06de42e3a58e46251d6e96f4 [id=59b6b39367414d8ea603015a4042a8a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.335144 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80fa082afee4c3b93bbe757b61cb3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.337704 1652 tablet_bootstrap.cc:492] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:33.338773 1652 tablet_bootstrap.cc:654] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.339998 1313 tablet_service.cc:1511] Processing CreateTablet for tablet a80fa082afee4c3b93bbe757b61cb3ee (DEFAULT_TABLE table=default.table_e904ff4d06de42e3a58e46251d6e96f4 [id=59b6b39367414d8ea603015a4042a8a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.340338 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80fa082afee4c3b93bbe757b61cb3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.343792 1177 tablet_service.cc:1511] Processing CreateTablet for tablet a80fa082afee4c3b93bbe757b61cb3ee (DEFAULT_TABLE table=default.table_e904ff4d06de42e3a58e46251d6e96f4 [id=59b6b39367414d8ea603015a4042a8a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.343986 1652 tablet_bootstrap.cc:492] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:33.344096 1652 ts_tablet_manager.cc:1403] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:33.344213 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a80fa082afee4c3b93bbe757b61cb3ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.344615 1652 raft_consensus.cc:359] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.344735 1652 raft_consensus.cc:385] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.344766 1652 raft_consensus.cc:740] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.344947 1652 consensus_queue.cc:260] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.345232 1653 tablet_bootstrap.cc:492] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:33.346487 1653 tablet_bootstrap.cc:654] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.347270 1654 tablet_bootstrap.cc:492] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:33.348536 1654 tablet_bootstrap.cc:654] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.352144 1652 ts_tablet_manager.cc:1434] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:33.356626 1653 tablet_bootstrap.cc:492] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:33.356777 1653 ts_tablet_manager.cc:1403] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260317 20:57:33.357352 1653 raft_consensus.cc:359] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.357487 1653 raft_consensus.cc:385] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.357527 1653 raft_consensus.cc:740] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.357669 1653 consensus_queue.cc:260] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.357982 1653 ts_tablet_manager.cc:1434] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:33.360633 1654 tablet_bootstrap.cc:492] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:33.360776 1654 ts_tablet_manager.cc:1403] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260317 20:57:33.361389 1654 raft_consensus.cc:359] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.361531 1654 raft_consensus.cc:385] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.361567 1654 raft_consensus.cc:740] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.361697 1654 consensus_queue.cc:260] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.362007 1654 ts_tablet_manager.cc:1434] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260317 20:57:33.367524 1449 raft_consensus.cc:493] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:33.367671 1449 raft_consensus.cc:515] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.368080 1449 leader_election.cc:290] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.368757 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a900d232ebe465eb9fdecd6038cd37f" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:33.368909 1061 raft_consensus.cc:2468] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:33.369133 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a900d232ebe465eb9fdecd6038cd37f" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:33.369261 1334 raft_consensus.cc:2468] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:33.369737 1133 leader_election.cc:304] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:33.370471 1449 raft_consensus.cc:2804] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:33.370543 1449 raft_consensus.cc:493] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:33.370594 1449 raft_consensus.cc:3060] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.371718 1449 raft_consensus.cc:515] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.372084 1449 leader_election.cc:290] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.373438 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a900d232ebe465eb9fdecd6038cd37f" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:33.373605 1061 raft_consensus.cc:3060] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.373821 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a900d232ebe465eb9fdecd6038cd37f" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:33.373967 1334 raft_consensus.cc:3060] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.374743 1061 raft_consensus.cc:2468] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:33.374989 1334 raft_consensus.cc:2468] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:33.375936 1133 leader_election.cc:304] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:33.376289 1449 raft_consensus.cc:2804] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:33.376380 1449 raft_consensus.cc:697] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:33.376531 1449 consensus_queue.cc:237] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.393668 791 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_4dbc50b14c244bfba10bd8a152d0ad78 [id=51ef4172c7b74b36881a86b814419bb6]
I20260317 20:57:33.416513 1689 tablet.cc:1723] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.421264 1690 tablet.cc:1723] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.422664 948 catalog_manager.cc:2772] Deleting table default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93] in response to Hive Metastore notification log event 16
I20260317 20:57:33.423537 1691 tablet.cc:1723] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.428946 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 05afc5b78c3b4724850eb1f994b4ccf3
I20260317 20:57:33.429638 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 05afc5b78c3b4724850eb1f994b4ccf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:33.429641 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 05afc5b78c3b4724850eb1f994b4ccf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:33.429667 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 05afc5b78c3b4724850eb1f994b4ccf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:33.430186 1695 tablet_replica.cc:333] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:33.430371 1695 raft_consensus.cc:2243] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:33.430589 1695 raft_consensus.cc:2272] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.430900 948 catalog_manager.cc:2772] Deleting table default.table_85e2216401ff46efa6722e98254db955 [id=4f4af9891c564a5b8d43526c2e917ae7] in response to Hive Metastore notification log event 18
I20260317 20:57:33.431144 1695 ts_tablet_manager.cc:1916] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.433995 1695 ts_tablet_manager.cc:1929] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.434111 1695 log.cc:1199] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/05afc5b78c3b4724850eb1f994b4ccf3
I20260317 20:57:33.434389 1695 ts_tablet_manager.cc:1950] T 05afc5b78c3b4724850eb1f994b4ccf3 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:33.435125 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 05afc5b78c3b4724850eb1f994b4ccf3 (table default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]) successfully deleted
I20260317 20:57:33.439903 1691 tablet.cc:1723] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.440948 1689 tablet.cc:1723] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.445772 1700 tablet.cc:1723] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.447718 1690 tablet.cc:1723] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.449782 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet eb1d6f3d7d174730bd8c32e89bb5c984
I20260317 20:57:33.450412 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet eb1d6f3d7d174730bd8c32e89bb5c984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:33.450641 1689 tablet.cc:1723] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.451040 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet eb1d6f3d7d174730bd8c32e89bb5c984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:33.451200 1695 tablet_replica.cc:333] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:33.451237 948 catalog_manager.cc:2772] Deleting table default.table_4dbc50b14c244bfba10bd8a152d0ad78 [id=51ef4172c7b74b36881a86b814419bb6] in response to Hive Metastore notification log event 20
I20260317 20:57:33.451313 1695 raft_consensus.cc:2243] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:33.451511 1695 raft_consensus.cc:2272] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.451924 1695 ts_tablet_manager.cc:1916] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.454178 1695 ts_tablet_manager.cc:1929] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.454253 1695 log.cc:1199] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/eb1d6f3d7d174730bd8c32e89bb5c984
I20260317 20:57:33.454510 1695 ts_tablet_manager.cc:1950] T eb1d6f3d7d174730bd8c32e89bb5c984 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:33.455245 1691 tablet.cc:1723] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.455857 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet eb1d6f3d7d174730bd8c32e89bb5c984 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:33.457067 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 6f594a73e1d84d37813e71ee70b81800
I20260317 20:57:33.457636 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f594a73e1d84d37813e71ee70b81800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:33.458204 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f594a73e1d84d37813e71ee70b81800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:33.458755 1693 tablet_replica.cc:333] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
W20260317 20:57:33.458734 800 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6c133cda464b48309d86571d465a0367 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:33.458882 1693 raft_consensus.cc:2243] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.459012 1693 raft_consensus.cc:2272] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.459625 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f594a73e1d84d37813e71ee70b81800 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:33.460081 1693 ts_tablet_manager.cc:1916] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.461606 1695 tablet_replica.cc:333] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:33.461688 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet eb1d6f3d7d174730bd8c32e89bb5c984 (table default.table_85e2216401ff46efa6722e98254db955 [id=4f4af9891c564a5b8d43526c2e917ae7]) successfully deleted
I20260317 20:57:33.461759 1695 raft_consensus.cc:2243] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:33.461947 1695 raft_consensus.cc:2272] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.462308 1695 ts_tablet_manager.cc:1916] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.464146 1695 ts_tablet_manager.cc:1929] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.464216 1695 log.cc:1199] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/6f594a73e1d84d37813e71ee70b81800
I20260317 20:57:33.464440 1695 ts_tablet_manager.cc:1950] T 6f594a73e1d84d37813e71ee70b81800 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:33.465086 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 6f594a73e1d84d37813e71ee70b81800 (table default.table_4dbc50b14c244bfba10bd8a152d0ad78 [id=51ef4172c7b74b36881a86b814419bb6]) successfully deleted
I20260317 20:57:33.466810 1693 ts_tablet_manager.cc:1929] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.466888 1693 log.cc:1199] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/05afc5b78c3b4724850eb1f994b4ccf3
I20260317 20:57:33.467176 1693 ts_tablet_manager.cc:1950] T 05afc5b78c3b4724850eb1f994b4ccf3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:33.467854 1693 tablet_replica.cc:333] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:33.467986 1693 raft_consensus.cc:2243] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.468019 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 05afc5b78c3b4724850eb1f994b4ccf3 (table default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]) successfully deleted
I20260317 20:57:33.468107 1693 raft_consensus.cc:2272] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.468506 1693 ts_tablet_manager.cc:1916] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.476615 1693 ts_tablet_manager.cc:1929] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.476725 1693 log.cc:1199] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/eb1d6f3d7d174730bd8c32e89bb5c984
I20260317 20:57:33.476986 1693 ts_tablet_manager.cc:1950] T eb1d6f3d7d174730bd8c32e89bb5c984 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:33.477705 1693 tablet_replica.cc:333] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:33.477851 1693 raft_consensus.cc:2243] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.478436 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet eb1d6f3d7d174730bd8c32e89bb5c984 (table default.table_85e2216401ff46efa6722e98254db955 [id=4f4af9891c564a5b8d43526c2e917ae7]) successfully deleted
I20260317 20:57:33.478667 1694 tablet_replica.cc:333] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:33.478830 1694 raft_consensus.cc:2243] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.478986 1694 raft_consensus.cc:2272] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.479497 1694 ts_tablet_manager.cc:1916] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.480962 1693 raft_consensus.cc:2272] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.481467 1693 ts_tablet_manager.cc:1916] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.484056 1693 ts_tablet_manager.cc:1929] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.484171 1693 log.cc:1199] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/6f594a73e1d84d37813e71ee70b81800
I20260317 20:57:33.484448 1693 ts_tablet_manager.cc:1950] T 6f594a73e1d84d37813e71ee70b81800 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:33.490191 1694 ts_tablet_manager.cc:1929] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.490319 1694 log.cc:1199] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/05afc5b78c3b4724850eb1f994b4ccf3
I20260317 20:57:33.490667 1694 ts_tablet_manager.cc:1950] T 05afc5b78c3b4724850eb1f994b4ccf3 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:33.491711 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 05afc5b78c3b4724850eb1f994b4ccf3 (table default.table_e5d6d92a3e994614a3975dcf29c3db11 [id=1cd283f53e8044d59ad724ebe7f9bb93]) successfully deleted
I20260317 20:57:33.492026 1694 tablet_replica.cc:333] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:33.492184 1694 raft_consensus.cc:2243] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.492327 1694 raft_consensus.cc:2272] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.493441 1694 ts_tablet_manager.cc:1916] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.496400 1694 ts_tablet_manager.cc:1929] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.496546 1694 log.cc:1199] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/eb1d6f3d7d174730bd8c32e89bb5c984
I20260317 20:57:33.496798 1694 ts_tablet_manager.cc:1950] T eb1d6f3d7d174730bd8c32e89bb5c984 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:33.497558 1694 tablet_replica.cc:333] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:33.497701 1694 raft_consensus.cc:2243] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.497766 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet eb1d6f3d7d174730bd8c32e89bb5c984 (table default.table_85e2216401ff46efa6722e98254db955 [id=4f4af9891c564a5b8d43526c2e917ae7]) successfully deleted
I20260317 20:57:33.497825 1694 raft_consensus.cc:2272] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.498247 1694 ts_tablet_manager.cc:1916] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.500216 1694 ts_tablet_manager.cc:1929] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.500298 1694 log.cc:1199] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/6f594a73e1d84d37813e71ee70b81800
I20260317 20:57:33.500558 1694 ts_tablet_manager.cc:1950] T 6f594a73e1d84d37813e71ee70b81800 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:33.501262 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 6f594a73e1d84d37813e71ee70b81800 (table default.table_4dbc50b14c244bfba10bd8a152d0ad78 [id=51ef4172c7b74b36881a86b814419bb6]) successfully deleted
I20260317 20:57:33.506362 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 6f594a73e1d84d37813e71ee70b81800 (table default.table_4dbc50b14c244bfba10bd8a152d0ad78 [id=51ef4172c7b74b36881a86b814419bb6]) successfully deleted
I20260317 20:57:33.515525 800 catalog_manager.cc:2174] created HMS catalog entry for table [id=f8b4a98c1b42468ea1e61976172fe1ee]
I20260317 20:57:33.519018 799 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 18) took 2225 ms. Trace:
I20260317 20:57:33.519120 799 rpcz_store.cc:276] 0317 20:57:31.293127 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.293257 (+ 130us) service_pool.cc:225] Handling call
0317 20:57:32.093482 (+800225us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.518476 (+1424994us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.518722 (+ 246us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:33.518993 (+ 271us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":183491,"Hive Metastore.run_cpu_time_us":600,"Hive Metastore.run_wall_time_us":255031}
I20260317 20:57:33.519194 798 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 17) took 2295 ms. Trace:
I20260317 20:57:33.519282 798 rpcz_store.cc:276] 0317 20:57:31.223912 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.287973 (+ 64061us) service_pool.cc:225] Handling call
0317 20:57:32.093217 (+805244us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.518758 (+1425541us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.518971 (+ 213us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:33.519171 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":8078,"Hive Metastore.run_cpu_time_us":594,"Hive Metastore.run_wall_time_us":175516}
W20260317 20:57:33.520375 796 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c63b594cb8ad4d4bb2d094326fff5111 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:33.521031 794 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 24) took 2034 ms. Trace:
I20260317 20:57:33.521098 794 rpcz_store.cc:276] 0317 20:57:31.486798 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.576393 (+ 89595us) service_pool.cc:225] Handling call
0317 20:57:32.096084 (+519691us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.521016 (+1424932us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1106151,"Hive Metastore.run_cpu_time_us":196,"Hive Metastore.run_wall_time_us":88944}
I20260317 20:57:33.521255 799 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_0ef0ec042f05496c9732c4a2d7e9b991" } new_table_name: "default.Table_b832fcb92ce7484c9bf70cdd65f3a109" modify_external_catalogs: true
I20260317 20:57:33.521409 794 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_791a1827dff94dfc93d45ed5bfbcce82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:33.521829 797 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 19) took 2178 ms. Trace:
I20260317 20:57:33.521888 797 rpcz_store.cc:276] 0317 20:57:31.343008 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.355840 (+ 12832us) service_pool.cc:225] Handling call
0317 20:57:32.093637 (+737797us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.521463 (+1427826us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.521618 (+ 155us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:33.521815 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":438429,"Hive Metastore.run_cpu_time_us":703,"Hive Metastore.run_wall_time_us":69696}
I20260317 20:57:33.522178 800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 31) took 1961 ms. Trace:
I20260317 20:57:33.522147 797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_e410d42be96e4ac58f16d30d662b4ad4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:33.522349 793 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 21) took 2124 ms. Trace:
I20260317 20:57:33.522396 793 rpcz_store.cc:276] 0317 20:57:31.398200 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.537353 (+139153us) service_pool.cc:225] Handling call
0317 20:57:32.095034 (+557681us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.522341 (+1427307us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":569274,"Hive Metastore.run_cpu_time_us":271,"Hive Metastore.run_wall_time_us":494672}
I20260317 20:57:33.522622 793 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_e2da314b82a64ac3abd49740cd983744"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:33.522792 791 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 30) took 1995 ms. Trace:
I20260317 20:57:33.522832 791 rpcz_store.cc:276] 0317 20:57:31.527230 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:31.744586 (+217356us) service_pool.cc:225] Handling call
0317 20:57:32.108849 (+364263us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.522783 (+1413934us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1210793,"Hive Metastore.run_cpu_time_us":204,"Hive Metastore.run_wall_time_us":73843}
I20260317 20:57:33.522975 791 master_service.cc:954] ReplaceTablet: received request to replace tablet e7a541291c504f98a7e6c887d6ef695b from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:33.522220 800 rpcz_store.cc:276] 0317 20:57:31.560882 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:32.147144 (+586262us) service_pool.cc:225] Handling call
0317 20:57:33.458816 (+1311672us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:33.459177 (+ 361us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:33.515511 (+ 56334us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:33.522010 (+ 6499us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:33.522106 (+ 96us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:33.522169 (+ 63us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:33.516162 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:33.516305 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:33.516311 (+ 6us) write_op.cc:435] Acquired schema lock
0317 20:57:33.516312 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:33.516396 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:33.516407 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:33.516411 (+ 4us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:33.516481 (+ 70us) tablet.cc:700] Row locks acquired
0317 20:57:33.516482 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:33.516539 (+ 57us) write_op.cc:270] Start()
0317 20:57:33.516576 (+ 37us) write_op.cc:276] Timestamp: P: 1773781053516470 usec, L: 0
0317 20:57:33.516578 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:33.516756 (+ 178us) log.cc:844] Serialized 432 byte log entry
0317 20:57:33.520615 (+ 3859us) op_driver.cc:464] REPLICATION: finished
0317 20:57:33.520733 (+ 118us) write_op.cc:301] APPLY: starting
0317 20:57:33.520752 (+ 19us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:33.520786 (+ 34us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:33.520808 (+ 22us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:33.520916 (+ 108us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:33.520945 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:33.520949 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:33.521020 (+ 71us) log.cc:844] Serialized 28 byte log entry
0317 20:57:33.521080 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.521094 (+ 14us) write_op.cc:454] Released schema lock
0317 20:57:33.521099 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:33.521159 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.521161 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1712,"Hive Metastore.run_cpu_time_us":250,"Hive Metastore.run_wall_time_us":54473,"child_traces":[["op",{"apply.queue_time_us":73,"apply.run_cpu_time_us":415,"apply.run_wall_time_us":415,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":702,"prepare.run_wall_time_us":702,"raft.queue_time_us":1061,"raft.run_cpu_time_us":482,"raft.run_wall_time_us":484,"replication_time_us":4007}]]}
I20260317 20:57:33.525157 800 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_231a8eed1e2d4957a62ed9029daf6f72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:33.531462 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce5b0bca40b422892510e8667421e94 (DEFAULT_TABLE table=default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.531528 798 catalog_manager.cc:5671] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:33.531857 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce5b0bca40b422892510e8667421e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.533281 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce5b0bca40b422892510e8667421e94 (DEFAULT_TABLE table=default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.533586 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce5b0bca40b422892510e8667421e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.535974 1652 tablet_bootstrap.cc:492] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:33.537241 1652 tablet_bootstrap.cc:654] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.539057 791 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet e7a541291c504f98a7e6c887d6ef695b
I20260317 20:57:33.539381 791 catalog_manager.cc:6741] ReplaceTablet: tablet e7a541291c504f98a7e6c887d6ef695b deleted and replaced by tablet 0df6fe0e6b844b0384809c0d52f2421b
I20260317 20:57:33.539454 791 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 39) took 1751 ms. Trace:
I20260317 20:57:33.539498 791 rpcz_store.cc:276] 0317 20:57:31.787952 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.522956 (+1735004us) service_pool.cc:225] Handling call
0317 20:57:33.539445 (+ 16489us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:33.525853 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:33.525932 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:33.525936 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:33.525937 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:33.525995 (+ 58us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:33.526001 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:33.526004 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:33.526066 (+ 62us) tablet.cc:700] Row locks acquired
0317 20:57:33.526068 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:33.526089 (+ 21us) write_op.cc:270] Start()
0317 20:57:33.526110 (+ 21us) write_op.cc:276] Timestamp: P: 1773781053526043 usec, L: 0
0317 20:57:33.526112 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:33.526209 (+ 97us) log.cc:844] Serialized 661 byte log entry
0317 20:57:33.538367 (+ 12158us) op_driver.cc:464] REPLICATION: finished
0317 20:57:33.538474 (+ 107us) write_op.cc:301] APPLY: starting
0317 20:57:33.538489 (+ 15us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:33.538518 (+ 29us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:33.538536 (+ 18us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:33.538609 (+ 73us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:33.538646 (+ 37us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0317 20:57:33.538650 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:33.538723 (+ 73us) log.cc:844] Serialized 28 byte log entry
0317 20:57:33.538777 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.538791 (+ 14us) write_op.cc:454] Released schema lock
0317 20:57:33.538796 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:33.538861 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.538864 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":68,"apply.run_cpu_time_us":377,"apply.run_wall_time_us":377,"num_ops":2,"prepare.queue_time_us":2237,"prepare.run_cpu_time_us":393,"prepare.run_wall_time_us":391,"replication_time_us":12226}]]}
I20260317 20:57:33.540776 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet e7a541291c504f98a7e6c887d6ef695b with delete_type TABLET_DATA_DELETED (replaced by tablet 0df6fe0e6b844b0384809c0d52f2421b) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:33.540995 1695 tablet_replica.cc:333] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:33.541147 1695 raft_consensus.cc:2243] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.541286 1695 raft_consensus.cc:2272] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.541249 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 0ce5b0bca40b422892510e8667421e94 (DEFAULT_TABLE table=default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.541568 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce5b0bca40b422892510e8667421e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.541746 1695 ts_tablet_manager.cc:1916] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.542141 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet e7a541291c504f98a7e6c887d6ef695b with delete_type TABLET_DATA_DELETED (replaced by tablet 0df6fe0e6b844b0384809c0d52f2421b) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:33.542304 1694 tablet_replica.cc:333] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:33.542412 1694 raft_consensus.cc:2243] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:33.542771 1694 raft_consensus.cc:2272] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.543144 1694 ts_tablet_manager.cc:1916] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.544029 1695 ts_tablet_manager.cc:1929] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.544095 1695 log.cc:1199] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/e7a541291c504f98a7e6c887d6ef695b
I20260317 20:57:33.544340 1695 ts_tablet_manager.cc:1950] T e7a541291c504f98a7e6c887d6ef695b P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:33.545083 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet e7a541291c504f98a7e6c887d6ef695b (table default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]) successfully deleted
I20260317 20:57:33.545177 1694 ts_tablet_manager.cc:1929] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.545238 1694 log.cc:1199] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/e7a541291c504f98a7e6c887d6ef695b
I20260317 20:57:33.545480 1694 ts_tablet_manager.cc:1950] T e7a541291c504f98a7e6c887d6ef695b P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:33.546880 1653 tablet_bootstrap.cc:492] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:33.546964 1451 raft_consensus.cc:493] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:33.547075 1451 raft_consensus.cc:515] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.547547 1654 tablet_bootstrap.cc:492] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:33.547539 1451 leader_election.cc:290] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.548045 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80fa082afee4c3b93bbe757b61cb3ee" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:33.548185 1333 raft_consensus.cc:2468] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:33.548484 1654 tablet_bootstrap.cc:654] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.548519 996 leader_election.cc:304] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:33.548684 1451 raft_consensus.cc:2804] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:33.548731 1451 raft_consensus.cc:493] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:33.548782 1451 raft_consensus.cc:3060] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.549033 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80fa082afee4c3b93bbe757b61cb3ee" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:33.549171 1197 raft_consensus.cc:2468] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:33.549662 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet e7a541291c504f98a7e6c887d6ef695b with delete_type TABLET_DATA_DELETED (replaced by tablet 0df6fe0e6b844b0384809c0d52f2421b) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:33.549826 1451 raft_consensus.cc:515] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.549892 1693 tablet_replica.cc:333] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:33.550029 1693 raft_consensus.cc:2243] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.550179 1693 raft_consensus.cc:2272] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.550230 1451 leader_election.cc:290] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.550235 1449 consensus_queue.cc:1048] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:33.550613 1693 ts_tablet_manager.cc:1916] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.550663 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80fa082afee4c3b93bbe757b61cb3ee" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:33.550769 1333 raft_consensus.cc:3060] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.551759 1333 raft_consensus.cc:2468] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:33.552048 996 leader_election.cc:304] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:33.552827 1693 ts_tablet_manager.cc:1929] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.552897 1693 log.cc:1199] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/e7a541291c504f98a7e6c887d6ef695b
I20260317 20:57:33.553133 1693 ts_tablet_manager.cc:1950] T e7a541291c504f98a7e6c887d6ef695b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:33.548046 1653 tablet_bootstrap.cc:654] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.555377 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a80fa082afee4c3b93bbe757b61cb3ee" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:33.555521 1197 raft_consensus.cc:3060] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.556653 1197 raft_consensus.cc:2468] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:33.557058 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet e7a541291c504f98a7e6c887d6ef695b (table default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]) successfully deleted
I20260317 20:57:33.557808 1449 consensus_queue.cc:1048] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:33.558449 1451 raft_consensus.cc:2804] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:33.558674 1451 raft_consensus.cc:697] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:33.558821 1451 consensus_queue.cc:237] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.559310 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet e7a541291c504f98a7e6c887d6ef695b (table default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]) successfully deleted
I20260317 20:57:33.566355 798 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_7ebd9bdc267143a699de00438360c54a [id=262f037e46644a98890abee1b764ba1e] alter complete (version 1)
I20260317 20:57:33.567142 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 0df6fe0e6b844b0384809c0d52f2421b (DEFAULT_TABLE table=default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.567479 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df6fe0e6b844b0384809c0d52f2421b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.568565 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 0df6fe0e6b844b0384809c0d52f2421b (DEFAULT_TABLE table=default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.568863 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df6fe0e6b844b0384809c0d52f2421b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.570001 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 0df6fe0e6b844b0384809c0d52f2421b (DEFAULT_TABLE table=default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.570310 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df6fe0e6b844b0384809c0d52f2421b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.572384 798 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9] alter complete (version 1)
I20260317 20:57:33.576798 1653 tablet_bootstrap.cc:492] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:33.576939 1653 ts_tablet_manager.cc:1403] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.001s
I20260317 20:57:33.577518 1653 raft_consensus.cc:359] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.577654 1653 raft_consensus.cc:385] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.577697 1653 raft_consensus.cc:740] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.577819 1653 consensus_queue.cc:260] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.578157 1653 ts_tablet_manager.cc:1434] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260317 20:57:33.578388 1653 tablet_bootstrap.cc:492] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:33.579500 791 catalog_manager.cc:5671] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:33.579960 1653 tablet_bootstrap.cc:654] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.580152 1654 tablet_bootstrap.cc:492] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:33.580171 798 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70] alter complete (version 1)
I20260317 20:57:33.580240 1654 ts_tablet_manager.cc:1403] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.002s
I20260317 20:57:33.580734 798 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_79c743594792412ea112f4cd57316c36"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:33.580766 1654 raft_consensus.cc:359] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.580875 1654 raft_consensus.cc:385] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.580906 1654 raft_consensus.cc:740] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.581030 1654 consensus_queue.cc:260] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.581360 1654 ts_tablet_manager.cc:1434] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:33.581550 1654 tablet_bootstrap.cc:492] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:33.582238 1653 tablet_bootstrap.cc:492] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:33.582319 1653 ts_tablet_manager.cc:1403] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260317 20:57:33.583503 1654 tablet_bootstrap.cc:654] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.584561 1652 tablet_bootstrap.cc:492] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:33.584688 1652 ts_tablet_manager.cc:1403] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20260317 20:57:33.585234 1652 raft_consensus.cc:359] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.585336 1652 raft_consensus.cc:385] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.585367 1652 raft_consensus.cc:740] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.585479 1652 consensus_queue.cc:260] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.585805 1652 ts_tablet_manager.cc:1434] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:33.585996 1652 tablet_bootstrap.cc:492] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:33.587021 1652 tablet_bootstrap.cc:654] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.587780 1653 raft_consensus.cc:359] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.587893 1653 raft_consensus.cc:385] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.587925 1653 raft_consensus.cc:740] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.588037 1653 consensus_queue.cc:260] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.588315 1653 ts_tablet_manager.cc:1434] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.006s user 0.000s sys 0.000s
I20260317 20:57:33.590796 791 master_service.cc:954] ReplaceTablet: received request to replace tablet eb1d6f3d7d174730bd8c32e89bb5c984 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:33.591073 791 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 42) took 1697 ms. Trace:
I20260317 20:57:33.591132 791 rpcz_store.cc:276] 0317 20:57:31.894095 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.590772 (+1696677us) service_pool.cc:225] Handling call
0317 20:57:33.591061 (+ 289us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260317 20:57:33.591614 1565 raft_consensus.cc:493] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:33.591707 1565 raft_consensus.cc:515] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.592080 1565 leader_election.cc:290] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.593118 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce5b0bca40b422892510e8667421e94" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:33.593266 1061 raft_consensus.cc:2468] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:33.594225 791 master_service.cc:954] ReplaceTablet: received request to replace tablet eb1d6f3d7d174730bd8c32e89bb5c984 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:33.594426 791 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 43) took 1689 ms. Trace:
I20260317 20:57:33.594471 791 rpcz_store.cc:276] 0317 20:57:31.904896 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.594202 (+1689306us) service_pool.cc:225] Handling call
0317 20:57:33.594419 (+ 217us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260317 20:57:33.594983 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce5b0bca40b422892510e8667421e94" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:33.595120 1334 raft_consensus.cc:2468] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:33.595577 791 master_service.cc:954] ReplaceTablet: received request to replace tablet cd2bbbaf425c4998a6913b1444740bb4 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:33.595625 1133 leader_election.cc:304] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:33.595826 1565 raft_consensus.cc:2804] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:33.595891 1565 raft_consensus.cc:493] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:33.595948 1565 raft_consensus.cc:3060] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.597141 1565 raft_consensus.cc:515] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.597569 1565 leader_election.cc:290] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.599984 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce5b0bca40b422892510e8667421e94" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:33.600145 1061 raft_consensus.cc:3060] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.601269 1061 raft_consensus.cc:2468] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:33.601920 1654 tablet_bootstrap.cc:492] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:33.602030 1654 ts_tablet_manager.cc:1403] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20260317 20:57:33.602110 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ce5b0bca40b422892510e8667421e94" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:33.602236 1334 raft_consensus.cc:3060] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.602612 1654 raft_consensus.cc:359] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.602705 1654 raft_consensus.cc:385] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.602732 1654 raft_consensus.cc:740] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.602852 1654 consensus_queue.cc:260] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.603163 1654 ts_tablet_manager.cc:1434] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:33.603246 1334 raft_consensus.cc:2468] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:33.606971 1133 leader_election.cc:304] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:33.609197 1565 raft_consensus.cc:2804] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:33.609359 1565 raft_consensus.cc:697] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:33.609516 1565 consensus_queue.cc:237] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.617736 791 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet cd2bbbaf425c4998a6913b1444740bb4
I20260317 20:57:33.619719 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet cd2bbbaf425c4998a6913b1444740bb4 with delete_type TABLET_DATA_DELETED (replaced by tablet fb690e450f344e75ac7f4ca49f6a8445) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:33.619905 795 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]
I20260317 20:57:33.619935 1693 tablet_replica.cc:333] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:33.620062 1693 raft_consensus.cc:2243] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.620118 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet cd2bbbaf425c4998a6913b1444740bb4 with delete_type TABLET_DATA_DELETED (replaced by tablet fb690e450f344e75ac7f4ca49f6a8445) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:33.620198 1693 raft_consensus.cc:2272] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.620314 1694 tablet_replica.cc:333] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:33.620440 1694 raft_consensus.cc:2243] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:33.620636 1694 raft_consensus.cc:2272] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.620683 1693 ts_tablet_manager.cc:1916] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.621017 1694 ts_tablet_manager.cc:1916] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.623106 1693 ts_tablet_manager.cc:1929] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.623106 1694 ts_tablet_manager.cc:1929] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.623178 1694 log.cc:1199] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/cd2bbbaf425c4998a6913b1444740bb4
I20260317 20:57:33.623178 1693 log.cc:1199] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/cd2bbbaf425c4998a6913b1444740bb4
I20260317 20:57:33.623435 1694 ts_tablet_manager.cc:1950] T cd2bbbaf425c4998a6913b1444740bb4 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:33.623448 1693 ts_tablet_manager.cc:1950] T cd2bbbaf425c4998a6913b1444740bb4 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:33.623864 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet cd2bbbaf425c4998a6913b1444740bb4 with delete_type TABLET_DATA_DELETED (replaced by tablet fb690e450f344e75ac7f4ca49f6a8445) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:33.624073 1695 tablet_replica.cc:333] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:33.624208 1695 raft_consensus.cc:2243] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.624332 1695 raft_consensus.cc:2272] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.624745 1695 ts_tablet_manager.cc:1916] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.627020 1695 ts_tablet_manager.cc:1929] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.627135 1695 log.cc:1199] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/cd2bbbaf425c4998a6913b1444740bb4
I20260317 20:57:33.627417 1695 ts_tablet_manager.cc:1950] T cd2bbbaf425c4998a6913b1444740bb4 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:33.628260 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet cd2bbbaf425c4998a6913b1444740bb4 (table default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]) successfully deleted
I20260317 20:57:33.628885 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet cd2bbbaf425c4998a6913b1444740bb4 (table default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]) successfully deleted
I20260317 20:57:33.629369 1177 tablet_service.cc:1511] Processing CreateTablet for tablet fb690e450f344e75ac7f4ca49f6a8445 (DEFAULT_TABLE table=default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.629482 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet cd2bbbaf425c4998a6913b1444740bb4 (table default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]) successfully deleted
I20260317 20:57:33.629662 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb690e450f344e75ac7f4ca49f6a8445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.631935 1654 tablet_bootstrap.cc:492] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:33.632711 1313 tablet_service.cc:1511] Processing CreateTablet for tablet fb690e450f344e75ac7f4ca49f6a8445 (DEFAULT_TABLE table=default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.632995 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb690e450f344e75ac7f4ca49f6a8445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.633069 1654 tablet_bootstrap.cc:654] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.633445 1041 tablet_service.cc:1511] Processing CreateTablet for tablet fb690e450f344e75ac7f4ca49f6a8445 (DEFAULT_TABLE table=default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.633692 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb690e450f344e75ac7f4ca49f6a8445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.634366 1652 tablet_bootstrap.cc:492] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:33.634462 1652 ts_tablet_manager.cc:1403] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20260317 20:57:33.634819 1462 raft_consensus.cc:493] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:33.634909 1462 raft_consensus.cc:515] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.635000 1652 raft_consensus.cc:359] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.635097 1652 raft_consensus.cc:385] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.635128 1652 raft_consensus.cc:740] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.635247 1652 consensus_queue.cc:260] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.635347 1462 leader_election.cc:290] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:33.635557 1652 ts_tablet_manager.cc:1434] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:33.635768 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6fe0e6b844b0384809c0d52f2421b" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:33.635893 1197 raft_consensus.cc:2468] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:33.636168 1268 leader_election.cc:304] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:33.636590 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6fe0e6b844b0384809c0d52f2421b" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:33.636710 1059 raft_consensus.cc:2468] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:33.639468 1653 tablet_bootstrap.cc:492] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:33.639545 1462 raft_consensus.cc:2804] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:33.639626 1462 raft_consensus.cc:493] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:33.639683 1462 raft_consensus.cc:3060] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.640625 1462 raft_consensus.cc:515] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.640906 1653 tablet_bootstrap.cc:654] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.641052 1462 leader_election.cc:290] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:33.641538 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6fe0e6b844b0384809c0d52f2421b" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:33.641677 1059 raft_consensus.cc:3060] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.641880 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6fe0e6b844b0384809c0d52f2421b" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:33.642024 1197 raft_consensus.cc:3060] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.642822 1059 raft_consensus.cc:2468] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:33.643045 1197 raft_consensus.cc:2468] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:33.643240 1269 leader_election.cc:304] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:33.643433 1654 tablet_bootstrap.cc:492] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:33.643522 1654 ts_tablet_manager.cc:1403] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20260317 20:57:33.643607 1462 raft_consensus.cc:2804] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:33.643704 1462 raft_consensus.cc:697] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:33.643834 1462 consensus_queue.cc:237] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.644094 1654 raft_consensus.cc:359] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.644193 1654 raft_consensus.cc:385] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.644232 1654 raft_consensus.cc:740] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.644363 1654 consensus_queue.cc:260] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.644707 1654 ts_tablet_manager.cc:1434] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260317 20:57:33.644987 1652 tablet_bootstrap.cc:492] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:33.645664 791 catalog_manager.cc:6741] ReplaceTablet: tablet cd2bbbaf425c4998a6913b1444740bb4 deleted and replaced by tablet fb690e450f344e75ac7f4ca49f6a8445
I20260317 20:57:33.645771 791 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 44) took 1729 ms. Trace:
I20260317 20:57:33.645821 791 rpcz_store.cc:276] 0317 20:57:31.916749 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.595560 (+1678811us) service_pool.cc:225] Handling call
0317 20:57:33.602991 (+ 7431us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.602998 (+ 7us) write_op.cc:454] Released schema lock
0317 20:57:33.645761 (+ 42763us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:33.596187 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:33.596282 (+ 95us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:33.596286 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:33.596287 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:33.596355 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:33.596364 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:33.596367 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:33.596418 (+ 51us) tablet.cc:700] Row locks acquired
0317 20:57:33.596419 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:33.596443 (+ 24us) write_op.cc:270] Start()
0317 20:57:33.596467 (+ 24us) write_op.cc:276] Timestamp: P: 1773781053596382 usec, L: 0
0317 20:57:33.596468 (+ 1us) op_driver.cc:348] REPLICATION: starting
0317 20:57:33.596595 (+ 127us) log.cc:844] Serialized 661 byte log entry
0317 20:57:33.599899 (+ 3304us) op_driver.cc:464] REPLICATION: finished
0317 20:57:33.601420 (+ 1521us) write_op.cc:301] APPLY: starting
0317 20:57:33.601437 (+ 17us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:33.601467 (+ 30us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:33.601484 (+ 17us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:33.601551 (+ 67us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:33.601589 (+ 38us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0317 20:57:33.601593 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:33.601644 (+ 51us) log.cc:844] Serialized 28 byte log entry
0317 20:57:33.601686 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.601717 (+ 31us) write_op.cc:454] Released schema lock
0317 20:57:33.601722 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":1466,"apply.run_cpu_time_us":348,"apply.run_wall_time_us":348,"num_ops":2,"prepare.queue_time_us":40,"prepare.run_cpu_time_us":526,"prepare.run_wall_time_us":5814,"raft.queue_time_us":674,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":326,"replication_time_us":3406}]]}
I20260317 20:57:33.646219 1652 tablet_bootstrap.cc:654] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.653964 1652 tablet_bootstrap.cc:492] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:33.654227 1652 ts_tablet_manager.cc:1403] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s
I20260317 20:57:33.654981 1652 raft_consensus.cc:359] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.655099 1652 raft_consensus.cc:385] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.655129 1652 raft_consensus.cc:740] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.655248 1652 consensus_queue.cc:260] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.655491 1652 ts_tablet_manager.cc:1434] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:33.657117 791 catalog_manager.cc:5671] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:33.657611 1653 tablet_bootstrap.cc:492] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:33.657740 1653 ts_tablet_manager.cc:1403] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260317 20:57:33.658342 1653 raft_consensus.cc:359] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.658474 1653 raft_consensus.cc:385] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.658514 1653 raft_consensus.cc:740] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.658643 1653 consensus_queue.cc:260] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.658955 1653 ts_tablet_manager.cc:1434] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:33.678236 791 catalog_manager.cc:5671] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:33.687294 796 catalog_manager.cc:2174] created HMS catalog entry for table [id=b4359316a03b48bcb97b2d377b1c5c93]
I20260317 20:57:33.691738 796 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 33) took 2090 ms. Trace:
I20260317 20:57:33.691859 796 rpcz_store.cc:276] 0317 20:57:31.601461 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.257389 (+1655928us) service_pool.cc:225] Handling call
0317 20:57:33.520493 (+263104us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:33.520856 (+ 363us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:33.687281 (+166425us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:33.691538 (+ 4257us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:33.691631 (+ 93us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:33.691719 (+ 88us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:33.687915 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:33.688024 (+ 109us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:33.688029 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:33.688030 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:33.688097 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:33.688105 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:33.688108 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:33.688163 (+ 55us) tablet.cc:700] Row locks acquired
0317 20:57:33.688164 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:33.688190 (+ 26us) write_op.cc:270] Start()
0317 20:57:33.688212 (+ 22us) write_op.cc:276] Timestamp: P: 1773781053688109 usec, L: 0
0317 20:57:33.688214 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:33.688344 (+ 130us) log.cc:844] Serialized 432 byte log entry
0317 20:57:33.690949 (+ 2605us) op_driver.cc:464] REPLICATION: finished
0317 20:57:33.691029 (+ 80us) write_op.cc:301] APPLY: starting
0317 20:57:33.691042 (+ 13us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:33.691073 (+ 31us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:33.691087 (+ 14us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:33.691168 (+ 81us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:33.691193 (+ 25us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:33.691197 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:33.691249 (+ 52us) log.cc:844] Serialized 28 byte log entry
0317 20:57:33.691293 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.691305 (+ 12us) write_op.cc:454] Released schema lock
0317 20:57:33.691310 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:33.691361 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.691363 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":98797,"Hive Metastore.run_cpu_time_us":207,"Hive Metastore.run_wall_time_us":67371,"child_traces":[["op",{"apply.queue_time_us":45,"apply.run_cpu_time_us":325,"apply.run_wall_time_us":324,"num_ops":2,"prepare.queue_time_us":116,"prepare.run_cpu_time_us":487,"prepare.run_wall_time_us":488,"replication_time_us":2699}]]}
I20260317 20:57:33.696696 796 master_service.cc:954] ReplaceTablet: received request to replace tablet 05afc5b78c3b4724850eb1f994b4ccf3 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:33.696967 796 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 45) took 1743 ms. Trace:
I20260317 20:57:33.697016 796 rpcz_store.cc:276] 0317 20:57:31.953235 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.696669 (+1743434us) service_pool.cc:225] Handling call
0317 20:57:33.696943 (+ 274us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260317 20:57:33.697181 796 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_9e4d286026a74f549f1874d0f1b908de" } new_table_name: "default.Table_df3d165713f44a8b87b980f60d112d34" modify_external_catalogs: true
I20260317 20:57:33.704337 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 71ed1a25a2d849eba1adb7ebf2c6a733 (DEFAULT_TABLE table=default.table_c63b594cb8ad4d4bb2d094326fff5111 [id=b4359316a03b48bcb97b2d377b1c5c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.704337 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 71ed1a25a2d849eba1adb7ebf2c6a733 (DEFAULT_TABLE table=default.table_c63b594cb8ad4d4bb2d094326fff5111 [id=b4359316a03b48bcb97b2d377b1c5c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.704650 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ed1a25a2d849eba1adb7ebf2c6a733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.704650 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ed1a25a2d849eba1adb7ebf2c6a733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.706897 1652 tablet_bootstrap.cc:492] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:33.707165 1653 tablet_bootstrap.cc:492] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:33.707676 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 71ed1a25a2d849eba1adb7ebf2c6a733 (DEFAULT_TABLE table=default.table_c63b594cb8ad4d4bb2d094326fff5111 [id=b4359316a03b48bcb97b2d377b1c5c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.707974 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71ed1a25a2d849eba1adb7ebf2c6a733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.708098 1652 tablet_bootstrap.cc:654] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.708168 1653 tablet_bootstrap.cc:654] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.710470 1654 tablet_bootstrap.cc:492] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:33.711555 1654 tablet_bootstrap.cc:654] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.713527 791 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_5e656cced82044008854c0c5271d95d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:33.714833 1653 tablet_bootstrap.cc:492] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:33.714941 1653 ts_tablet_manager.cc:1403] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:33.715982 1653 raft_consensus.cc:359] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.716097 1653 raft_consensus.cc:385] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.716125 1653 raft_consensus.cc:740] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.716269 1653 consensus_queue.cc:260] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.716526 1653 ts_tablet_manager.cc:1434] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:33.722766 1654 tablet_bootstrap.cc:492] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:33.722930 1654 ts_tablet_manager.cc:1403] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.003s
I20260317 20:57:33.723809 1654 raft_consensus.cc:359] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.723958 1654 raft_consensus.cc:385] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.723995 1654 raft_consensus.cc:740] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.724149 1654 consensus_queue.cc:260] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.724475 1654 ts_tablet_manager.cc:1434] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:33.733691 1652 tablet_bootstrap.cc:492] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:33.733844 1652 ts_tablet_manager.cc:1403] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.001s
I20260317 20:57:33.734428 1652 raft_consensus.cc:359] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.734570 1652 raft_consensus.cc:385] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.734603 1652 raft_consensus.cc:740] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.734767 1652 consensus_queue.cc:260] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.735069 1652 ts_tablet_manager.cc:1434] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:33.742859 792 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_8e39f763b78b443eb64d97cb4d88570a [id=151f2703b99946fb99c43b1ac473b677]
I20260317 20:57:33.746632 948 catalog_manager.cc:2772] Deleting table default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8] in response to Hive Metastore notification log event 22
I20260317 20:57:33.752903 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet fb690e450f344e75ac7f4ca49f6a8445
I20260317 20:57:33.753541 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet fb690e450f344e75ac7f4ca49f6a8445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:33.753615 948 catalog_manager.cc:2772] Deleting table default.table_8e39f763b78b443eb64d97cb4d88570a [id=151f2703b99946fb99c43b1ac473b677] in response to Hive Metastore notification log event 24
I20260317 20:57:33.753768 1693 tablet_replica.cc:333] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:33.753891 1693 raft_consensus.cc:2243] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.753993 1693 raft_consensus.cc:2272] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.754439 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet fb690e450f344e75ac7f4ca49f6a8445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:33.754536 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet fb690e450f344e75ac7f4ca49f6a8445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:33.754657 1695 tablet_replica.cc:333] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:33.754719 1694 tablet_replica.cc:333] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:33.754805 1695 raft_consensus.cc:2243] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.754840 1694 raft_consensus.cc:2243] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.754925 1695 raft_consensus.cc:2272] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.754936 1694 raft_consensus.cc:2272] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.755003 1693 ts_tablet_manager.cc:1916] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.755386 1694 ts_tablet_manager.cc:1916] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.757418 1693 ts_tablet_manager.cc:1929] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:33.757524 1693 log.cc:1199] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/fb690e450f344e75ac7f4ca49f6a8445
I20260317 20:57:33.757620 1694 ts_tablet_manager.cc:1929] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:33.757714 1694 log.cc:1199] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/fb690e450f344e75ac7f4ca49f6a8445
I20260317 20:57:33.757762 1693 ts_tablet_manager.cc:1950] T fb690e450f344e75ac7f4ca49f6a8445 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:33.757908 1694 ts_tablet_manager.cc:1950] T fb690e450f344e75ac7f4ca49f6a8445 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:33.758689 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet fb690e450f344e75ac7f4ca49f6a8445 (table default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]) successfully deleted
I20260317 20:57:33.759234 1695 ts_tablet_manager.cc:1916] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.761459 1695 ts_tablet_manager.cc:1929] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:33.761536 1695 log.cc:1199] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/fb690e450f344e75ac7f4ca49f6a8445
I20260317 20:57:33.762408 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet fb690e450f344e75ac7f4ca49f6a8445 (table default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]) successfully deleted
I20260317 20:57:33.762737 1695 ts_tablet_manager.cc:1950] T fb690e450f344e75ac7f4ca49f6a8445 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:33.763707 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet fb690e450f344e75ac7f4ca49f6a8445 (table default.table_546787ba946048329e14e21785ced611 [id=4e5a8129f6854a90b31140e70ff041c8]) successfully deleted
I20260317 20:57:33.765969 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 4dcaf5ab229445bda791c6e807c60034
I20260317 20:57:33.766841 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dcaf5ab229445bda791c6e807c60034 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:33.766839 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dcaf5ab229445bda791c6e807c60034 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:33.767036 1695 tablet_replica.cc:333] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:33.767086 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 4dcaf5ab229445bda791c6e807c60034 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:33 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:33.767144 1693 tablet_replica.cc:333] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:33.767179 1695 raft_consensus.cc:2243] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.767302 1695 raft_consensus.cc:2272] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260317 20:57:33.767300 794 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_791a1827dff94dfc93d45ed5bfbcce82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:33.767448 1693 raft_consensus.cc:2243] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:33.767510 1694 tablet_replica.cc:333] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:33.767671 1694 raft_consensus.cc:2243] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:33.767741 1695 ts_tablet_manager.cc:1916] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.767839 1694 raft_consensus.cc:2272] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:33.767941 1693 raft_consensus.cc:2272] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260317 20:57:33.768159 797 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e410d42be96e4ac58f16d30d662b4ad4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:33.768205 1694 ts_tablet_manager.cc:1916] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:33.768375 1693 ts_tablet_manager.cc:1916] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260317 20:57:33.768883 793 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e2da314b82a64ac3abd49740cd983744 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:33.770696 1693 ts_tablet_manager.cc:1929] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.770766 1694 ts_tablet_manager.cc:1929] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.770902 1693 log.cc:1199] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/4dcaf5ab229445bda791c6e807c60034
I20260317 20:57:33.770865 1694 log.cc:1199] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/4dcaf5ab229445bda791c6e807c60034
I20260317 20:57:33.771236 1693 ts_tablet_manager.cc:1950] T 4dcaf5ab229445bda791c6e807c60034 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:33.771225 1694 ts_tablet_manager.cc:1950] T 4dcaf5ab229445bda791c6e807c60034 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:33.771862 1695 ts_tablet_manager.cc:1929] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:33.771948 1695 log.cc:1199] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/4dcaf5ab229445bda791c6e807c60034
I20260317 20:57:33.772186 1695 ts_tablet_manager.cc:1950] T 4dcaf5ab229445bda791c6e807c60034 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:33.772178 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 4dcaf5ab229445bda791c6e807c60034 (table default.table_8e39f763b78b443eb64d97cb4d88570a [id=151f2703b99946fb99c43b1ac473b677]) successfully deleted
I20260317 20:57:33.772182 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 4dcaf5ab229445bda791c6e807c60034 (table default.table_8e39f763b78b443eb64d97cb4d88570a [id=151f2703b99946fb99c43b1ac473b677]) successfully deleted
I20260317 20:57:33.772958 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 4dcaf5ab229445bda791c6e807c60034 (table default.table_8e39f763b78b443eb64d97cb4d88570a [id=151f2703b99946fb99c43b1ac473b677]) successfully deleted
I20260317 20:57:33.833953 799 catalog_manager.cc:3502] renamed table default.table_0ef0ec042f05496c9732c4a2d7e9b991 [id=a4ba9bce277146cc8c2a1cfcbf90f951] in HMS: new name default.table_b832fcb92ce7484c9bf70cdd65f3a109
I20260317 20:57:33.839625 1715 raft_consensus.cc:493] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:33.839800 1715 raft_consensus.cc:515] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.840340 1715 leader_election.cc:290] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.841198 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ed1a25a2d849eba1adb7ebf2c6a733" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:33.841378 1059 raft_consensus.cc:2468] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:33.841657 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ed1a25a2d849eba1adb7ebf2c6a733" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:33.841811 1334 raft_consensus.cc:2468] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:33.842566 1133 leader_election.cc:304] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:33.842968 1715 raft_consensus.cc:2804] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:33.843031 1715 raft_consensus.cc:493] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:33.843070 1715 raft_consensus.cc:3060] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.844240 1715 raft_consensus.cc:515] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.844818 1715 leader_election.cc:290] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.845913 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ed1a25a2d849eba1adb7ebf2c6a733" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:33.846099 1334 raft_consensus.cc:3060] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.847296 1334 raft_consensus.cc:2468] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:33.847755 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71ed1a25a2d849eba1adb7ebf2c6a733" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:33.847895 1059 raft_consensus.cc:3060] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.849049 1059 raft_consensus.cc:2468] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:33.850225 1133 leader_election.cc:304] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:33.850903 1715 raft_consensus.cc:2804] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:33.851006 1715 raft_consensus.cc:697] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:33.851154 1715 consensus_queue.cc:237] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.853477 1565 consensus_queue.cc:1048] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:33.867987 1449 consensus_queue.cc:1048] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:33.884040 794 catalog_manager.cc:2174] created HMS catalog entry for table [id=5252bc6500764ca8825af7718c54d03e]
I20260317 20:57:33.891850 794 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 36) took 2204 ms. Trace:
I20260317 20:57:33.891968 794 rpcz_store.cc:276] 0317 20:57:31.687307 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.521308 (+1834001us) service_pool.cc:225] Handling call
0317 20:57:33.767377 (+246069us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:33.767796 (+ 419us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:33.884025 (+116229us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:33.891616 (+ 7591us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:33.891725 (+ 109us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:33.891825 (+ 100us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:33.884770 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:33.884892 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:33.884895 (+ 3us) write_op.cc:435] Acquired schema lock
0317 20:57:33.884896 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:33.884959 (+ 63us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:33.884969 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:33.884972 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:33.885019 (+ 47us) tablet.cc:700] Row locks acquired
0317 20:57:33.885019 (+ 0us) write_op.cc:260] PREPARE: finished
0317 20:57:33.885048 (+ 29us) write_op.cc:270] Start()
0317 20:57:33.885075 (+ 27us) write_op.cc:276] Timestamp: P: 1773781053884929 usec, L: 0
0317 20:57:33.885076 (+ 1us) op_driver.cc:348] REPLICATION: starting
0317 20:57:33.885216 (+ 140us) log.cc:844] Serialized 432 byte log entry
0317 20:57:33.888110 (+ 2894us) op_driver.cc:464] REPLICATION: finished
0317 20:57:33.888208 (+ 98us) write_op.cc:301] APPLY: starting
0317 20:57:33.888230 (+ 22us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:33.888265 (+ 35us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:33.888282 (+ 17us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:33.888361 (+ 79us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:33.888393 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:33.888397 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:33.888477 (+ 80us) log.cc:844] Serialized 28 byte log entry
0317 20:57:33.888541 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.888553 (+ 12us) write_op.cc:454] Released schema lock
0317 20:57:33.888559 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:33.888627 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:33.888629 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":66093,"Hive Metastore.run_cpu_time_us":304,"Hive Metastore.run_wall_time_us":49995,"child_traces":[["op",{"apply.queue_time_us":52,"apply.run_cpu_time_us":407,"apply.run_wall_time_us":407,"num_ops":2,"prepare.queue_time_us":134,"prepare.run_cpu_time_us":586,"prepare.run_wall_time_us":586,"raft.queue_time_us":348,"raft.run_cpu_time_us":442,"raft.run_wall_time_us":442,"replication_time_us":2999}]]}
I20260317 20:57:33.907130 1059 raft_consensus.cc:1275] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Refusing update from remote peer 630e777e97c141a69e35660f32b26f6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:33.907979 1197 raft_consensus.cc:1275] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Refusing update from remote peer 630e777e97c141a69e35660f32b26f6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:33.908417 1450 consensus_queue.cc:1048] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:33.909251 1177 tablet_service.cc:1511] Processing CreateTablet for tablet ac00453b303f4af780abc0f39f0f0ada (DEFAULT_TABLE table=default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.909603 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac00453b303f4af780abc0f39f0f0ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.909859 1041 tablet_service.cc:1511] Processing CreateTablet for tablet ac00453b303f4af780abc0f39f0f0ada (DEFAULT_TABLE table=default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.910171 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac00453b303f4af780abc0f39f0f0ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.910629 1313 tablet_service.cc:1511] Processing CreateTablet for tablet ac00453b303f4af780abc0f39f0f0ada (DEFAULT_TABLE table=default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:33.910876 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac00453b303f4af780abc0f39f0f0ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:33.912635 1652 tablet_bootstrap.cc:492] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:33.913098 1653 tablet_bootstrap.cc:492] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:33.913825 1652 tablet_bootstrap.cc:654] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.914355 1653 tablet_bootstrap.cc:654] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.914922 1450 consensus_queue.cc:1048] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:33.921032 1654 tablet_bootstrap.cc:492] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:33.921865 1653 tablet_bootstrap.cc:492] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:33.921973 1653 ts_tablet_manager.cc:1403] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260317 20:57:33.922261 1654 tablet_bootstrap.cc:654] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:33.922510 1653 raft_consensus.cc:359] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.922626 1653 raft_consensus.cc:385] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.922657 1653 raft_consensus.cc:740] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.922816 1653 consensus_queue.cc:260] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.923489 1653 ts_tablet_manager.cc:1434] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:33.926601 792 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 34) took 2292 ms. Trace:
I20260317 20:57:33.926710 792 rpcz_store.cc:276] 0317 20:57:31.634509 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.327386 (+1692877us) service_pool.cc:225] Handling call
0317 20:57:33.521603 (+194217us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.926576 (+404973us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":165480,"Hive Metastore.run_cpu_time_us":176,"Hive Metastore.run_wall_time_us":55638}
W20260317 20:57:33.926898 800 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_231a8eed1e2d4957a62ed9029daf6f72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:33.927747 798 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_79c743594792412ea112f4cd57316c36 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:33.928308 795 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 32) took 2354 ms. Trace:
I20260317 20:57:33.928364 795 rpcz_store.cc:276] 0317 20:57:31.573488 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:32.693740 (+1120252us) service_pool.cc:225] Handling call
0317 20:57:33.519936 (+826196us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:33.928291 (+408355us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":2353,"Hive Metastore.run_cpu_time_us":168,"Hive Metastore.run_wall_time_us":97298}
I20260317 20:57:33.928527 792 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_cde2029a6fbb404892afd070c4de7abd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:33.928582 795 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_4993eb4cbf8d4cd28646b149b3c141bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260317 20:57:33.926899 791 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5e656cced82044008854c0c5271d95d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:33.930625 1689 tablet.cc:1723] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.931361 1690 tablet.cc:1723] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.942484 794 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet 0df6fe0e6b844b0384809c0d52f2421b (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]). Expected version 1 got 0
I20260317 20:57:33.945812 794 catalog_manager.cc:5671] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:33.946913 1691 tablet.cc:1723] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:33.968639 1654 tablet_bootstrap.cc:492] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:33.968793 1654 ts_tablet_manager.cc:1403] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20260317 20:57:33.969425 1654 raft_consensus.cc:359] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.969568 1654 raft_consensus.cc:385] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.969602 1654 raft_consensus.cc:740] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.970534 1654 consensus_queue.cc:260] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.973484 1654 ts_tablet_manager.cc:1434] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260317 20:57:33.974215 1652 tablet_bootstrap.cc:492] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:33.974344 1652 ts_tablet_manager.cc:1403] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.062s user 0.000s sys 0.002s
I20260317 20:57:33.974906 1652 raft_consensus.cc:359] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.975221 1652 raft_consensus.cc:385] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:33.975270 1652 raft_consensus.cc:740] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:33.975579 1652 consensus_queue.cc:260] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.978483 1652 ts_tablet_manager.cc:1434] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260317 20:57:33.981089 1715 raft_consensus.cc:493] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:33.983996 1715 raft_consensus.cc:515] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.984623 1715 leader_election.cc:290] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.985324 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00453b303f4af780abc0f39f0f0ada" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:33.985504 1334 raft_consensus.cc:2468] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:33.985908 1133 leader_election.cc:304] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:33.986352 1715 raft_consensus.cc:2804] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:33.986423 1715 raft_consensus.cc:493] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:33.986475 1715 raft_consensus.cc:3060] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.987743 1715 raft_consensus.cc:515] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:33.988255 1715 leader_election.cc:290] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:33.988992 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00453b303f4af780abc0f39f0f0ada" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:33.989140 1334 raft_consensus.cc:3060] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.990975 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00453b303f4af780abc0f39f0f0ada" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:33.991170 1059 raft_consensus.cc:2468] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:33.991484 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00453b303f4af780abc0f39f0f0ada" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:33.991591 1061 raft_consensus.cc:3060] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:33.992944 1061 raft_consensus.cc:2468] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:33.994156 1334 raft_consensus.cc:2468] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:33.994745 1133 leader_election.cc:304] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:33.995277 1449 raft_consensus.cc:2804] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:33.995393 1449 raft_consensus.cc:697] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:33.995600 1449 consensus_queue.cc:237] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.000919 1565 consensus_queue.cc:1048] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:33.966346 794 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951] alter complete (version 1)
I20260317 20:57:33.972885 797 catalog_manager.cc:2174] created HMS catalog entry for table [id=bc541149fbdd48ea9861ed3c108807cd]
I20260317 20:57:34.014283 797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 37) took 2287 ms. Trace:
I20260317 20:57:34.014384 797 rpcz_store.cc:276] 0317 20:57:31.727131 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.522069 (+1794938us) service_pool.cc:225] Handling call
0317 20:57:33.768248 (+246179us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:33.768587 (+ 339us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:33.972873 (+204286us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:34.014075 (+ 41202us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:34.014181 (+ 106us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:34.014264 (+ 83us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:34.009352 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:34.009517 (+ 165us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:34.009522 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:34.009524 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:34.009606 (+ 82us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:34.009620 (+ 14us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:34.009623 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:34.009711 (+ 88us) tablet.cc:700] Row locks acquired
0317 20:57:34.009713 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:34.009754 (+ 41us) write_op.cc:270] Start()
0317 20:57:34.009790 (+ 36us) write_op.cc:276] Timestamp: P: 1773781054009716 usec, L: 0
0317 20:57:34.009791 (+ 1us) op_driver.cc:348] REPLICATION: starting
0317 20:57:34.009969 (+ 178us) log.cc:844] Serialized 432 byte log entry
0317 20:57:34.013309 (+ 3340us) op_driver.cc:464] REPLICATION: finished
0317 20:57:34.013597 (+ 288us) write_op.cc:301] APPLY: starting
0317 20:57:34.013618 (+ 21us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:34.013681 (+ 63us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:34.013707 (+ 26us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:34.013791 (+ 84us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:34.013825 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:34.013832 (+ 7us) write_op.cc:312] APPLY: finished
0317 20:57:34.013903 (+ 71us) log.cc:844] Serialized 28 byte log entry
0317 20:57:34.013957 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.013972 (+ 15us) write_op.cc:454] Released schema lock
0317 20:57:34.013977 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:34.014077 (+ 100us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.014081 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":123529,"Hive Metastore.run_cpu_time_us":188,"Hive Metastore.run_wall_time_us":80593,"child_traces":[["op",{"apply.queue_time_us":216,"apply.run_cpu_time_us":478,"apply.run_wall_time_us":479,"num_ops":2,"prepare.queue_time_us":79,"prepare.run_cpu_time_us":848,"prepare.run_wall_time_us":1780,"raft.queue_time_us":573,"raft.run_cpu_time_us":471,"raft.run_wall_time_us":472,"replication_time_us":3488}]]}
I20260317 20:57:34.016288 797 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_c63b594cb8ad4d4bb2d094326fff5111" } new_table_name: "default.Table_e63b5215dfe141f78d97647d4e83411d" modify_external_catalogs: true
I20260317 20:57:34.020788 1313 tablet_service.cc:1511] Processing CreateTablet for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 (DEFAULT_TABLE table=default.table_e410d42be96e4ac58f16d30d662b4ad4 [id=bc541149fbdd48ea9861ed3c108807cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.020929 1041 tablet_service.cc:1511] Processing CreateTablet for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 (DEFAULT_TABLE table=default.table_e410d42be96e4ac58f16d30d662b4ad4 [id=bc541149fbdd48ea9861ed3c108807cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.021123 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.021157 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.023365 1653 tablet_bootstrap.cc:492] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.023563 1177 tablet_service.cc:1511] Processing CreateTablet for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 (DEFAULT_TABLE table=default.table_e410d42be96e4ac58f16d30d662b4ad4 [id=bc541149fbdd48ea9861ed3c108807cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.023845 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.024062 1715 consensus_queue.cc:1048] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.024421 1653 tablet_bootstrap.cc:654] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.025241 1652 tablet_bootstrap.cc:492] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.026316 1652 tablet_bootstrap.cc:654] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.026859 1654 tablet_bootstrap.cc:492] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.027871 1654 tablet_bootstrap.cc:654] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.032581 1652 tablet_bootstrap.cc:492] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.032704 1652 ts_tablet_manager.cc:1403] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:34.032817 1653 tablet_bootstrap.cc:492] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.032928 1653 ts_tablet_manager.cc:1403] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260317 20:57:34.033226 1652 raft_consensus.cc:359] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.033352 1652 raft_consensus.cc:385] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.033401 1652 raft_consensus.cc:740] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.033447 1653 raft_consensus.cc:359] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.033565 1653 raft_consensus.cc:385] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.033540 1652 consensus_queue.cc:260] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.033607 1653 raft_consensus.cc:740] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.033764 1653 consensus_queue.cc:260] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.033806 1652 ts_tablet_manager.cc:1434] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:34.034080 1653 ts_tablet_manager.cc:1434] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:34.039425 793 catalog_manager.cc:2174] created HMS catalog entry for table [id=779672e78a3549a48fef75a3ef465b69]
I20260317 20:57:34.043043 1654 tablet_bootstrap.cc:492] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.043154 1654 ts_tablet_manager.cc:1403] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.001s
I20260317 20:57:34.043638 1654 raft_consensus.cc:359] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.043761 1654 raft_consensus.cc:385] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.043794 1654 raft_consensus.cc:740] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.043902 1654 consensus_queue.cc:260] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.044150 1654 ts_tablet_manager.cc:1434] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:34.048583 1709 consensus_queue.cc:1048] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.051283 1450 raft_consensus.cc:493] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.051421 1450 raft_consensus.cc:515] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.051846 1450 leader_election.cc:290] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.052289 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd37fcd2fe5b4c4fbb739aa7fd75a517" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:34.052450 1197 raft_consensus.cc:2468] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:34.052809 1268 leader_election.cc:304] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:34.052994 1450 raft_consensus.cc:2804] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:34.053056 1450 raft_consensus.cc:493] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:34.053107 1450 raft_consensus.cc:3060] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.054258 1450 raft_consensus.cc:515] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.054647 1450 leader_election.cc:290] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.055133 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd37fcd2fe5b4c4fbb739aa7fd75a517" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:34.055272 1197 raft_consensus.cc:3060] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.056319 1197 raft_consensus.cc:2468] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:34.056706 1268 leader_election.cc:304] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:34.057310 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd37fcd2fe5b4c4fbb739aa7fd75a517" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:34.057448 1059 raft_consensus.cc:3060] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.057644 1450 raft_consensus.cc:2804] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:34.057752 1450 raft_consensus.cc:697] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:34.057904 1450 consensus_queue.cc:237] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.058485 1059 raft_consensus.cc:2468] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:34.058805 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd37fcd2fe5b4c4fbb739aa7fd75a517" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:34.058912 1061 raft_consensus.cc:2376] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1. Re-sending same reply.
I20260317 20:57:34.063225 1709 consensus_queue.cc:1048] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.086344 793 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 38) took 2312 ms. Trace:
I20260317 20:57:34.086447 793 rpcz_store.cc:276] 0317 20:57:31.773712 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.522533 (+1748821us) service_pool.cc:225] Handling call
0317 20:57:33.768965 (+246432us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:33.769250 (+ 285us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:34.039415 (+270165us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:34.086145 (+ 46730us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:34.086239 (+ 94us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:34.086322 (+ 83us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:34.040274 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:34.040397 (+ 123us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:34.040401 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:34.040403 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:34.040493 (+ 90us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:34.040503 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:34.040506 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:34.040564 (+ 58us) tablet.cc:700] Row locks acquired
0317 20:57:34.040566 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:34.040598 (+ 32us) write_op.cc:270] Start()
0317 20:57:34.040626 (+ 28us) write_op.cc:276] Timestamp: P: 1773781054040558 usec, L: 0
0317 20:57:34.040627 (+ 1us) op_driver.cc:348] REPLICATION: starting
0317 20:57:34.040762 (+ 135us) log.cc:844] Serialized 432 byte log entry
0317 20:57:34.085660 (+ 44898us) op_driver.cc:464] REPLICATION: finished
0317 20:57:34.085743 (+ 83us) write_op.cc:301] APPLY: starting
0317 20:57:34.085778 (+ 35us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:34.085809 (+ 31us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:34.085825 (+ 16us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:34.085898 (+ 73us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:34.085924 (+ 26us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:34.085928 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:34.085985 (+ 57us) log.cc:844] Serialized 28 byte log entry
0317 20:57:34.086030 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.086067 (+ 37us) write_op.cc:454] Released schema lock
0317 20:57:34.086072 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:34.086138 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.086140 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":203512,"Hive Metastore.run_cpu_time_us":188,"Hive Metastore.run_wall_time_us":66439,"child_traces":[["op",{"apply.queue_time_us":44,"apply.run_cpu_time_us":384,"apply.run_wall_time_us":383,"num_ops":2,"prepare.queue_time_us":365,"prepare.run_cpu_time_us":611,"prepare.run_wall_time_us":43700,"raft.queue_time_us":85399,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":365,"replication_time_us":45006}]]}
I20260317 20:57:34.088513 793 catalog_manager.cc:5671] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:34.091689 799 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 35) took 2414 ms. Trace:
I20260317 20:57:34.091816 799 rpcz_store.cc:276] 0317 20:57:31.677310 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.521178 (+1843868us) service_pool.cc:225] Handling call
0317 20:57:33.766713 (+245535us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:34.091150 (+324437us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:34.091424 (+ 274us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:34.091663 (+ 239us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":29,"Hive Metastore.run_cpu_time_us":537,"Hive Metastore.run_wall_time_us":66988}
I20260317 20:57:34.092144 799 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_7ebd9bdc267143a699de00438360c54a" } new_table_name: "default.Table_bfa0dd2ccbe04d26bb5885d568cd2393" modify_external_catalogs: true
I20260317 20:57:34.098690 793 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_3e019f83132e4014bc96f1473937b0aa" } modify_external_catalogs: true
I20260317 20:57:34.098866 793 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_3e019f83132e4014bc96f1473937b0aa" } modify_external_catalogs: true
I20260317 20:57:34.101162 800 catalog_manager.cc:2174] created HMS catalog entry for table [id=2d5a1b99f7ce4466b34d668d142d8e54]
I20260317 20:57:34.105176 800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 40) took 2269 ms. Trace:
I20260317 20:57:34.105270 800 rpcz_store.cc:276] 0317 20:57:31.835379 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.525071 (+1689692us) service_pool.cc:225] Handling call
0317 20:57:33.926978 (+401907us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:33.927386 (+ 408us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:34.101151 (+173765us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:34.104991 (+ 3840us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:34.105091 (+ 100us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:34.105158 (+ 67us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:34.101679 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:34.101797 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:34.102077 (+ 280us) write_op.cc:435] Acquired schema lock
0317 20:57:34.102078 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:34.102155 (+ 77us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:34.102164 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:34.102167 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:34.102357 (+ 190us) tablet.cc:700] Row locks acquired
0317 20:57:34.102359 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:34.102386 (+ 27us) write_op.cc:270] Start()
0317 20:57:34.102410 (+ 24us) write_op.cc:276] Timestamp: P: 1773781054102334 usec, L: 0
0317 20:57:34.102412 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:34.102531 (+ 119us) log.cc:844] Serialized 432 byte log entry
0317 20:57:34.104522 (+ 1991us) op_driver.cc:464] REPLICATION: finished
0317 20:57:34.104602 (+ 80us) write_op.cc:301] APPLY: starting
0317 20:57:34.104617 (+ 15us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:34.104643 (+ 26us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:34.104659 (+ 16us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:34.104727 (+ 68us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:34.104755 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:34.104761 (+ 6us) write_op.cc:312] APPLY: finished
0317 20:57:34.104808 (+ 47us) log.cc:844] Serialized 28 byte log entry
0317 20:57:34.104850 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.104863 (+ 13us) write_op.cc:454] Released schema lock
0317 20:57:34.104867 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:34.104924 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.104928 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":119061,"Hive Metastore.run_cpu_time_us":175,"Hive Metastore.run_wall_time_us":54426,"spinlock_wait_cycles":14976,"child_traces":[["op",{"apply.queue_time_us":39,"apply.run_cpu_time_us":314,"apply.run_wall_time_us":315,"num_ops":2,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":546,"prepare.run_wall_time_us":2010,"raft.queue_time_us":28,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":171,"replication_time_us":2084}]]}
I20260317 20:57:34.118647 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 46e5d823d53c465b8751f8c3cd8c09cf (DEFAULT_TABLE table=default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.118999 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e5d823d53c465b8751f8c3cd8c09cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.119475 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 46e5d823d53c465b8751f8c3cd8c09cf (DEFAULT_TABLE table=default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.119554 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 46e5d823d53c465b8751f8c3cd8c09cf (DEFAULT_TABLE table=default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.119735 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e5d823d53c465b8751f8c3cd8c09cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.119867 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e5d823d53c465b8751f8c3cd8c09cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.122196 1653 tablet_bootstrap.cc:492] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.122309 1652 tablet_bootstrap.cc:492] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.123411 1652 tablet_bootstrap.cc:654] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.123412 1653 tablet_bootstrap.cc:654] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.127664 1654 tablet_bootstrap.cc:492] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.129127 1654 tablet_bootstrap.cc:654] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.131021 1653 tablet_bootstrap.cc:492] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.131124 1653 ts_tablet_manager.cc:1403] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260317 20:57:34.131592 1653 raft_consensus.cc:359] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.131719 1653 raft_consensus.cc:385] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.131752 1653 raft_consensus.cc:740] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.132210 1653 consensus_queue.cc:260] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.132692 1653 ts_tablet_manager.cc:1434] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:34.132875 794 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_6c133cda464b48309d86571d465a0367" } modify_external_catalogs: true
I20260317 20:57:34.133014 794 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_6c133cda464b48309d86571d465a0367" } modify_external_catalogs: true
I20260317 20:57:34.133600 800 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_a26747a8e2de47f5a6f00cfc3fa59c1f" } new_table_name: "default.Table_985a38ed1c344c8386f0b656b4a5cc95" modify_external_catalogs: true
I20260317 20:57:34.140579 1313 tablet_service.cc:1511] Processing CreateTablet for tablet e5dc15804e4046fdac79204e10ed14fc (DEFAULT_TABLE table=default.table_231a8eed1e2d4957a62ed9029daf6f72 [id=2d5a1b99f7ce4466b34d668d142d8e54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.140579 1041 tablet_service.cc:1511] Processing CreateTablet for tablet e5dc15804e4046fdac79204e10ed14fc (DEFAULT_TABLE table=default.table_231a8eed1e2d4957a62ed9029daf6f72 [id=2d5a1b99f7ce4466b34d668d142d8e54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.140910 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5dc15804e4046fdac79204e10ed14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.140910 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5dc15804e4046fdac79204e10ed14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.140954 1177 tablet_service.cc:1511] Processing CreateTablet for tablet e5dc15804e4046fdac79204e10ed14fc (DEFAULT_TABLE table=default.table_231a8eed1e2d4957a62ed9029daf6f72 [id=2d5a1b99f7ce4466b34d668d142d8e54]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.141268 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5dc15804e4046fdac79204e10ed14fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.143328 1653 tablet_bootstrap.cc:492] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.144483 1653 tablet_bootstrap.cc:654] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.146250 798 catalog_manager.cc:2174] created HMS catalog entry for table [id=25284c95383d4736bd72836dbc5b8438]
I20260317 20:57:34.146448 1652 tablet_bootstrap.cc:492] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.146550 1652 ts_tablet_manager.cc:1403] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20260317 20:57:34.147061 1652 raft_consensus.cc:359] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.147195 1652 raft_consensus.cc:385] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.147229 1652 raft_consensus.cc:740] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.147356 1652 consensus_queue.cc:260] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.147631 1652 ts_tablet_manager.cc:1434] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.147855 1652 tablet_bootstrap.cc:492] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.149470 1652 tablet_bootstrap.cc:654] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.152637 798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 41) took 2274 ms. Trace:
I20260317 20:57:34.152897 1654 tablet_bootstrap.cc:492] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.153013 1654 ts_tablet_manager.cc:1403] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.001s
I20260317 20:57:34.152747 798 rpcz_store.cc:276] 0317 20:57:31.877772 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.580632 (+1702860us) service_pool.cc:225] Handling call
0317 20:57:33.927831 (+347199us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:33.928161 (+ 330us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:34.146240 (+218079us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:34.152452 (+ 6212us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:34.152539 (+ 87us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:34.152618 (+ 79us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:34.146771 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:34.146872 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:34.146876 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:34.146877 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:34.146953 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:34.146962 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:34.146965 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:34.147016 (+ 51us) tablet.cc:700] Row locks acquired
0317 20:57:34.147017 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:34.147055 (+ 38us) write_op.cc:270] Start()
0317 20:57:34.147094 (+ 39us) write_op.cc:276] Timestamp: P: 1773781054146989 usec, L: 0
0317 20:57:34.147098 (+ 4us) op_driver.cc:348] REPLICATION: starting
0317 20:57:34.147262 (+ 164us) log.cc:844] Serialized 432 byte log entry
0317 20:57:34.151089 (+ 3827us) op_driver.cc:464] REPLICATION: finished
0317 20:57:34.151997 (+ 908us) write_op.cc:301] APPLY: starting
0317 20:57:34.152017 (+ 20us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:34.152050 (+ 33us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:34.152067 (+ 17us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:34.152151 (+ 84us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:34.152183 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:34.152188 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:34.152252 (+ 64us) log.cc:844] Serialized 28 byte log entry
0317 20:57:34.152302 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.152314 (+ 12us) write_op.cc:454] Released schema lock
0317 20:57:34.152319 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:34.152378 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.152380 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":172776,"Hive Metastore.run_cpu_time_us":188,"Hive Metastore.run_wall_time_us":45082,"child_traces":[["op",{"apply.queue_time_us":846,"apply.run_cpu_time_us":381,"apply.run_wall_time_us":380,"mutex_wait_us":1570,"num_ops":2,"prepare.queue_time_us":36,"prepare.run_cpu_time_us":631,"prepare.run_wall_time_us":2458,"raft.queue_time_us":1662,"raft.run_cpu_time_us":364,"raft.run_wall_time_us":363,"replication_time_us":3964}]]}
I20260317 20:57:34.153137 1653 tablet_bootstrap.cc:492] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.153228 1653 ts_tablet_manager.cc:1403] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260317 20:57:34.153551 1654 raft_consensus.cc:359] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.153676 1654 raft_consensus.cc:385] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.153713 1654 raft_consensus.cc:740] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.153710 1653 raft_consensus.cc:359] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.153827 1653 raft_consensus.cc:385] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.153864 1653 raft_consensus.cc:740] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.153875 1654 consensus_queue.cc:260] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.154029 1653 consensus_queue.cc:260] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.154219 1654 ts_tablet_manager.cc:1434] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:34.154325 1653 ts_tablet_manager.cc:1434] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.153954 798 catalog_manager.cc:5671] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:34.159757 1652 tablet_bootstrap.cc:492] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.159881 1652 ts_tablet_manager.cc:1403] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260317 20:57:34.160413 1652 raft_consensus.cc:359] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.160521 1652 raft_consensus.cc:385] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.160553 1652 raft_consensus.cc:740] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.160691 1652 consensus_queue.cc:260] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.160996 1652 ts_tablet_manager.cc:1434] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:34.179987 1178 tablet_service.cc:1511] Processing CreateTablet for tablet d9a43741bfda4ccdb070e74b9f638766 (DEFAULT_TABLE table=default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.180150 1313 tablet_service.cc:1511] Processing CreateTablet for tablet d9a43741bfda4ccdb070e74b9f638766 (DEFAULT_TABLE table=default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.180341 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a43741bfda4ccdb070e74b9f638766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.180425 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a43741bfda4ccdb070e74b9f638766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.182685 1653 tablet_bootstrap.cc:492] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.182840 1654 tablet_bootstrap.cc:492] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.183565 1715 raft_consensus.cc:493] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.183651 1715 raft_consensus.cc:515] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.183813 1653 tablet_bootstrap.cc:654] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.183923 1654 tablet_bootstrap.cc:654] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.184080 1715 leader_election.cc:290] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:34.184466 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e5d823d53c465b8751f8c3cd8c09cf" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:34.184612 1334 raft_consensus.cc:2468] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:34.185464 1133 leader_election.cc:304] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:34.185947 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e5d823d53c465b8751f8c3cd8c09cf" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:34.186018 1041 tablet_service.cc:1511] Processing CreateTablet for tablet d9a43741bfda4ccdb070e74b9f638766 (DEFAULT_TABLE table=default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.186127 1061 raft_consensus.cc:2468] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:34.186321 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9a43741bfda4ccdb070e74b9f638766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.186313 1715 raft_consensus.cc:2804] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:34.186365 1715 raft_consensus.cc:493] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:34.186403 1715 raft_consensus.cc:3060] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.187448 1715 raft_consensus.cc:515] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.187881 1715 leader_election.cc:290] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:34.188611 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e5d823d53c465b8751f8c3cd8c09cf" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:34.188750 1334 raft_consensus.cc:3060] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.189769 1334 raft_consensus.cc:2468] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:34.190112 1652 tablet_bootstrap.cc:492] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.191316 798 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_17c2097cd322498e80bb464abfd17703" } modify_external_catalogs: true
I20260317 20:57:34.191516 1652 tablet_bootstrap.cc:654] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.191538 798 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_17c2097cd322498e80bb464abfd17703" } modify_external_catalogs: true
I20260317 20:57:34.192564 1654 tablet_bootstrap.cc:492] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.192675 1654 ts_tablet_manager.cc:1403] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260317 20:57:34.192749 1133 leader_election.cc:304] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:34.192894 1653 tablet_bootstrap.cc:492] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.192981 1653 ts_tablet_manager.cc:1403] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260317 20:57:34.193208 1654 raft_consensus.cc:359] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.193310 1654 raft_consensus.cc:385] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.193341 1654 raft_consensus.cc:740] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.193312 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46e5d823d53c465b8751f8c3cd8c09cf" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:34.193434 1061 raft_consensus.cc:3060] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.193459 1653 raft_consensus.cc:359] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.193490 1654 consensus_queue.cc:260] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.193557 1653 raft_consensus.cc:385] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.193586 1653 raft_consensus.cc:740] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.193709 1653 consensus_queue.cc:260] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.193794 1654 ts_tablet_manager.cc:1434] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.193997 1654 tablet_bootstrap.cc:492] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.193986 1653 ts_tablet_manager.cc:1434] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:34.194456 1061 raft_consensus.cc:2468] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:34.195173 1654 tablet_bootstrap.cc:654] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.195586 1715 raft_consensus.cc:2804] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:34.195701 1715 raft_consensus.cc:697] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:34.195859 1715 consensus_queue.cc:237] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.197363 1652 tablet_bootstrap.cc:492] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.197476 1652 ts_tablet_manager.cc:1403] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260317 20:57:34.198031 1652 raft_consensus.cc:359] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.198172 1652 raft_consensus.cc:385] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.198210 1652 raft_consensus.cc:740] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.198334 1652 consensus_queue.cc:260] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.198635 1652 ts_tablet_manager.cc:1434] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:34.202106 1654 tablet_bootstrap.cc:492] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.202250 1654 ts_tablet_manager.cc:1403] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:34.202885 1654 raft_consensus.cc:359] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.203027 1654 raft_consensus.cc:385] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.203076 1654 raft_consensus.cc:740] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.203233 1654 consensus_queue.cc:260] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.203609 1654 ts_tablet_manager.cc:1434] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.256652 796 catalog_manager.cc:3502] renamed table default.table_9e4d286026a74f549f1874d0f1b908de [id=06a4801fbead41c6adfb06c624d3c9ad] in HMS: new name default.table_df3d165713f44a8b87b980f60d112d34
I20260317 20:57:34.293216 791 catalog_manager.cc:2174] created HMS catalog entry for table [id=ca7b69998d7a40afbb2b2cf254ba261c]
I20260317 20:57:34.298607 791 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 47) took 1403 ms. Trace:
I20260317 20:57:34.298722 791 rpcz_store.cc:276] 0317 20:57:32.895346 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.712221 (+816875us) service_pool.cc:225] Handling call
0317 20:57:33.929470 (+217249us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:33.929792 (+ 322us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:34.293202 (+363410us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:34.298403 (+ 5201us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:34.298502 (+ 99us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:34.298584 (+ 82us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:34.293915 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:34.294059 (+ 144us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:34.294064 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:34.294065 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:34.294149 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:34.294160 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:34.294164 (+ 4us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:34.294223 (+ 59us) tablet.cc:700] Row locks acquired
0317 20:57:34.294224 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:34.294260 (+ 36us) write_op.cc:270] Start()
0317 20:57:34.294293 (+ 33us) write_op.cc:276] Timestamp: P: 1773781054294167 usec, L: 0
0317 20:57:34.294295 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:34.294466 (+ 171us) log.cc:844] Serialized 432 byte log entry
0317 20:57:34.297000 (+ 2534us) op_driver.cc:464] REPLICATION: finished
0317 20:57:34.297095 (+ 95us) write_op.cc:301] APPLY: starting
0317 20:57:34.297116 (+ 21us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:34.297157 (+ 41us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:34.297173 (+ 16us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:34.297255 (+ 82us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:34.297290 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:34.297295 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:34.297358 (+ 63us) log.cc:844] Serialized 28 byte log entry
0317 20:57:34.297409 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.297420 (+ 11us) write_op.cc:454] Released schema lock
0317 20:57:34.297425 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:34.297497 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.297500 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":326745,"Hive Metastore.run_cpu_time_us":285,"Hive Metastore.run_wall_time_us":36492,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":36,"apply.run_cpu_time_us":397,"apply.run_wall_time_us":398,"num_ops":2,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":678,"prepare.run_wall_time_us":678,"raft.queue_time_us":431,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":424,"replication_time_us":2677}]]}
I20260317 20:57:34.301587 791 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_fe83b51f353e4ece951a13044f816de5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:34.308213 1041 tablet_service.cc:1511] Processing CreateTablet for tablet aca959e916df4cedbaee283d770f82bc (DEFAULT_TABLE table=default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.308321 1313 tablet_service.cc:1511] Processing CreateTablet for tablet aca959e916df4cedbaee283d770f82bc (DEFAULT_TABLE table=default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.308578 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca959e916df4cedbaee283d770f82bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.308576 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca959e916df4cedbaee283d770f82bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.310330 1177 tablet_service.cc:1511] Processing CreateTablet for tablet aca959e916df4cedbaee283d770f82bc (DEFAULT_TABLE table=default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.310710 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aca959e916df4cedbaee283d770f82bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.310995 1653 tablet_bootstrap.cc:492] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.312058 1653 tablet_bootstrap.cc:654] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.313108 1654 tablet_bootstrap.cc:492] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.314364 1654 tablet_bootstrap.cc:654] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.315948 1654 tablet_bootstrap.cc:492] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.316047 1654 ts_tablet_manager.cc:1403] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:34.316607 1654 raft_consensus.cc:359] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.316699 1654 raft_consensus.cc:385] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.316720 1654 raft_consensus.cc:740] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.316874 1654 consensus_queue.cc:260] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.317159 1652 tablet_bootstrap.cc:492] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.317240 1654 ts_tablet_manager.cc:1434] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:34.318288 1652 tablet_bootstrap.cc:654] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
W20260317 20:57:34.320415 792 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cde2029a6fbb404892afd070c4de7abd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:34.320734 795 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_4993eb4cbf8d4cd28646b149b3c141bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:34.320912 1689 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:34.321388 1450 raft_consensus.cc:493] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.321491 1450 raft_consensus.cc:515] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.321887 1450 leader_election.cc:290] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.322430 1690 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:34.322873 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5dc15804e4046fdac79204e10ed14fc" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:34.323053 1059 raft_consensus.cc:2468] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:34.323176 1652 tablet_bootstrap.cc:492] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.323283 1652 ts_tablet_manager.cc:1403] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:34.323292 1691 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:34.323850 1652 raft_consensus.cc:359] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.323954 1652 raft_consensus.cc:385] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.323985 1652 raft_consensus.cc:740] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.323964 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5dc15804e4046fdac79204e10ed14fc" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:34.324092 1197 raft_consensus.cc:2468] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:34.324118 1652 consensus_queue.cc:260] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.324546 1652 ts_tablet_manager.cc:1434] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:34.326263 1268 leader_election.cc:304] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:34.327199 1462 raft_consensus.cc:2804] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:34.327276 1462 raft_consensus.cc:493] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:34.327318 1462 raft_consensus.cc:3060] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.354624 1653 tablet_bootstrap.cc:492] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.354786 1653 ts_tablet_manager.cc:1403] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20260317 20:57:34.355935 1653 raft_consensus.cc:359] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.356068 1653 raft_consensus.cc:385] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.356103 1653 raft_consensus.cc:740] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.356236 1653 consensus_queue.cc:260] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.356739 1653 ts_tablet_manager.cc:1434] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:34.357821 1462 raft_consensus.cc:515] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.358184 1708 raft_consensus.cc:493] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.358232 1462 leader_election.cc:290] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.358296 1708 raft_consensus.cc:515] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.358721 1708 leader_election.cc:290] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:34.359020 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5dc15804e4046fdac79204e10ed14fc" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:34.359020 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a43741bfda4ccdb070e74b9f638766" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:34.359169 1197 raft_consensus.cc:3060] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.359207 1196 raft_consensus.cc:2468] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:34.359614 995 leader_election.cc:304] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:34.360217 1197 raft_consensus.cc:2468] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:34.360543 1268 leader_election.cc:304] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:34.360627 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5dc15804e4046fdac79204e10ed14fc" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:34.360715 1450 raft_consensus.cc:2804] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:34.360738 1059 raft_consensus.cc:3060] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.360796 1450 raft_consensus.cc:697] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:34.360953 1450 consensus_queue.cc:237] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:34.361763 1059 raft_consensus.cc:2468] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:34.362396 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a43741bfda4ccdb070e74b9f638766" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:34.362531 1334 raft_consensus.cc:2468] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:34.362587 1462 raft_consensus.cc:493] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.362643 1462 raft_consensus.cc:515] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.363008 1462 leader_election.cc:290] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:34.363384 1708 raft_consensus.cc:2804] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:34.363466 1708 raft_consensus.cc:493] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:34.363518 1708 raft_consensus.cc:3060] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.364960 1708 raft_consensus.cc:515] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.365417 1708 leader_election.cc:290] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:34.365816 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a43741bfda4ccdb070e74b9f638766" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:34.365793 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a43741bfda4ccdb070e74b9f638766" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:34.365921 1334 raft_consensus.cc:3060] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.365921 1196 raft_consensus.cc:3060] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.367020 1196 raft_consensus.cc:2468] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:34.367139 1334 raft_consensus.cc:2468] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:34.367471 996 leader_election.cc:304] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:34.367791 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a43741bfda4ccdb070e74b9f638766" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:34.367978 1059 raft_consensus.cc:2393] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 630e777e97c141a69e35660f32b26f6d in current term 1: Already voted for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in this term.
I20260317 20:57:34.368261 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9a43741bfda4ccdb070e74b9f638766" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:34.368407 1197 raft_consensus.cc:2393] T d9a43741bfda4ccdb070e74b9f638766 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 630e777e97c141a69e35660f32b26f6d in current term 1: Already voted for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in this term.
I20260317 20:57:34.368636 1708 raft_consensus.cc:2804] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:34.368767 1268 leader_election.cc:304] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d; no voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:34.369050 1462 raft_consensus.cc:2749] T d9a43741bfda4ccdb070e74b9f638766 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260317 20:57:34.369288 1708 raft_consensus.cc:697] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:34.369485 1708 consensus_queue.cc:237] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:34.398981 797 catalog_manager.cc:3502] renamed table default.table_c63b594cb8ad4d4bb2d094326fff5111 [id=b4359316a03b48bcb97b2d377b1c5c93] in HMS: new name default.table_e63b5215dfe141f78d97647d4e83411d
I20260317 20:57:34.425751 792 catalog_manager.cc:2174] created HMS catalog entry for table [id=be7ee71957a44bbfbfd419246984e502]
I20260317 20:57:34.430584 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 48) took 1017 ms. Trace:
I20260317 20:57:34.430696 792 rpcz_store.cc:276] 0317 20:57:33.413228 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.928441 (+515213us) service_pool.cc:225] Handling call
0317 20:57:34.320544 (+392103us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:34.320950 (+ 406us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:34.425736 (+104786us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:34.430348 (+ 4612us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:34.430479 (+ 131us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:34.430563 (+ 84us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:34.426501 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:34.426618 (+ 117us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:34.426622 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:34.426624 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:34.426695 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:34.426706 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:34.426710 (+ 4us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:34.426769 (+ 59us) tablet.cc:700] Row locks acquired
0317 20:57:34.426770 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:34.426806 (+ 36us) write_op.cc:270] Start()
0317 20:57:34.426838 (+ 32us) write_op.cc:276] Timestamp: P: 1773781054426797 usec, L: 0
0317 20:57:34.426840 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:34.426996 (+ 156us) log.cc:844] Serialized 432 byte log entry
0317 20:57:34.429621 (+ 2625us) op_driver.cc:464] REPLICATION: finished
0317 20:57:34.429721 (+ 100us) write_op.cc:301] APPLY: starting
0317 20:57:34.429737 (+ 16us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:34.429780 (+ 43us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:34.429796 (+ 16us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:34.429875 (+ 79us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:34.429904 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:34.429908 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:34.429975 (+ 67us) log.cc:844] Serialized 28 byte log entry
0317 20:57:34.430027 (+ 52us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.430068 (+ 41us) write_op.cc:454] Released schema lock
0317 20:57:34.430073 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:34.430135 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:34.430137 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":77939,"Hive Metastore.run_cpu_time_us":303,"Hive Metastore.run_wall_time_us":26661,"child_traces":[["op",{"apply.queue_time_us":60,"apply.run_cpu_time_us":403,"apply.run_wall_time_us":402,"mutex_wait_us":25,"num_ops":2,"prepare.queue_time_us":39,"prepare.run_cpu_time_us":638,"prepare.run_wall_time_us":639,"raft.queue_time_us":116,"raft.run_cpu_time_us":595,"raft.run_wall_time_us":595,"replication_time_us":2752,"spinlock_wait_cycles":29312}]]}
I20260317 20:57:34.440109 1708 raft_consensus.cc:493] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.440254 1708 raft_consensus.cc:515] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.440685 1708 leader_election.cc:290] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:34.441030 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 1e084fc67777419fb5af7936ab89e8bf (DEFAULT_TABLE table=default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.441319 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e084fc67777419fb5af7936ab89e8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.441843 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 1e084fc67777419fb5af7936ab89e8bf (DEFAULT_TABLE table=default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.442140 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e084fc67777419fb5af7936ab89e8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.444680 1653 tablet_bootstrap.cc:492] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.445801 1653 tablet_bootstrap.cc:654] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.446682 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca959e916df4cedbaee283d770f82bc" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:34.446831 1334 raft_consensus.cc:2468] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:34.447598 996 leader_election.cc:304] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:34.448226 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca959e916df4cedbaee283d770f82bc" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:34.448379 1197 raft_consensus.cc:2468] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:34.449388 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 1e084fc67777419fb5af7936ab89e8bf (DEFAULT_TABLE table=default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.449692 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e084fc67777419fb5af7936ab89e8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.450675 1653 tablet_bootstrap.cc:492] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.450775 1653 ts_tablet_manager.cc:1403] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:34.451329 1653 raft_consensus.cc:359] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.451470 1653 raft_consensus.cc:385] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.451508 1653 raft_consensus.cc:740] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.451648 1653 consensus_queue.cc:260] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.451964 1653 ts_tablet_manager.cc:1434] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:34.452107 795 catalog_manager.cc:2174] created HMS catalog entry for table [id=29839ff707bc4e67aec781e8653ff8f6]
I20260317 20:57:34.452802 1654 tablet_bootstrap.cc:492] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.452968 796 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 46) took 2142 ms. Trace:
I20260317 20:57:34.453025 796 rpcz_store.cc:276] 0317 20:57:32.310633 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:33.697124 (+1386491us) service_pool.cc:225] Handling call
0317 20:57:33.928674 (+231550us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:34.452560 (+523886us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:34.452743 (+ 183us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:34.452948 (+ 205us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":217321,"Hive Metastore.run_cpu_time_us":528,"Hive Metastore.run_wall_time_us":110459}
I20260317 20:57:34.453899 1654 tablet_bootstrap.cc:654] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
W20260317 20:57:34.454965 791 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_fe83b51f353e4ece951a13044f816de5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:34.457144 796 master_service.cc:954] ReplaceTablet: received request to replace tablet 0df6fe0e6b844b0384809c0d52f2421b from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:34.459941 1708 raft_consensus.cc:2804] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:34.460034 1708 raft_consensus.cc:493] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:34.460083 1708 raft_consensus.cc:3060] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.460986 1565 consensus_queue.cc:1048] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.463256 1652 tablet_bootstrap.cc:492] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.464463 1652 tablet_bootstrap.cc:654] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.469377 1565 consensus_queue.cc:1048] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.475169 1708 raft_consensus.cc:515] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.475694 1708 leader_election.cc:290] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:34.476531 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca959e916df4cedbaee283d770f82bc" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:34.476692 1332 raft_consensus.cc:3060] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.476814 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aca959e916df4cedbaee283d770f82bc" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:34.476927 1197 raft_consensus.cc:3060] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.477859 1197 raft_consensus.cc:2468] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:34.477859 1332 raft_consensus.cc:2468] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:34.478359 996 leader_election.cc:304] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:34.478654 1708 raft_consensus.cc:2804] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:34.478741 1708 raft_consensus.cc:697] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:34.478700 1565 consensus_queue.cc:1048] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.478896 1708 consensus_queue.cc:237] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.479499 792 catalog_manager.cc:5671] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:34.493412 796 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 0df6fe0e6b844b0384809c0d52f2421b
I20260317 20:57:34.493816 796 catalog_manager.cc:6741] ReplaceTablet: tablet 0df6fe0e6b844b0384809c0d52f2421b deleted and replaced by tablet d5cd4964ea9d4a2aa4db0bd970b854ea
I20260317 20:57:34.506507 1462 consensus_queue.cc:1048] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.519279 792 master_service.cc:954] ReplaceTablet: received request to replace tablet 0df6fe0e6b844b0384809c0d52f2421b from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:34.519673 792 master_service.cc:954] ReplaceTablet: received request to replace tablet 487a2d92c3614dbe801d9e4d478ce9ac from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:34.521143 796 catalog_manager.cc:5671] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:34.526223 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 0df6fe0e6b844b0384809c0d52f2421b with delete_type TABLET_DATA_DELETED (replaced by tablet d5cd4964ea9d4a2aa4db0bd970b854ea) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:34.526747 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 0df6fe0e6b844b0384809c0d52f2421b with delete_type TABLET_DATA_DELETED (replaced by tablet d5cd4964ea9d4a2aa4db0bd970b854ea) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:34.527230 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 0df6fe0e6b844b0384809c0d52f2421b with delete_type TABLET_DATA_DELETED (replaced by tablet d5cd4964ea9d4a2aa4db0bd970b854ea) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:34.547899 794 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]
I20260317 20:57:34.548219 792 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 487a2d92c3614dbe801d9e4d478ce9ac
I20260317 20:57:34.549099 792 catalog_manager.cc:6741] ReplaceTablet: tablet 487a2d92c3614dbe801d9e4d478ce9ac deleted and replaced by tablet f40ecce1ad104dc5b301c1b505b2c7fd
I20260317 20:57:34.549279 792 master_service.cc:954] ReplaceTablet: received request to replace tablet b11d10f48472444bbd662af1c02c6bb9 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:34.550415 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 487a2d92c3614dbe801d9e4d478ce9ac with delete_type TABLET_DATA_DELETED (replaced by tablet f40ecce1ad104dc5b301c1b505b2c7fd) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:34.551136 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 487a2d92c3614dbe801d9e4d478ce9ac with delete_type TABLET_DATA_DELETED (replaced by tablet f40ecce1ad104dc5b301c1b505b2c7fd) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:34.551393 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 487a2d92c3614dbe801d9e4d478ce9ac with delete_type TABLET_DATA_DELETED (replaced by tablet f40ecce1ad104dc5b301c1b505b2c7fd) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:34.554806 1462 raft_consensus.cc:493] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.554962 1462 raft_consensus.cc:515] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.555423 1462 leader_election.cc:290] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.555999 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e084fc67777419fb5af7936ab89e8bf" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
W20260317 20:57:34.556648 1269 leader_election.cc:343] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:34.557240 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e084fc67777419fb5af7936ab89e8bf" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
W20260317 20:57:34.557812 1268 leader_election.cc:343] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:34.557894 1268 leader_election.cc:304] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d; no voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:34.558100 1462 raft_consensus.cc:2749] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260317 20:57:34.576189 1314 tablet_service.cc:1511] Processing CreateTablet for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (DEFAULT_TABLE table=default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.576581 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cd4964ea9d4a2aa4db0bd970b854ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.576709 1040 tablet_service.cc:1511] Processing CreateTablet for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (DEFAULT_TABLE table=default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.577044 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cd4964ea9d4a2aa4db0bd970b854ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.577191 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 6ebf9468b8a04a49ae2938fa8ea0334d (DEFAULT_TABLE table=default.table_4993eb4cbf8d4cd28646b149b3c141bb [id=29839ff707bc4e67aec781e8653ff8f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.577415 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ebf9468b8a04a49ae2938fa8ea0334d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.579418 1653 tablet_bootstrap.cc:492] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.580482 1653 tablet_bootstrap.cc:654] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.581990 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6ebf9468b8a04a49ae2938fa8ea0334d (DEFAULT_TABLE table=default.table_4993eb4cbf8d4cd28646b149b3c141bb [id=29839ff707bc4e67aec781e8653ff8f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.582336 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ebf9468b8a04a49ae2938fa8ea0334d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.585613 1449 consensus_queue.cc:1048] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.592953 1178 tablet_service.cc:1511] Processing CreateTablet for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (DEFAULT_TABLE table=default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.593402 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cd4964ea9d4a2aa4db0bd970b854ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.596686 1177 tablet_service.cc:1511] Processing CreateTablet for tablet 6ebf9468b8a04a49ae2938fa8ea0334d (DEFAULT_TABLE table=default.table_4993eb4cbf8d4cd28646b149b3c141bb [id=29839ff707bc4e67aec781e8653ff8f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.597047 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ebf9468b8a04a49ae2938fa8ea0334d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.600344 792 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet b11d10f48472444bbd662af1c02c6bb9
I20260317 20:57:34.601648 792 catalog_manager.cc:6741] ReplaceTablet: tablet b11d10f48472444bbd662af1c02c6bb9 deleted and replaced by tablet 5853e5551fa34207b252da03ce90d769
I20260317 20:57:34.601733 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet b11d10f48472444bbd662af1c02c6bb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 5853e5551fa34207b252da03ce90d769) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:34.601997 792 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_ffa8292a8cda469787b621281ed2203c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:34.604815 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet b11d10f48472444bbd662af1c02c6bb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 5853e5551fa34207b252da03ce90d769) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:34.606428 1653 tablet_bootstrap.cc:492] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.606570 1653 ts_tablet_manager.cc:1403] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20260317 20:57:34.607214 1653 raft_consensus.cc:359] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.607362 1653 raft_consensus.cc:385] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.607401 1653 raft_consensus.cc:740] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.607549 1653 consensus_queue.cc:260] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.607893 1653 ts_tablet_manager.cc:1434] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:34.608147 1653 tablet_bootstrap.cc:492] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.614162 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet b11d10f48472444bbd662af1c02c6bb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 5853e5551fa34207b252da03ce90d769) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:34.617092 1653 tablet_bootstrap.cc:654] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.623174 1654 tablet_bootstrap.cc:492] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.623306 1654 ts_tablet_manager.cc:1403] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.171s user 0.001s sys 0.001s
I20260317 20:57:34.623847 1654 raft_consensus.cc:359] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.623957 1654 raft_consensus.cc:385] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.623987 1654 raft_consensus.cc:740] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.624115 1654 consensus_queue.cc:260] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.624385 1654 ts_tablet_manager.cc:1434] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.624610 1654 tablet_bootstrap.cc:492] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.625821 1654 tablet_bootstrap.cc:654] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.627637 1785 tablet_replica.cc:333] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:34.627893 1785 raft_consensus.cc:2243] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:34.628123 1785 raft_consensus.cc:2272] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:34.634336 1784 tablet_replica.cc:333] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:34.634619 1784 raft_consensus.cc:2243] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:34.634835 1784 raft_consensus.cc:2272] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:34.635536 1784 ts_tablet_manager.cc:1916] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:34.637097 1783 tablet_replica.cc:333] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:34.637313 1783 raft_consensus.cc:2243] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:34.637636 1783 raft_consensus.cc:2272] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:34.638713 1783 ts_tablet_manager.cc:1916] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:34.641916 1314 tablet_service.cc:1511] Processing CreateTablet for tablet f40ecce1ad104dc5b301c1b505b2c7fd (DEFAULT_TABLE table=default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.643932 1785 ts_tablet_manager.cc:1916] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:34.645689 1449 consensus_queue.cc:1048] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.646497 1462 consensus_queue.cc:1048] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.647559 1654 tablet_bootstrap.cc:492] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.647677 1654 ts_tablet_manager.cc:1403] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.003s
I20260317 20:57:34.648277 1654 raft_consensus.cc:359] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.648396 1654 raft_consensus.cc:385] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.648427 1654 raft_consensus.cc:740] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.648593 1654 consensus_queue.cc:260] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.649528 1654 ts_tablet_manager.cc:1434] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260317 20:57:34.649746 1654 tablet_bootstrap.cc:492] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.651129 1654 tablet_bootstrap.cc:654] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.651481 1652 tablet_bootstrap.cc:492] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.651582 1652 ts_tablet_manager.cc:1403] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.188s user 0.002s sys 0.000s
I20260317 20:57:34.652074 1652 raft_consensus.cc:359] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.652181 1652 raft_consensus.cc:385] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.652211 1652 raft_consensus.cc:740] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.652357 1652 consensus_queue.cc:260] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.652638 1652 ts_tablet_manager.cc:1434] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.652806 1652 tablet_bootstrap.cc:492] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.653847 1652 tablet_bootstrap.cc:654] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.656353 1177 tablet_service.cc:1511] Processing CreateTablet for tablet f40ecce1ad104dc5b301c1b505b2c7fd (DEFAULT_TABLE table=default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.659138 1041 tablet_service.cc:1511] Processing CreateTablet for tablet f40ecce1ad104dc5b301c1b505b2c7fd (DEFAULT_TABLE table=default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.659544 1690 tablet.cc:1723] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:34.660367 1689 tablet.cc:1723] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:34.661814 411 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu with pid 1489
I20260317 20:57:34.664829 1565 consensus_queue.cc:1048] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.665053 1691 tablet.cc:1723] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:34.667589 1652 tablet_bootstrap.cc:492] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.667690 1652 ts_tablet_manager.cc:1403] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260317 20:57:34.667932 1653 tablet_bootstrap.cc:492] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.668009 1653 ts_tablet_manager.cc:1403] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.000s
I20260317 20:57:34.668150 1652 raft_consensus.cc:359] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.668254 1652 raft_consensus.cc:385] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.668282 1652 raft_consensus.cc:740] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.668391 1652 consensus_queue.cc:260] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.668417 1653 raft_consensus.cc:359] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.668514 1653 raft_consensus.cc:385] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.668542 1653 raft_consensus.cc:740] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.668668 1652 ts_tablet_manager.cc:1434] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.668650 1653 consensus_queue.cc:260] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.668838 1652 tablet_bootstrap.cc:492] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.668908 1653 ts_tablet_manager.cc:1434] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:34.671334 1652 tablet_bootstrap.cc:654] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.674297 1654 tablet_bootstrap.cc:492] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.674435 1654 ts_tablet_manager.cc:1403] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20260317 20:57:34.675046 1654 raft_consensus.cc:359] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.675195 1654 raft_consensus.cc:385] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.675238 1654 raft_consensus.cc:740] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.675359 1654 consensus_queue.cc:260] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.675688 1654 ts_tablet_manager.cc:1434] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:34.677870 795 catalog_manager.cc:5671] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:34.679391 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 5853e5551fa34207b252da03ce90d769 (DEFAULT_TABLE table=default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.680732 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 5853e5551fa34207b252da03ce90d769 (DEFAULT_TABLE table=default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.680843 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 5853e5551fa34207b252da03ce90d769 (DEFAULT_TABLE table=default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.683987 1652 tablet_bootstrap.cc:492] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.684100 1652 ts_tablet_manager.cc:1403] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260317 20:57:34.684628 1652 raft_consensus.cc:359] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.684746 1652 raft_consensus.cc:385] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.684783 1652 raft_consensus.cc:740] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.684903 1652 consensus_queue.cc:260] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.685175 1652 ts_tablet_manager.cc:1434] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260317 20:57:34.686785 787 connection.cc:537] client connection to 127.0.102.254:45865 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:34.686885 787 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 5 similar messages]
W20260317 20:57:34.687225 1134 connection.cc:537] client connection to 127.0.102.254:45865 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:34.687760 997 connection.cc:537] client connection to 127.0.102.254:45865 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260317 20:57:34.693930 796 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_df3d165713f44a8b87b980f60d112d34 [id=06a4801fbead41c6adfb06c624d3c9ad] alter complete (version 2)
I20260317 20:57:34.694594 796 master_service.cc:954] ReplaceTablet: received request to replace tablet 0ce5b0bca40b422892510e8667421e94 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:34.695008 797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_8cc9c66b97034de7b01437aced6119ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:34.696166 795 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_231a8eed1e2d4957a62ed9029daf6f72" } modify_external_catalogs: true
I20260317 20:57:34.696288 795 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_231a8eed1e2d4957a62ed9029daf6f72" } modify_external_catalogs: true
W20260317 20:57:34.700485 787 consensus_peers.cc:597] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 -> Peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Couldn't send request to peer 5022d9ddb45c41faa9f114e2a0a31fc3. Status: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260317 20:57:34.701819 837 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111),
I20260317 20:57:34.701967 837 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:34.704100 796 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 0ce5b0bca40b422892510e8667421e94
I20260317 20:57:34.704535 796 catalog_manager.cc:6741] ReplaceTablet: tablet 0ce5b0bca40b422892510e8667421e94 deleted and replaced by tablet 050cba485ea24b27bc08aa76440114a3
I20260317 20:57:34.704831 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ce5b0bca40b422892510e8667421e94 with delete_type TABLET_DATA_DELETED (replaced by tablet 050cba485ea24b27bc08aa76440114a3) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:34.705713 796 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]). Expected version 1 got 0
I20260317 20:57:34.709481 1312 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ce5b0bca40b422892510e8667421e94 with delete_type TABLET_DATA_DELETED (replaced by tablet 050cba485ea24b27bc08aa76440114a3) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:34.710784 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ce5b0bca40b422892510e8667421e94 with delete_type TABLET_DATA_DELETED (replaced by tablet 050cba485ea24b27bc08aa76440114a3) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:34.713189 796 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_e63b5215dfe141f78d97647d4e83411d [id=b4359316a03b48bcb97b2d377b1c5c93] alter complete (version 1)
W20260317 20:57:34.713666 796 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d5cd4964ea9d4a2aa4db0bd970b854ea consensus state has no leader
I20260317 20:57:34.714581 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40ecce1ad104dc5b301c1b505b2c7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.714685 1312 tablet_service.cc:1511] Processing CreateTablet for tablet 050cba485ea24b27bc08aa76440114a3 (DEFAULT_TABLE table=default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.714756 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5853e5551fa34207b252da03ce90d769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.715672 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 050cba485ea24b27bc08aa76440114a3 (DEFAULT_TABLE table=default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.718681 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5853e5551fa34207b252da03ce90d769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.718845 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050cba485ea24b27bc08aa76440114a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.719144 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5853e5551fa34207b252da03ce90d769. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.719231 1652 tablet_bootstrap.cc:492] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.719606 1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050cba485ea24b27bc08aa76440114a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.720338 1652 tablet_bootstrap.cc:654] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.721439 1652 tablet_bootstrap.cc:492] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.721582 1652 ts_tablet_manager.cc:1403] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:34.721976 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40ecce1ad104dc5b301c1b505b2c7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.722172 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f40ecce1ad104dc5b301c1b505b2c7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.722182 1652 raft_consensus.cc:359] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.722354 1652 raft_consensus.cc:385] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.722396 1652 raft_consensus.cc:740] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.722528 1652 consensus_queue.cc:260] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.722822 1652 ts_tablet_manager.cc:1434] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.723067 1652 tablet_bootstrap.cc:492] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.724514 1653 tablet_bootstrap.cc:492] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.725749 1653 tablet_bootstrap.cc:654] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.725797 1652 tablet_bootstrap.cc:654] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.714210 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 050cba485ea24b27bc08aa76440114a3 (DEFAULT_TABLE table=default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:34.728922 796 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]). Expected version 1 got 0
I20260317 20:57:34.731518 796 catalog_manager.cc:5671] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:34.731863 796 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]). Expected version 1 got 0
I20260317 20:57:34.735196 1653 tablet_bootstrap.cc:492] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.735322 1653 ts_tablet_manager.cc:1403] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260317 20:57:34.735889 1653 raft_consensus.cc:359] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.736037 1653 raft_consensus.cc:385] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.736076 1653 raft_consensus.cc:740] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.736223 1653 consensus_queue.cc:260] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.736545 1653 ts_tablet_manager.cc:1434] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260317 20:57:34.740203 796 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]). Expected version 1 got 0
W20260317 20:57:34.740624 796 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f40ecce1ad104dc5b301c1b505b2c7fd consensus state has no leader
I20260317 20:57:34.741797 796 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet 5853e5551fa34207b252da03ce90d769 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]). Expected version 1 got 0
W20260317 20:57:34.742259 796 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 5853e5551fa34207b252da03ce90d769 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5853e5551fa34207b252da03ce90d769 consensus state has no leader
I20260317 20:57:34.742893 1652 tablet_bootstrap.cc:492] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.742856 796 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_e904ff4d06de42e3a58e46251d6e96f4" } modify_external_catalogs: true
I20260317 20:57:34.742980 796 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_e904ff4d06de42e3a58e46251d6e96f4" } modify_external_catalogs: true
I20260317 20:57:34.743099 1652 ts_tablet_manager.cc:1403] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260317 20:57:34.743613 1652 raft_consensus.cc:359] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.743724 1652 raft_consensus.cc:385] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.743757 1652 raft_consensus.cc:740] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.743911 1652 consensus_queue.cc:260] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.744191 1652 ts_tablet_manager.cc:1434] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.752945 1450 raft_consensus.cc:493] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.753126 1450 raft_consensus.cc:515] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.753587 1450 leader_election.cc:290] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.753957 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebf9468b8a04a49ae2938fa8ea0334d" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:34.754014 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebf9468b8a04a49ae2938fa8ea0334d" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:34.754124 1059 raft_consensus.cc:2468] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:34.754159 1197 raft_consensus.cc:2468] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:34.754462 1269 leader_election.cc:304] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:34.754676 1450 raft_consensus.cc:2804] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:34.754735 1450 raft_consensus.cc:493] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:34.754807 1450 raft_consensus.cc:3060] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
W20260317 20:57:34.769507 787 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet f40ecce1ad104dc5b301c1b505b2c7fd consensus state has no leader
I20260317 20:57:34.776268 766 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111),
I20260317 20:57:34.776418 766 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:34.786453 1462 consensus_queue.cc:1048] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.792487 1806 consensus_queue.cc:1048] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.801450 1806 raft_consensus.cc:493] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.801647 1806 raft_consensus.cc:515] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.802249 1806 leader_election.cc:290] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.802748 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40ecce1ad104dc5b301c1b505b2c7fd" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:34.802932 1059 raft_consensus.cc:2468] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
W20260317 20:57:34.803164 1268 leader_election.cc:343] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: f40ecce1ad104dc5b301c1b505b2c7fd
I20260317 20:57:34.803295 1269 leader_election.cc:304] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:34.803468 1806 raft_consensus.cc:2804] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:34.803534 1806 raft_consensus.cc:493] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:34.803624 1806 raft_consensus.cc:3060] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.813730 1785 ts_tablet_manager.cc:1929] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:34.813880 1785 log.cc:1199] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/0df6fe0e6b844b0384809c0d52f2421b
I20260317 20:57:34.814252 1785 ts_tablet_manager.cc:1950] T 0df6fe0e6b844b0384809c0d52f2421b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:34.814254 1450 raft_consensus.cc:515] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.814778 1450 leader_election.cc:290] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.817082 1654 tablet_bootstrap.cc:492] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.818398 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050cba485ea24b27bc08aa76440114a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:34.818524 1654 tablet_bootstrap.cc:654] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.821259 1652 tablet_bootstrap.cc:492] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:34.821535 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebf9468b8a04a49ae2938fa8ea0334d" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:34.821660 1059 raft_consensus.cc:3060] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.822474 1652 tablet_bootstrap.cc:654] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.823258 1654 tablet_bootstrap.cc:492] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.823352 1654 ts_tablet_manager.cc:1403] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:34.823916 1654 raft_consensus.cc:359] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.824034 1654 raft_consensus.cc:385] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.824069 1654 raft_consensus.cc:740] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.825146 1785 tablet_replica.cc:333] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:34.825266 1785 raft_consensus.cc:2243] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:34.825366 1785 raft_consensus.cc:2272] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:34.825488 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 0df6fe0e6b844b0384809c0d52f2421b (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]) successfully deleted
I20260317 20:57:34.825742 1785 ts_tablet_manager.cc:1916] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:34.824203 1654 consensus_queue.cc:260] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.826293 1654 ts_tablet_manager.cc:1434] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260317 20:57:34.826310 1709 raft_consensus.cc:493] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:34.826397 1709 raft_consensus.cc:515] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.826525 1654 tablet_bootstrap.cc:492] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.826835 1709 leader_election.cc:290] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:34.824491 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ebf9468b8a04a49ae2938fa8ea0334d" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:34.826934 1197 raft_consensus.cc:3060] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.827023 793 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]
I20260317 20:57:34.828073 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853e5551fa34207b252da03ce90d769" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:34.828202 1196 raft_consensus.cc:2468] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:34.828467 995 leader_election.cc:304] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:34.828516 1654 tablet_bootstrap.cc:654] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.828627 1709 raft_consensus.cc:2804] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:34.828691 1709 raft_consensus.cc:493] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:34.828737 1709 raft_consensus.cc:3060] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
W20260317 20:57:34.829284 996 leader_election.cc:343] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 5853e5551fa34207b252da03ce90d769
I20260317 20:57:34.832659 1652 tablet_bootstrap.cc:492] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:34.832805 1652 ts_tablet_manager.cc:1403] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260317 20:57:34.832832 1654 tablet_bootstrap.cc:492] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.833030 1654 ts_tablet_manager.cc:1403] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260317 20:57:34.833390 1652 raft_consensus.cc:359] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.833527 1652 raft_consensus.cc:385] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.833572 1652 raft_consensus.cc:740] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.833704 1654 raft_consensus.cc:359] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.833930 1652 consensus_queue.cc:260] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.834008 1654 raft_consensus.cc:385] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.834213 1654 raft_consensus.cc:740] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.834626 1654 consensus_queue.cc:260] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.836506 1652 ts_tablet_manager.cc:1434] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:34.838725 1654 ts_tablet_manager.cc:1434] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20260317 20:57:34.839109 1654 tablet_bootstrap.cc:492] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:34.841607 1654 tablet_bootstrap.cc:654] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.843098 1654 tablet_bootstrap.cc:492] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:34.843221 1654 ts_tablet_manager.cc:1403] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260317 20:57:34.843839 1654 raft_consensus.cc:359] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.843958 1654 raft_consensus.cc:385] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.843986 1654 raft_consensus.cc:740] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.844144 1654 consensus_queue.cc:260] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.844441 1654 ts_tablet_manager.cc:1434] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:34.889348 1708 consensus_queue.cc:1048] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.898408 1708 consensus_queue.cc:1048] T d9a43741bfda4ccdb070e74b9f638766 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.910648 1197 raft_consensus.cc:2468] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:34.910766 1784 ts_tablet_manager.cc:1929] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:34.910835 1784 log.cc:1199] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/0df6fe0e6b844b0384809c0d52f2421b
I20260317 20:57:34.911131 1784 ts_tablet_manager.cc:1950] T 0df6fe0e6b844b0384809c0d52f2421b P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:34.911079 1806 raft_consensus.cc:515] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.911403 1059 raft_consensus.cc:2468] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:34.911620 1806 leader_election.cc:290] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:34.912644 1709 raft_consensus.cc:515] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.913127 1709 leader_election.cc:290] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:34.913552 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853e5551fa34207b252da03ce90d769" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:34.913595 1783 ts_tablet_manager.cc:1929] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:34.913688 1197 raft_consensus.cc:3060] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.913664 1268 leader_election.cc:304] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:34.914095 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40ecce1ad104dc5b301c1b505b2c7fd" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:34.914208 1196 raft_consensus.cc:3060] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.916567 1653 tablet_bootstrap.cc:492] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.913678 1783 log.cc:1199] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/0df6fe0e6b844b0384809c0d52f2421b
I20260317 20:57:34.917258 1783 ts_tablet_manager.cc:1950] T 0df6fe0e6b844b0384809c0d52f2421b P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:34.917637 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f40ecce1ad104dc5b301c1b505b2c7fd" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:34.917788 1059 raft_consensus.cc:3060] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.917908 1653 tablet_bootstrap.cc:654] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.917888 1806 raft_consensus.cc:2804] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:34.918128 1806 raft_consensus.cc:697] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:34.918298 1806 consensus_queue.cc:237] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.918629 1784 tablet_replica.cc:333] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:34.918776 1784 raft_consensus.cc:2243] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:34.918996 1784 raft_consensus.cc:2272] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:34.919436 1784 ts_tablet_manager.cc:1916] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:34.920993 1653 tablet_bootstrap.cc:492] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.921090 1653 ts_tablet_manager.cc:1403] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260317 20:57:34.921191 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 0df6fe0e6b844b0384809c0d52f2421b (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]) successfully deleted
I20260317 20:57:34.921635 1653 raft_consensus.cc:359] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.921686 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5853e5551fa34207b252da03ce90d769" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:34.921751 1653 raft_consensus.cc:385] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.921798 1653 raft_consensus.cc:740] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.921940 1653 consensus_queue.cc:260] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.922276 1653 ts_tablet_manager.cc:1434] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:34.922391 1334 raft_consensus.cc:3060] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:34.922462 1653 tablet_bootstrap.cc:492] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:34.923625 1653 tablet_bootstrap.cc:654] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:34.924933 1653 tablet_bootstrap.cc:492] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:34.925022 1653 ts_tablet_manager.cc:1403] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:34.925506 1653 raft_consensus.cc:359] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.925655 1653 raft_consensus.cc:385] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:34.925693 1653 raft_consensus.cc:740] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:34.925825 1653 consensus_queue.cc:260] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:34.926414 1653 ts_tablet_manager.cc:1434] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260317 20:57:34.934834 1709 consensus_queue.cc:1048] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:34.939193 1819 consensus_queue.cc:1048] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.000183 1819 raft_consensus.cc:493] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:35.000347 1819 raft_consensus.cc:515] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.000883 1334 raft_consensus.cc:2468] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:35.001312 1783 tablet_replica.cc:333] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.001444 1783 raft_consensus.cc:2243] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.001575 1783 raft_consensus.cc:2272] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.001570 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 0df6fe0e6b844b0384809c0d52f2421b (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]) successfully deleted
I20260317 20:57:35.001936 1819 leader_election.cc:290] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.002008 1783 ts_tablet_manager.cc:1916] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.002223 1059 raft_consensus.cc:2468] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:35.002530 1197 raft_consensus.cc:2468] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:35.002794 1785 ts_tablet_manager.cc:1929] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:35.002848 1196 raft_consensus.cc:2468] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:35.002888 1785 log.cc:1199] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/487a2d92c3614dbe801d9e4d478ce9ac
I20260317 20:57:35.003162 1785 ts_tablet_manager.cc:1950] T 487a2d92c3614dbe801d9e4d478ce9ac P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.003226 995 leader_election.cc:304] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.003473 1819 raft_consensus.cc:2804] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:35.003671 1819 raft_consensus.cc:697] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:35.003635 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cba485ea24b27bc08aa76440114a3" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:35.003773 1198 raft_consensus.cc:2468] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:35.004092 995 leader_election.cc:304] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.004438 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cba485ea24b27bc08aa76440114a3" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:35.004572 1334 raft_consensus.cc:2468] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:35.004611 1708 raft_consensus.cc:2804] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:35.004671 1708 raft_consensus.cc:493] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:35.004719 1708 raft_consensus.cc:3060] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.005117 1269 leader_election.cc:304] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.003847 1819 consensus_queue.cc:237] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.006001 1708 raft_consensus.cc:515] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.006444 1708 leader_election.cc:290] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.006846 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cba485ea24b27bc08aa76440114a3" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:35.007004 1198 raft_consensus.cc:3060] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.007354 1784 ts_tablet_manager.cc:1929] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:35.007426 1784 log.cc:1199] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/487a2d92c3614dbe801d9e4d478ce9ac
I20260317 20:57:35.007716 1784 ts_tablet_manager.cc:1950] T 487a2d92c3614dbe801d9e4d478ce9ac P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.008144 1198 raft_consensus.cc:2468] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:35.008598 995 leader_election.cc:304] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.008965 1462 raft_consensus.cc:2804] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:35.009073 1462 raft_consensus.cc:697] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:35.009097 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050cba485ea24b27bc08aa76440114a3" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:35.009209 1334 raft_consensus.cc:3060] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.009481 1819 raft_consensus.cc:2804] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:35.009634 1819 raft_consensus.cc:697] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:35.009884 1819 consensus_queue.cc:237] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.009217 1462 consensus_queue.cc:237] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.010166 800 catalog_manager.cc:3502] renamed table default.table_a26747a8e2de47f5a6f00cfc3fa59c1f [id=60e57136849e4d3f946131445d27a0c1] in HMS: new name default.table_985a38ed1c344c8386f0b656b4a5cc95
I20260317 20:57:35.020534 1785 tablet_replica.cc:333] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.020749 1785 raft_consensus.cc:2243] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.020903 1785 raft_consensus.cc:2272] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.021375 1785 ts_tablet_manager.cc:1916] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.023033 1784 tablet_replica.cc:333] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.023188 1784 raft_consensus.cc:2243] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.023303 1784 raft_consensus.cc:2272] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.023751 1784 ts_tablet_manager.cc:1916] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.023803 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 487a2d92c3614dbe801d9e4d478ce9ac (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
I20260317 20:57:35.024024 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 487a2d92c3614dbe801d9e4d478ce9ac (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
I20260317 20:57:35.024631 1783 ts_tablet_manager.cc:1929] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:35.024742 1783 log.cc:1199] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/487a2d92c3614dbe801d9e4d478ce9ac
I20260317 20:57:35.025043 1783 ts_tablet_manager.cc:1950] T 487a2d92c3614dbe801d9e4d478ce9ac P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.037199 1449 raft_consensus.cc:493] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:35.037370 1449 raft_consensus.cc:515] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.037915 1449 leader_election.cc:290] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.038791 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e084fc67777419fb5af7936ab89e8bf" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:35.038972 1059 raft_consensus.cc:2468] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:35.038949 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e084fc67777419fb5af7936ab89e8bf" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:35.039106 1332 raft_consensus.cc:2468] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:35.039726 1133 leader_election.cc:304] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:35.040341 1449 raft_consensus.cc:2804] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:35.040407 1449 raft_consensus.cc:493] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:35.040445 1449 raft_consensus.cc:3060] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.059813 1715 raft_consensus.cc:493] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:35.059962 1715 raft_consensus.cc:515] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.060457 1715 leader_election.cc:290] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.061013 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5cd4964ea9d4a2aa4db0bd970b854ea" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:35.061066 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5cd4964ea9d4a2aa4db0bd970b854ea" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:35.061154 1059 raft_consensus.cc:2468] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:35.061283 1332 raft_consensus.cc:2468] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:35.061525 1133 leader_election.cc:304] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.061765 1715 raft_consensus.cc:2804] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:35.061837 1715 raft_consensus.cc:493] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:35.061898 1715 raft_consensus.cc:3060] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.094282 1334 raft_consensus.cc:2468] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:35.095253 1783 tablet_replica.cc:333] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.095429 1783 raft_consensus.cc:2243] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.095678 1783 raft_consensus.cc:2272] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.095849 1449 raft_consensus.cc:515] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.096096 1783 ts_tablet_manager.cc:1916] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.096287 1449 leader_election.cc:290] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.097172 1785 ts_tablet_manager.cc:1929] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:35.097282 1785 log.cc:1199] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/b11d10f48472444bbd662af1c02c6bb9
I20260317 20:57:35.097328 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 487a2d92c3614dbe801d9e4d478ce9ac (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
I20260317 20:57:35.097599 1785 ts_tablet_manager.cc:1950] T b11d10f48472444bbd662af1c02c6bb9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.097677 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e084fc67777419fb5af7936ab89e8bf" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:35.097800 1059 raft_consensus.cc:3060] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.097820 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e084fc67777419fb5af7936ab89e8bf" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:35.097942 1334 raft_consensus.cc:3060] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.101189 1784 ts_tablet_manager.cc:1929] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:35.101279 1784 log.cc:1199] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/b11d10f48472444bbd662af1c02c6bb9
I20260317 20:57:35.101486 1784 ts_tablet_manager.cc:1950] T b11d10f48472444bbd662af1c02c6bb9 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.158607 1785 tablet_replica.cc:333] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.158684 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet b11d10f48472444bbd662af1c02c6bb9 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]) successfully deleted
I20260317 20:57:35.158823 1785 raft_consensus.cc:2243] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.158962 1785 raft_consensus.cc:2272] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.160207 1785 ts_tablet_manager.cc:1916] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.187831 1059 raft_consensus.cc:2468] T 1e084fc67777419fb5af7936ab89e8bf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.188504 1133 leader_election.cc:304] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.188608 1715 raft_consensus.cc:515] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.188973 1334 raft_consensus.cc:2468] T 1e084fc67777419fb5af7936ab89e8bf P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.189136 1715 leader_election.cc:290] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.189270 1715 raft_consensus.cc:2804] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:35.189363 1715 raft_consensus.cc:697] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:35.189919 1783 ts_tablet_manager.cc:1929] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:35.190114 1783 log.cc:1199] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/b11d10f48472444bbd662af1c02c6bb9
I20260317 20:57:35.190531 1783 ts_tablet_manager.cc:1950] T b11d10f48472444bbd662af1c02c6bb9 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.190761 1784 tablet_replica.cc:333] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.190927 1784 raft_consensus.cc:2243] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.189523 1715 consensus_queue.cc:237] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.190974 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet b11d10f48472444bbd662af1c02c6bb9 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]) successfully deleted
I20260317 20:57:35.191121 1784 raft_consensus.cc:2272] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.191567 1784 ts_tablet_manager.cc:1916] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.192515 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5cd4964ea9d4a2aa4db0bd970b854ea" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:35.192679 1334 raft_consensus.cc:3060] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.193028 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5cd4964ea9d4a2aa4db0bd970b854ea" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:35.193219 1059 raft_consensus.cc:3060] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.194092 1334 raft_consensus.cc:2468] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.194484 1133 leader_election.cc:304] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:35.194547 1059 raft_consensus.cc:2468] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.194710 1715 raft_consensus.cc:2804] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:35.195159 1715 raft_consensus.cc:697] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:35.195343 1715 consensus_queue.cc:237] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.198282 1785 ts_tablet_manager.cc:1929] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.198375 1785 log.cc:1199] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/0ce5b0bca40b422892510e8667421e94
I20260317 20:57:35.198660 1785 ts_tablet_manager.cc:1950] T 0ce5b0bca40b422892510e8667421e94 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.198832 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet b11d10f48472444bbd662af1c02c6bb9 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]) successfully deleted
I20260317 20:57:35.199033 1783 tablet_replica.cc:333] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.199158 1783 raft_consensus.cc:2243] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.199261 1783 raft_consensus.cc:2272] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.199635 1783 ts_tablet_manager.cc:1916] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.232640 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 0ce5b0bca40b422892510e8667421e94 (table default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]) successfully deleted
I20260317 20:57:35.253924 1784 ts_tablet_manager.cc:1929] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.254202 1784 log.cc:1199] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/0ce5b0bca40b422892510e8667421e94
I20260317 20:57:35.254602 1784 ts_tablet_manager.cc:1950] T 0ce5b0bca40b422892510e8667421e94 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.255111 1783 ts_tablet_manager.cc:1929] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.255196 1783 log.cc:1199] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/0ce5b0bca40b422892510e8667421e94
I20260317 20:57:35.255430 1783 ts_tablet_manager.cc:1950] T 0ce5b0bca40b422892510e8667421e94 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.255774 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 0ce5b0bca40b422892510e8667421e94 (table default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]) successfully deleted
I20260317 20:57:35.257547 798 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]
I20260317 20:57:35.263127 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 0ce5b0bca40b422892510e8667421e94 (table default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]) successfully deleted
I20260317 20:57:35.270813 1773 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:35.270974 1773 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:35.355369 799 catalog_manager.cc:3502] renamed table default.table_7ebd9bdc267143a699de00438360c54a [id=262f037e46644a98890abee1b764ba1e] in HMS: new name default.table_bfa0dd2ccbe04d26bb5885d568cd2393
I20260317 20:57:35.391397 1450 consensus_queue.cc:1048] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.395814 1462 consensus_queue.cc:1048] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.444573 1819 consensus_queue.cc:1048] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.448731 1708 consensus_queue.cc:1048] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.513222 1462 consensus_queue.cc:1048] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.517293 1450 consensus_queue.cc:1048] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.530123 1708 consensus_queue.cc:1048] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.535104 1708 consensus_queue.cc:1048] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.571276 791 catalog_manager.cc:2174] created HMS catalog entry for table [id=7eb5962822e84dfd9a9180115824aeb3]
I20260317 20:57:35.576552 948 catalog_manager.cc:2772] Deleting table default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee] in response to Hive Metastore notification log event 36
I20260317 20:57:35.577375 791 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 56) took 1849 ms. Trace:
I20260317 20:57:35.577461 791 rpcz_store.cc:276] 0317 20:57:33.728113 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.301486 (+573373us) service_pool.cc:225] Handling call
0317 20:57:34.455049 (+153563us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:34.455409 (+ 360us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:35.571263 (+1115854us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:35.577170 (+ 5907us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:35.577259 (+ 89us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:35.577355 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:35.572039 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:35.572135 (+ 96us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:35.572138 (+ 3us) write_op.cc:435] Acquired schema lock
0317 20:57:35.572140 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:35.572203 (+ 63us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:35.572211 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:35.572213 (+ 2us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:35.572260 (+ 47us) tablet.cc:700] Row locks acquired
0317 20:57:35.572261 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:35.572286 (+ 25us) write_op.cc:270] Start()
0317 20:57:35.572310 (+ 24us) write_op.cc:276] Timestamp: P: 1773781055572231 usec, L: 0
0317 20:57:35.572311 (+ 1us) op_driver.cc:348] REPLICATION: starting
0317 20:57:35.572436 (+ 125us) log.cc:844] Serialized 432 byte log entry
0317 20:57:35.574839 (+ 2403us) op_driver.cc:464] REPLICATION: finished
0317 20:57:35.576344 (+ 1505us) write_op.cc:301] APPLY: starting
0317 20:57:35.576364 (+ 20us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:35.576398 (+ 34us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:35.576417 (+ 19us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:35.576497 (+ 80us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:35.576529 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:35.576534 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:35.576607 (+ 73us) log.cc:844] Serialized 28 byte log entry
0317 20:57:35.577042 (+ 435us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.577058 (+ 16us) write_op.cc:454] Released schema lock
0317 20:57:35.577063 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:35.577135 (+ 72us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.577138 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":899897,"Hive Metastore.run_cpu_time_us":258,"Hive Metastore.run_wall_time_us":215793,"child_traces":[["op",{"apply.queue_time_us":1433,"apply.run_cpu_time_us":423,"apply.run_wall_time_us":795,"num_ops":2,"prepare.queue_time_us":222,"prepare.run_cpu_time_us":541,"prepare.run_wall_time_us":542,"raft.queue_time_us":338,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":222,"replication_time_us":2498,"thread_start_us":743,"threads_started":2}]]}
I20260317 20:57:35.578644 791 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]). Expected version 1 got 0
W20260317 20:57:35.579048 791 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.102.193:52439 (request call id 44) took 833 ms (client timeout 1000 ms). Trace:
W20260317 20:57:35.579119 791 rpcz_store.cc:269] 0317 20:57:34.745424 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.577872 (+832448us) service_pool.cc:225] Handling call
0317 20:57:35.579035 (+ 1163us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":326400}
W20260317 20:57:35.580094 791 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.102.194:52003 (request call id 36) took 791 ms (client timeout 1000 ms). Trace:
W20260317 20:57:35.580159 791 rpcz_store.cc:269] 0317 20:57:34.788714 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.579325 (+790611us) service_pool.cc:225] Handling call
0317 20:57:35.580082 (+ 757us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
W20260317 20:57:35.581648 791 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.102.195:55481 (request call id 39) took 790 ms (client timeout 1000 ms). Trace:
W20260317 20:57:35.581768 791 rpcz_store.cc:269] 0317 20:57:34.790982 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.580582 (+789600us) service_pool.cc:225] Handling call
0317 20:57:35.581636 (+ 1054us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260317 20:57:35.589320 1039 tablet_service.cc:1511] Processing CreateTablet for tablet bf781fd3f8a941628cbe910fdbd7fab0 (DEFAULT_TABLE table=default.table_fe83b51f353e4ece951a13044f816de5 [id=7eb5962822e84dfd9a9180115824aeb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.589676 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf781fd3f8a941628cbe910fdbd7fab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.589654 1176 tablet_service.cc:1511] Processing CreateTablet for tablet bf781fd3f8a941628cbe910fdbd7fab0 (DEFAULT_TABLE table=default.table_fe83b51f353e4ece951a13044f816de5 [id=7eb5962822e84dfd9a9180115824aeb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.589798 791 catalog_manager.cc:5671] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } }
I20260317 20:57:35.589946 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf781fd3f8a941628cbe910fdbd7fab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.590004 791 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]). Expected version 1 got 0
I20260317 20:57:35.590240 791 catalog_manager.cc:5671] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:35.590312 1312 tablet_service.cc:1511] Processing CreateTablet for tablet bf781fd3f8a941628cbe910fdbd7fab0 (DEFAULT_TABLE table=default.table_fe83b51f353e4ece951a13044f816de5 [id=7eb5962822e84dfd9a9180115824aeb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.590404 791 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet 5853e5551fa34207b252da03ce90d769 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]). Expected version 1 got 0
I20260317 20:57:35.590562 1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf781fd3f8a941628cbe910fdbd7fab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.590526 791 catalog_manager.cc:5671] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } }
I20260317 20:57:35.590948 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 050cba485ea24b27bc08aa76440114a3
I20260317 20:57:35.591600 948 catalog_manager.cc:2772] Deleting table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70] in response to Hive Metastore notification log event 37
I20260317 20:57:35.592365 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 050cba485ea24b27bc08aa76440114a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.592711 1841 tablet_bootstrap.cc:492] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:35.593007 1783 tablet_replica.cc:333] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.593159 1783 raft_consensus.cc:2243] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.593300 1783 raft_consensus.cc:2272] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.593619 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 050cba485ea24b27bc08aa76440114a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:35.593791 1842 tablet_bootstrap.cc:492] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:35.593988 1784 tablet_replica.cc:333] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.594134 1784 raft_consensus.cc:2243] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.594244 1784 raft_consensus.cc:2272] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.594308 1841 tablet_bootstrap.cc:654] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.594918 1842 tablet_bootstrap.cc:654] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.594903 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 050cba485ea24b27bc08aa76440114a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:35.594954 1784 ts_tablet_manager.cc:1916] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.595029 1843 tablet_bootstrap.cc:492] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:35.595113 1785 tablet_replica.cc:333] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.595224 1785 raft_consensus.cc:2243] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.595443 1785 raft_consensus.cc:2272] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.596037 1843 tablet_bootstrap.cc:654] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.596042 1785 ts_tablet_manager.cc:1916] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.597054 1784 ts_tablet_manager.cc:1929] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.597083 1841 tablet_bootstrap.cc:492] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:35.597114 1783 ts_tablet_manager.cc:1916] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.597139 1784 log.cc:1199] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/050cba485ea24b27bc08aa76440114a3
I20260317 20:57:35.597163 1841 ts_tablet_manager.cc:1403] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260317 20:57:35.597393 1784 ts_tablet_manager.cc:1950] T 050cba485ea24b27bc08aa76440114a3 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.597678 1841 raft_consensus.cc:359] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.597780 1841 raft_consensus.cc:385] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.597810 1841 raft_consensus.cc:740] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.598001 1841 consensus_queue.cc:260] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.598335 1785 ts_tablet_manager.cc:1929] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.598407 1785 log.cc:1199] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/050cba485ea24b27bc08aa76440114a3
I20260317 20:57:35.598640 1785 ts_tablet_manager.cc:1950] T 050cba485ea24b27bc08aa76440114a3 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.599045 1841 ts_tablet_manager.cc:1434] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:35.599354 1783 ts_tablet_manager.cc:1929] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.599428 1783 log.cc:1199] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/050cba485ea24b27bc08aa76440114a3
I20260317 20:57:35.599565 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 050cba485ea24b27bc08aa76440114a3 (table default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]) successfully deleted
I20260317 20:57:35.599948 1783 ts_tablet_manager.cc:1950] T 050cba485ea24b27bc08aa76440114a3 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.600112 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 050cba485ea24b27bc08aa76440114a3 (table default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]) successfully deleted
I20260317 20:57:35.600661 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 050cba485ea24b27bc08aa76440114a3 (table default.table_6c133cda464b48309d86571d465a0367 [id=f8b4a98c1b42468ea1e61976172fe1ee]) successfully deleted
I20260317 20:57:35.600950 1842 tablet_bootstrap.cc:492] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:35.601030 1842 ts_tablet_manager.cc:1403] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260317 20:57:35.601575 1842 raft_consensus.cc:359] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.601693 1842 raft_consensus.cc:385] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.601797 1843 tablet_bootstrap.cc:492] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:35.601894 1842 raft_consensus.cc:740] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.601886 1843 ts_tablet_manager.cc:1403] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260317 20:57:35.602109 1842 consensus_queue.cc:260] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.602430 1842 ts_tablet_manager.cc:1434] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:35.602465 1843 raft_consensus.cc:359] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.602576 1843 raft_consensus.cc:385] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.602607 1843 raft_consensus.cc:740] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.602731 1843 consensus_queue.cc:260] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.603013 1843 ts_tablet_manager.cc:1434] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:35.608448 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 5853e5551fa34207b252da03ce90d769
I20260317 20:57:35.610355 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.254:45865
--webserver_interface=127.0.102.254
--webserver_port=37411
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260317 20:57:35.611012 791 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]). Expected version 1 got 0
I20260317 20:57:35.611162 791 catalog_manager.cc:5671] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:35.611470 791 catalog_manager.cc:5671] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:35.611572 791 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]). Expected version 1 got 0
I20260317 20:57:35.613232 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 5853e5551fa34207b252da03ce90d769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:35.613283 1312 tablet_service.cc:1558] Processing DeleteTablet for tablet 5853e5551fa34207b252da03ce90d769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.613353 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 050cba485ea24b27bc08aa76440114a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:35.613499 1783 tablet_replica.cc:333] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.613646 1783 raft_consensus.cc:2243] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.613711 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet 5853e5551fa34207b252da03ce90d769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:35.613786 1783 raft_consensus.cc:2272] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.613890 1784 tablet_replica.cc:333] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.614006 1784 raft_consensus.cc:2243] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.614148 1784 raft_consensus.cc:2272] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.614547 1783 ts_tablet_manager.cc:1916] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.615942 1785 tablet_replica.cc:333] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.616101 1785 raft_consensus.cc:2243] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.616348 1785 raft_consensus.cc:2272] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.617791 1785 ts_tablet_manager.cc:1916] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.618577 1784 ts_tablet_manager.cc:1916] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.620620 1785 ts_tablet_manager.cc:1929] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.620724 1785 log.cc:1199] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/5853e5551fa34207b252da03ce90d769
I20260317 20:57:35.620726 1784 ts_tablet_manager.cc:1929] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.620792 1784 log.cc:1199] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/5853e5551fa34207b252da03ce90d769
I20260317 20:57:35.621026 1785 ts_tablet_manager.cc:1950] T 5853e5551fa34207b252da03ce90d769 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.621050 1784 ts_tablet_manager.cc:1950] T 5853e5551fa34207b252da03ce90d769 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.621876 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 5853e5551fa34207b252da03ce90d769 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]) successfully deleted
W20260317 20:57:35.622308 786 catalog_manager.cc:4969] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): delete failed for tablet 050cba485ea24b27bc08aa76440114a3 because the tablet was not found. No further retry: Not found: Tablet not found: 050cba485ea24b27bc08aa76440114a3
I20260317 20:57:35.622334 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 5853e5551fa34207b252da03ce90d769 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]) successfully deleted
I20260317 20:57:35.622465 1783 ts_tablet_manager.cc:1929] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.622567 1783 log.cc:1199] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/5853e5551fa34207b252da03ce90d769
I20260317 20:57:35.622839 1783 ts_tablet_manager.cc:1950] T 5853e5551fa34207b252da03ce90d769 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.623751 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 5853e5551fa34207b252da03ce90d769 (table default.table_3e019f83132e4014bc96f1473937b0aa [id=a845787d86674dcb8420c53e3d2c2e70]) successfully deleted
I20260317 20:57:35.625293 948 catalog_manager.cc:2772] Deleting table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9] in response to Hive Metastore notification log event 39
I20260317 20:57:35.627346 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 5853e5551fa34207b252da03ce90d769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:50668
W20260317 20:57:35.628069 785 catalog_manager.cc:4969] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): delete failed for tablet 5853e5551fa34207b252da03ce90d769 because the tablet was not found. No further retry: Not found: Tablet not found: 5853e5551fa34207b252da03ce90d769
I20260317 20:57:35.628113 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet 050cba485ea24b27bc08aa76440114a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:50668
W20260317 20:57:35.628528 785 catalog_manager.cc:4969] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): delete failed for tablet 050cba485ea24b27bc08aa76440114a3 because the tablet was not found. No further retry: Not found: Tablet not found: 050cba485ea24b27bc08aa76440114a3
I20260317 20:57:35.632004 1565 consensus_queue.cc:1048] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.637029 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet f40ecce1ad104dc5b301c1b505b2c7fd
I20260317 20:57:35.639767 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet f40ecce1ad104dc5b301c1b505b2c7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:35.640327 1312 tablet_service.cc:1558] Processing DeleteTablet for tablet f40ecce1ad104dc5b301c1b505b2c7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.640425 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 5853e5551fa34207b252da03ce90d769 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.640539 1783 tablet_replica.cc:333] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.640635 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet f40ecce1ad104dc5b301c1b505b2c7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:35.640672 1783 raft_consensus.cc:2243] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.640825 1785 tablet_replica.cc:333] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.640888 1783 raft_consensus.cc:2272] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.640913 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet 050cba485ea24b27bc08aa76440114a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.640959 1785 raft_consensus.cc:2243] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.641065 1785 raft_consensus.cc:2272] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.641367 1784 tablet_replica.cc:333] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.641510 1784 raft_consensus.cc:2243] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.641624 1784 raft_consensus.cc:2272] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.641764 791 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_395f00deaf674e7cac8e63f23538af32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:35.641868 1785 ts_tablet_manager.cc:1916] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.642761 1855 tablet.cc:1723] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:35.643095 1853 tablet.cc:1723] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:35.644544 1785 ts_tablet_manager.cc:1929] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.644611 1785 log.cc:1199] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/f40ecce1ad104dc5b301c1b505b2c7fd
I20260317 20:57:35.644865 1785 ts_tablet_manager.cc:1950] T f40ecce1ad104dc5b301c1b505b2c7fd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.645792 1784 ts_tablet_manager.cc:1916] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.647020 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
I20260317 20:57:35.647955 1784 ts_tablet_manager.cc:1929] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.648034 1784 log.cc:1199] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/f40ecce1ad104dc5b301c1b505b2c7fd
I20260317 20:57:35.648025 1783 ts_tablet_manager.cc:1916] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.648308 1784 ts_tablet_manager.cc:1950] T f40ecce1ad104dc5b301c1b505b2c7fd P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.649812 1449 consensus_queue.cc:1048] T 1e084fc67777419fb5af7936ab89e8bf P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.651248 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
I20260317 20:57:35.653723 1783 ts_tablet_manager.cc:1929] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.653802 1783 log.cc:1199] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/f40ecce1ad104dc5b301c1b505b2c7fd
I20260317 20:57:35.654093 1783 ts_tablet_manager.cc:1950] T f40ecce1ad104dc5b301c1b505b2c7fd P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.654829 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet f40ecce1ad104dc5b301c1b505b2c7fd (table default.table_17c2097cd322498e80bb464abfd17703 [id=8f5019afc57c4b86bf898f058e3bf9d9]) successfully deleted
W20260317 20:57:35.655232 786 catalog_manager.cc:4969] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet 5853e5551fa34207b252da03ce90d769 because the tablet was not found. No further retry: Not found: Tablet not found: 5853e5551fa34207b252da03ce90d769
W20260317 20:57:35.655387 786 catalog_manager.cc:4969] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet 050cba485ea24b27bc08aa76440114a3 because the tablet was not found. No further retry: Not found: Tablet not found: 050cba485ea24b27bc08aa76440114a3
I20260317 20:57:35.661337 1856 tablet.cc:1723] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:35.667594 794 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 54) took 1942 ms. Trace:
I20260317 20:57:35.667699 794 rpcz_store.cc:276] 0317 20:57:33.725319 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.126512 (+401193us) service_pool.cc:225] Handling call
0317 20:57:34.132854 (+ 6342us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x55b8f14ac554. stack: 00007fa13012bac1 00007fa13012c0b1 00007fa12fc08add 000055b8ec69937e 000055b8ec6993d1 00007fa132b771f1 00007fa132b7715f 00007fa131daad97 00007fa133d9b44d 00007fa133e60e47 00007fa131743301 00007fa13174cafb 00007fa130d890bf 00007fa130d88973 00007fa130d8b684 00007fa130d89fce
0317 20:57:34.452181 (+319327us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.667572 (+1215391us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":8070,"Hive Metastore.run_cpu_time_us":151,"Hive Metastore.run_wall_time_us":87404,"spinlock_wait_cycles":13945728}
I20260317 20:57:35.673087 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet f40ecce1ad104dc5b301c1b505b2c7fd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:60100
W20260317 20:57:35.674472 786 catalog_manager.cc:4969] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet f40ecce1ad104dc5b301c1b505b2c7fd because the tablet was not found. No further retry: Not found: Tablet not found: f40ecce1ad104dc5b301c1b505b2c7fd
I20260317 20:57:35.675770 1855 tablet.cc:1723] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260317 20:57:35.677517 792 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ffa8292a8cda469787b621281ed2203c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:35.677703 793 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 52) took 1952 ms. Trace:
I20260317 20:57:35.677769 793 rpcz_store.cc:276] 0317 20:57:33.725254 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.098625 (+373371us) service_pool.cc:225] Handling call
0317 20:57:34.452136 (+353511us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.677688 (+1225552us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":95510,"Hive Metastore.run_cpu_time_us":153,"Hive Metastore.run_wall_time_us":278344}
I20260317 20:57:35.678160 798 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 55) took 1952 ms. Trace:
I20260317 20:57:35.678216 798 rpcz_store.cc:276] 0317 20:57:33.725351 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.191231 (+465880us) service_pool.cc:225] Handling call
0317 20:57:34.452448 (+261217us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.678148 (+1225700us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":557499,"Hive Metastore.run_cpu_time_us":243,"Hive Metastore.run_wall_time_us":247489}
I20260317 20:57:35.678956 793 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_c10d78c7d64942d2b7eca1757de7f68b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:35.679456 799 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 51) took 1954 ms. Trace:
W20260317 20:57:35.679486 791 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_395f00deaf674e7cac8e63f23538af32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:35.679512 799 rpcz_store.cc:276] 0317 20:57:33.725215 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.092046 (+366831us) service_pool.cc:225] Handling call
0317 20:57:34.454536 (+362490us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.679150 (+1224614us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.679301 (+ 151us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:35.679442 (+ 141us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":802887,"Hive Metastore.run_cpu_time_us":625,"Hive Metastore.run_wall_time_us":97785}
I20260317 20:57:35.679790 799 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_b832fcb92ce7484c9bf70cdd65f3a109" } new_table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" modify_external_catalogs: true
W20260317 20:57:35.677517 797 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8cc9c66b97034de7b01437aced6119ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:35.680464 1856 tablet.cc:1723] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:35.681252 798 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_d75875b48ed64da7a376b2b012ffe68c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:35.681332 800 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 53) took 1956 ms. Trace:
I20260317 20:57:35.681419 794 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1] alter complete (version 1)
I20260317 20:57:35.681372 800 rpcz_store.cc:276] 0317 20:57:33.725288 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.125527 (+400239us) service_pool.cc:225] Handling call
0317 20:57:34.133579 (+ 8052us) spinlock_profiling.cc:243] Waited 7.85 ms on lock 0x55b8f14ac554. stack: 00007fa13012bac1 00007fa13012c0b1 00007fa12fc08add 000055b8ec69937e 000055b8ec6993d1 00007fa132b771f1 00007fa132b7715f 00007fa131daad97 00007fa133d9b44d 00007fa133e6118d 00007fa131743409 00007fa13174d1d9 00007fa130d890bf 00007fa130d88973 00007fa130d8b684 00007fa130d89fce
0317 20:57:34.452295 (+318716us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.679191 (+1226896us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.681129 (+ 1938us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:35.681323 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":373732,"Hive Metastore.run_cpu_time_us":724,"Hive Metastore.run_wall_time_us":183803,"spinlock_wait_cycles":18063104}
I20260317 20:57:35.681648 800 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_ac887ad780da4e9396fee8f025bfd410"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:35.682185 1853 tablet.cc:1723] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:35.681952 794 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_0ac761fd53a0407da10c160875b08eb2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:35.687870 1565 raft_consensus.cc:493] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:35.687999 1565 raft_consensus.cc:515] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.688427 1565 leader_election.cc:290] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.689954 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf781fd3f8a941628cbe910fdbd7fab0" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:35.690146 1334 raft_consensus.cc:2468] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:35.690135 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf781fd3f8a941628cbe910fdbd7fab0" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:35.690267 1059 raft_consensus.cc:2468] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:35.690774 1133 leader_election.cc:304] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.690981 1565 raft_consensus.cc:2804] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:35.691047 1565 raft_consensus.cc:493] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:35.691094 1565 raft_consensus.cc:3060] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.691823 1715 consensus_queue.cc:1048] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.692353 1565 raft_consensus.cc:515] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.693252 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf781fd3f8a941628cbe910fdbd7fab0" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:35.693400 1332 raft_consensus.cc:3060] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.693728 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf781fd3f8a941628cbe910fdbd7fab0" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:35.693883 1059 raft_consensus.cc:3060] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.694669 1332 raft_consensus.cc:2468] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.694962 1059 raft_consensus.cc:2468] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.696017 1133 leader_election.cc:304] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:35.692736 1565 leader_election.cc:290] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.696264 1715 raft_consensus.cc:2804] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:35.696429 1715 raft_consensus.cc:697] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:35.696576 1715 consensus_queue.cc:237] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.711458 1565 consensus_queue.cc:1048] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:35.742074 796 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_e904ff4d06de42e3a58e46251d6e96f4 [id=59b6b39367414d8ea603015a4042a8a6]
I20260317 20:57:35.777305 795 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_231a8eed1e2d4957a62ed9029daf6f72 [id=2d5a1b99f7ce4466b34d668d142d8e54]
I20260317 20:57:35.798432 792 catalog_manager.cc:2174] created HMS catalog entry for table [id=d0dc2033a1814ff399f25e0d0f567c62]
I20260317 20:57:35.802982 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 61) took 1906 ms. Trace:
I20260317 20:57:35.803074 792 rpcz_store.cc:276] 0317 20:57:33.896067 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.601849 (+705782us) service_pool.cc:225] Handling call
0317 20:57:35.677621 (+1075772us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:35.678006 (+ 385us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:35.798418 (+120412us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:35.802776 (+ 4358us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:35.802876 (+ 100us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:35.802965 (+ 89us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:35.799058 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:35.799169 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:35.799173 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:35.799175 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:35.799244 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:35.799255 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:35.799258 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:35.799313 (+ 55us) tablet.cc:700] Row locks acquired
0317 20:57:35.799315 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:35.799345 (+ 30us) write_op.cc:270] Start()
0317 20:57:35.799372 (+ 27us) write_op.cc:276] Timestamp: P: 1773781055799242 usec, L: 0
0317 20:57:35.799374 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:35.799527 (+ 153us) log.cc:844] Serialized 432 byte log entry
0317 20:57:35.802201 (+ 2674us) op_driver.cc:464] REPLICATION: finished
0317 20:57:35.802331 (+ 130us) write_op.cc:301] APPLY: starting
0317 20:57:35.802347 (+ 16us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:35.802378 (+ 31us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:35.802393 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:35.802469 (+ 76us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:35.802497 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:35.802501 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:35.802555 (+ 54us) log.cc:844] Serialized 28 byte log entry
0317 20:57:35.802616 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.802627 (+ 11us) write_op.cc:454] Released schema lock
0317 20:57:35.802632 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:35.802692 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.802698 (+ 6us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":99194,"Hive Metastore.run_cpu_time_us":268,"Hive Metastore.run_wall_time_us":21007,"spinlock_wait_cycles":14592,"child_traces":[["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":352,"apply.run_wall_time_us":352,"num_ops":2,"prepare.queue_time_us":54,"prepare.run_cpu_time_us":589,"prepare.run_wall_time_us":590,"raft.queue_time_us":353,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":202,"replication_time_us":2795}]]}
W20260317 20:57:35.807318 1848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:35.807652 1848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:35.807711 1848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:35.812659 1848 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:35.812752 1848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:35.812783 1848 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:35.812815 1848 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:35.814780 792 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_bfa0dd2ccbe04d26bb5885d568cd2393 [id=262f037e46644a98890abee1b764ba1e] alter complete (version 2)
I20260317 20:57:35.816987 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.817216 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.817328 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9f29b8296b4ea5aa599f4414efb6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.817463 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9f29b8296b4ea5aa599f4414efb6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.818306 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.818579 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9f29b8296b4ea5aa599f4414efb6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.818886 1848 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.254:45865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.102.254
--webserver_port=37411
--never_fsync=true
--heap_profile_path=/tmp/kudu.1848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:35.820348 1848 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:35.820886 1843 tablet_bootstrap.cc:492] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:35.820972 1841 tablet_bootstrap.cc:492] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:35.822067 1843 tablet_bootstrap.cc:654] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.822129 1841 tablet_bootstrap.cc:654] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.822837 792 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]). Expected version 1 got 0
I20260317 20:57:35.823065 1842 tablet_bootstrap.cc:492] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:35.823000 792 catalog_manager.cc:5671] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:35.823637 1848 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20260317 20:57:35.824162 1842 tablet_bootstrap.cc:654] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.824851 1843 tablet_bootstrap.cc:492] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:35.824954 1843 ts_tablet_manager.cc:1403] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:35.825485 1843 raft_consensus.cc:359] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.826022 1843 raft_consensus.cc:385] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.826082 1843 raft_consensus.cc:740] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.826215 1843 consensus_queue.cc:260] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.826612 1843 ts_tablet_manager.cc:1434] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260317 20:57:35.833300 792 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]). Expected version 1 got 0
I20260317 20:57:35.833879 1842 tablet_bootstrap.cc:492] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:35.833986 1842 ts_tablet_manager.cc:1403] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260317 20:57:35.834498 792 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951]). Expected version 1 got 0
I20260317 20:57:35.834992 792 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_e0a1ab3af8974191818e51a5608c5724"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:35.835264 1842 raft_consensus.cc:359] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.835376 1842 raft_consensus.cc:385] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.835415 1842 raft_consensus.cc:740] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.835863 1842 consensus_queue.cc:260] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
W20260317 20:57:35.836730 1872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:35.838419 1842 ts_tablet_manager.cc:1434] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
W20260317 20:57:35.838477 1874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:35.840703 1565 raft_consensus.cc:493] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:35.840838 1565 raft_consensus.cc:515] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.841282 1565 leader_election.cc:290] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.841660 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9f29b8296b4ea5aa599f4414efb6c9" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:35.841796 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9f29b8296b4ea5aa599f4414efb6c9" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:35.841924 1334 raft_consensus.cc:2468] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
W20260317 20:57:35.842532 1133 leader_election.cc:343] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:35.842760 1133 leader_election.cc:304] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters: 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:35.842936 1841 tablet_bootstrap.cc:492] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:35.843026 1565 raft_consensus.cc:2804] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:35.843042 1841 ts_tablet_manager.cc:1403] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20260317 20:57:35.843078 1565 raft_consensus.cc:493] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:35.843119 1565 raft_consensus.cc:3060] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.843567 1841 raft_consensus.cc:359] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.843678 1841 raft_consensus.cc:385] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.843709 1841 raft_consensus.cc:740] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.843847 1841 consensus_queue.cc:260] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.844153 1841 ts_tablet_manager.cc:1434] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:35.844206 1565 raft_consensus.cc:515] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.844645 1565 leader_election.cc:290] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.844954 791 catalog_manager.cc:2174] created HMS catalog entry for table [id=1b93f2aee69044b2b3252d17d5e4fab4]
I20260317 20:57:35.846946 1848 server_base.cc:1060] running on GCE node
I20260317 20:57:35.849284 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9f29b8296b4ea5aa599f4414efb6c9" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:35.849462 1334 raft_consensus.cc:3060] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
W20260317 20:57:35.850376 1871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:35.850433 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9f29b8296b4ea5aa599f4414efb6c9" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:35.850582 1059 raft_consensus.cc:3060] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.851392 1848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:35.851557 948 catalog_manager.cc:2772] Deleting table default.table_e904ff4d06de42e3a58e46251d6e96f4 [id=59b6b39367414d8ea603015a4042a8a6] in response to Hive Metastore notification log event 42
I20260317 20:57:35.851800 1059 raft_consensus.cc:2468] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.853242 1848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:35.856019 791 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 66) took 1639 ms. Trace:
I20260317 20:57:35.856094 791 rpcz_store.cc:276] 0317 20:57:34.216586 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.639593 (+1423007us) service_pool.cc:225] Handling call
0317 20:57:35.679546 (+ 39953us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:35.679878 (+ 332us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:35.844943 (+165065us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:35.855820 (+ 10877us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:35.855922 (+ 102us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:35.856001 (+ 79us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:35.845726 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:35.845853 (+ 127us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:35.845860 (+ 7us) write_op.cc:435] Acquired schema lock
0317 20:57:35.845863 (+ 3us) tablet.cc:661] Decoding operations
0317 20:57:35.845955 (+ 92us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:35.845965 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:35.845968 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:35.846027 (+ 59us) tablet.cc:700] Row locks acquired
0317 20:57:35.846030 (+ 3us) write_op.cc:260] PREPARE: finished
0317 20:57:35.846105 (+ 75us) write_op.cc:270] Start()
0317 20:57:35.846158 (+ 53us) write_op.cc:276] Timestamp: P: 1773781055845992 usec, L: 0
0317 20:57:35.846160 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:35.846307 (+ 147us) log.cc:844] Serialized 433 byte log entry
0317 20:57:35.855175 (+ 8868us) op_driver.cc:464] REPLICATION: finished
0317 20:57:35.855419 (+ 244us) write_op.cc:301] APPLY: starting
0317 20:57:35.855434 (+ 15us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:35.855459 (+ 25us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:35.855474 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:35.855544 (+ 70us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:35.855569 (+ 25us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:35.855574 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:35.855623 (+ 49us) log.cc:844] Serialized 29 byte log entry
0317 20:57:35.855680 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.855690 (+ 10us) write_op.cc:454] Released schema lock
0317 20:57:35.855695 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:35.855752 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.855754 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":118406,"Hive Metastore.run_cpu_time_us":243,"Hive Metastore.run_wall_time_us":46467,"child_traces":[["op",{"apply.queue_time_us":203,"apply.run_cpu_time_us":323,"apply.run_wall_time_us":323,"num_ops":2,"prepare.queue_time_us":346,"prepare.run_cpu_time_us":656,"prepare.run_wall_time_us":656,"raft.queue_time_us":1079,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":196,"replication_time_us":8989}]]}
I20260317 20:57:35.859967 1133 leader_election.cc:304] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.860481 1449 raft_consensus.cc:2804] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:35.860602 1449 raft_consensus.cc:697] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:35.860759 1449 consensus_queue.cc:237] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.863585 1334 raft_consensus.cc:2468] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.866374 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet a80fa082afee4c3b93bbe757b61cb3ee
I20260317 20:57:35.867712 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet a80fa082afee4c3b93bbe757b61cb3ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:35.867736 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet a80fa082afee4c3b93bbe757b61cb3ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.867961 1783 tablet_replica.cc:333] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.868000 1785 tablet_replica.cc:333] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.868050 948 catalog_manager.cc:2772] Deleting table default.table_231a8eed1e2d4957a62ed9029daf6f72 [id=2d5a1b99f7ce4466b34d668d142d8e54] in response to Hive Metastore notification log event 43
I20260317 20:57:35.868153 1785 raft_consensus.cc:2243] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.868423 1785 raft_consensus.cc:2272] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.868927 1785 ts_tablet_manager.cc:1916] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.869056 1783 raft_consensus.cc:2243] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.869194 1783 raft_consensus.cc:2272] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.869585 1783 ts_tablet_manager.cc:1916] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.871446 1785 ts_tablet_manager.cc:1929] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.871533 1785 log.cc:1199] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/a80fa082afee4c3b93bbe757b61cb3ee
I20260317 20:57:35.871809 1785 ts_tablet_manager.cc:1950] T a80fa082afee4c3b93bbe757b61cb3ee P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.872341 1783 ts_tablet_manager.cc:1929] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.872418 1783 log.cc:1199] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/a80fa082afee4c3b93bbe757b61cb3ee
I20260317 20:57:35.872705 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet a80fa082afee4c3b93bbe757b61cb3ee (table default.table_e904ff4d06de42e3a58e46251d6e96f4 [id=59b6b39367414d8ea603015a4042a8a6]) successfully deleted
I20260317 20:57:35.873546 1848 hybrid_clock.cc:648] HybridClock initialized: now 1773781055873433 us; error 123 us; skew 500 ppm
I20260317 20:57:35.873683 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet a80fa082afee4c3b93bbe757b61cb3ee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:35.873891 1784 tablet_replica.cc:333] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.874074 1784 raft_consensus.cc:2243] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.874209 1784 raft_consensus.cc:2272] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.874652 1784 ts_tablet_manager.cc:1916] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.877002 1848 webserver.cc:492] Webserver started at http://127.0.102.254:37411/ using document root <none> and password file <none>
I20260317 20:57:35.877064 1784 ts_tablet_manager.cc:1929] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.877139 1784 log.cc:1199] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/a80fa082afee4c3b93bbe757b61cb3ee
I20260317 20:57:35.877381 1784 ts_tablet_manager.cc:1950] T a80fa082afee4c3b93bbe757b61cb3ee P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.877795 1848 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:35.877868 1848 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:35.878961 791 catalog_manager.cc:5671] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:35.880228 1041 tablet_service.cc:1511] Processing CreateTablet for tablet f8ed352c406f49138e48fffa6b14a5d2 (DEFAULT_TABLE table=default.table_395f00deaf674e7cac8e63f23538af32 [id=1b93f2aee69044b2b3252d17d5e4fab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.880263 1314 tablet_service.cc:1511] Processing CreateTablet for tablet f8ed352c406f49138e48fffa6b14a5d2 (DEFAULT_TABLE table=default.table_395f00deaf674e7cac8e63f23538af32 [id=1b93f2aee69044b2b3252d17d5e4fab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.880551 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ed352c406f49138e48fffa6b14a5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.880565 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ed352c406f49138e48fffa6b14a5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.882740 1842 tablet_bootstrap.cc:492] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:35.883684 1841 tablet_bootstrap.cc:492] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:35.883927 1842 tablet_bootstrap.cc:654] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.883991 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet a80fa082afee4c3b93bbe757b61cb3ee (table default.table_e904ff4d06de42e3a58e46251d6e96f4 [id=59b6b39367414d8ea603015a4042a8a6]) successfully deleted
I20260317 20:57:35.884778 1841 tablet_bootstrap.cc:654] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.884932 1176 tablet_service.cc:1511] Processing CreateTablet for tablet f8ed352c406f49138e48fffa6b14a5d2 (DEFAULT_TABLE table=default.table_395f00deaf674e7cac8e63f23538af32 [id=1b93f2aee69044b2b3252d17d5e4fab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.885236 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ed352c406f49138e48fffa6b14a5d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.886154 1783 ts_tablet_manager.cc:1950] T a80fa082afee4c3b93bbe757b61cb3ee P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.886962 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet a80fa082afee4c3b93bbe757b61cb3ee (table default.table_e904ff4d06de42e3a58e46251d6e96f4 [id=59b6b39367414d8ea603015a4042a8a6]) successfully deleted
I20260317 20:57:35.887866 1843 tablet_bootstrap.cc:492] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:35.888387 1842 tablet_bootstrap.cc:492] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:35.888481 1842 ts_tablet_manager.cc:1403] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:35.889004 1843 tablet_bootstrap.cc:654] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.889079 1842 raft_consensus.cc:359] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.889205 1842 raft_consensus.cc:385] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.889235 1842 raft_consensus.cc:740] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.889384 1842 consensus_queue.cc:260] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.892277 1842 ts_tablet_manager.cc:1434] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:35.895104 1848 fs_manager.cc:714] Time spent opening directory manager: real 0.016s user 0.004s sys 0.000s
I20260317 20:57:35.897020 791 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_e410d42be96e4ac58f16d30d662b4ad4" } new_table_name: "default.Table_70c346e7110644f2b3b5b4bec1789d4a" modify_external_catalogs: true
I20260317 20:57:35.900907 1462 raft_consensus.cc:493] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:35.901033 1462 raft_consensus.cc:515] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.901396 1462 leader_election.cc:290] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:35.901883 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ed352c406f49138e48fffa6b14a5d2" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:35.902596 797 catalog_manager.cc:2174] created HMS catalog entry for table [id=8fec849379024c37a2926b6f0f2dfe4b]
W20260317 20:57:35.903021 1268 leader_election.cc:343] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:35.903230 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ed352c406f49138e48fffa6b14a5d2" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:35.903484 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet e5dc15804e4046fdac79204e10ed14fc
W20260317 20:57:35.903683 1269 leader_election.cc:343] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:35.903754 1269 leader_election.cc:304] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d; no voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:35.903959 1841 tablet_bootstrap.cc:492] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:35.903973 1462 raft_consensus.cc:2749] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260317 20:57:35.904060 1841 ts_tablet_manager.cc:1403] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260317 20:57:35.904942 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet e5dc15804e4046fdac79204e10ed14fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:35.905025 1841 raft_consensus.cc:359] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.905145 1841 raft_consensus.cc:385] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.905175 1841 raft_consensus.cc:740] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.905294 1841 consensus_queue.cc:260] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.905354 1784 tablet_replica.cc:333] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.905503 1784 raft_consensus.cc:2243] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.905611 1784 raft_consensus.cc:2272] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.905612 1841 ts_tablet_manager.cc:1434] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:35.905860 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet e5dc15804e4046fdac79204e10ed14fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:35.906061 1784 ts_tablet_manager.cc:1916] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.906623 1785 tablet_replica.cc:333] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.906759 1785 raft_consensus.cc:2243] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.906862 1785 raft_consensus.cc:2272] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.907229 1785 ts_tablet_manager.cc:1916] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.908393 1784 ts_tablet_manager.cc:1929] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.908463 1784 log.cc:1199] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/e5dc15804e4046fdac79204e10ed14fc
I20260317 20:57:35.908726 1784 ts_tablet_manager.cc:1950] T e5dc15804e4046fdac79204e10ed14fc P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.909440 1785 ts_tablet_manager.cc:1929] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.909507 1785 log.cc:1199] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/e5dc15804e4046fdac79204e10ed14fc
I20260317 20:57:35.909495 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet e5dc15804e4046fdac79204e10ed14fc (table default.table_231a8eed1e2d4957a62ed9029daf6f72 [id=2d5a1b99f7ce4466b34d668d142d8e54]) successfully deleted
I20260317 20:57:35.909773 1785 ts_tablet_manager.cc:1950] T e5dc15804e4046fdac79204e10ed14fc P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.910810 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet e5dc15804e4046fdac79204e10ed14fc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:35 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.910990 1783 tablet_replica.cc:333] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.911108 1783 raft_consensus.cc:2243] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.911303 1783 raft_consensus.cc:2272] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.911713 1783 ts_tablet_manager.cc:1916] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.913439 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet e5dc15804e4046fdac79204e10ed14fc (table default.table_231a8eed1e2d4957a62ed9029daf6f72 [id=2d5a1b99f7ce4466b34d668d142d8e54]) successfully deleted
I20260317 20:57:35.914093 1783 ts_tablet_manager.cc:1929] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.914173 1783 log.cc:1199] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/e5dc15804e4046fdac79204e10ed14fc
I20260317 20:57:35.914407 1783 ts_tablet_manager.cc:1950] T e5dc15804e4046fdac79204e10ed14fc P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.914621 1843 tablet_bootstrap.cc:492] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:35.914738 1843 ts_tablet_manager.cc:1403] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.002s
I20260317 20:57:35.915051 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet e5dc15804e4046fdac79204e10ed14fc (table default.table_231a8eed1e2d4957a62ed9029daf6f72 [id=2d5a1b99f7ce4466b34d668d142d8e54]) successfully deleted
I20260317 20:57:35.915241 1843 raft_consensus.cc:359] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.915364 1843 raft_consensus.cc:385] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.915395 1843 raft_consensus.cc:740] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.915529 1843 consensus_queue.cc:260] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.917196 1843 ts_tablet_manager.cc:1434] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260317 20:57:35.918684 1888 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:35.918740 797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 63) took 1821 ms. Trace:
I20260317 20:57:35.918817 797 rpcz_store.cc:276] 0317 20:57:34.097338 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.694925 (+597587us) service_pool.cc:225] Handling call
0317 20:57:35.680556 (+985631us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:35.680880 (+ 324us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:35.902588 (+221708us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:35.918484 (+ 15896us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:35.918630 (+ 146us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:35.918721 (+ 91us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:35.910891 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:35.911026 (+ 135us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:35.911031 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:35.911032 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:35.911102 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:35.911111 (+ 9us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:35.911116 (+ 5us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:35.911176 (+ 60us) tablet.cc:700] Row locks acquired
0317 20:57:35.911178 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:35.911208 (+ 30us) write_op.cc:270] Start()
0317 20:57:35.911234 (+ 26us) write_op.cc:276] Timestamp: P: 1773781055911084 usec, L: 0
0317 20:57:35.911236 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:35.911390 (+ 154us) log.cc:844] Serialized 433 byte log entry
0317 20:57:35.917576 (+ 6186us) op_driver.cc:464] REPLICATION: finished
0317 20:57:35.917687 (+ 111us) write_op.cc:301] APPLY: starting
0317 20:57:35.917705 (+ 18us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:35.917740 (+ 35us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:35.917754 (+ 14us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:35.917845 (+ 91us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:35.917876 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:35.917895 (+ 19us) write_op.cc:312] APPLY: finished
0317 20:57:35.917961 (+ 66us) log.cc:844] Serialized 29 byte log entry
0317 20:57:35.918021 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.918058 (+ 37us) write_op.cc:454] Released schema lock
0317 20:57:35.918063 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:35.918127 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.918129 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":170049,"Hive Metastore.run_cpu_time_us":210,"Hive Metastore.run_wall_time_us":51494,"spinlock_wait_cycles":3968,"child_traces":[["op",{"apply.queue_time_us":72,"apply.run_cpu_time_us":426,"apply.run_wall_time_us":426,"num_ops":2,"prepare.queue_time_us":7837,"prepare.run_cpu_time_us":593,"prepare.run_wall_time_us":593,"raft.queue_time_us":1352,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"replication_time_us":6311}]]}
I20260317 20:57:35.920202 1848 fs_manager.cc:730] Time spent opening block manager: real 0.024s user 0.003s sys 0.000s
I20260317 20:57:35.920354 1848 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:35.920831 1853 tablet.cc:1723] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:35.920898 1848 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260317 20:57:35.922757 793 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c10d78c7d64942d2b7eca1757de7f68b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:35.923635 1856 tablet.cc:1723] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:35.925457 1855 tablet.cc:1723] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:35.933691 1041 tablet_service.cc:1511] Processing CreateTablet for tablet e58ac81836d94bae906e753352c28ff7 (DEFAULT_TABLE table=default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.934072 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58ac81836d94bae906e753352c28ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.934290 1314 tablet_service.cc:1511] Processing CreateTablet for tablet e58ac81836d94bae906e753352c28ff7 (DEFAULT_TABLE table=default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.934540 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58ac81836d94bae906e753352c28ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.934580 797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_a9891e641d7144228ae4fa567a20f67d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:35.936378 1841 tablet_bootstrap.cc:492] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:35.936582 1176 tablet_service.cc:1511] Processing CreateTablet for tablet e58ac81836d94bae906e753352c28ff7 (DEFAULT_TABLE table=default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.936863 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58ac81836d94bae906e753352c28ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.937480 1841 tablet_bootstrap.cc:654] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.938947 1843 tablet_bootstrap.cc:492] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:35.939365 1842 tablet_bootstrap.cc:492] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:35.940019 1843 tablet_bootstrap.cc:654] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.940531 1842 tablet_bootstrap.cc:654] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.941263 1843 tablet_bootstrap.cc:492] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:35.941354 1843 ts_tablet_manager.cc:1403] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260317 20:57:35.941850 1843 raft_consensus.cc:359] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.941987 1843 raft_consensus.cc:385] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.942023 1843 raft_consensus.cc:740] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.942190 1843 consensus_queue.cc:260] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.942497 1843 ts_tablet_manager.cc:1434] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:35.944247 1842 tablet_bootstrap.cc:492] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:35.944357 1842 ts_tablet_manager.cc:1403] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260317 20:57:35.944860 1842 raft_consensus.cc:359] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.944967 1842 raft_consensus.cc:385] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.944993 1842 raft_consensus.cc:740] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.945101 1842 consensus_queue.cc:260] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.945353 1842 ts_tablet_manager.cc:1434] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:35.947415 796 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 65) took 1814 ms. Trace:
I20260317 20:57:35.947500 796 rpcz_store.cc:276] 0317 20:57:34.133391 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.742790 (+609399us) service_pool.cc:225] Handling call
0317 20:57:35.677238 (+934448us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.947397 (+270159us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":29,"Hive Metastore.run_cpu_time_us":171,"Hive Metastore.run_wall_time_us":64479}
W20260317 20:57:35.947624 800 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_ac887ad780da4e9396fee8f025bfd410 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:35.947824 794 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0ac761fd53a0407da10c160875b08eb2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:35.947624 798 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d75875b48ed64da7a376b2b012ffe68c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:35.948339 795 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 64) took 1815 ms. Trace:
I20260317 20:57:35.948863 795 rpcz_store.cc:276] 0317 20:57:34.133311 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:34.696103 (+562792us) service_pool.cc:225] Handling call
0317 20:57:35.677544 (+981441us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:35.948325 (+270781us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":64277,"Hive Metastore.run_cpu_time_us":211,"Hive Metastore.run_wall_time_us":35324}
I20260317 20:57:35.949360 796 master_service.cc:954] ReplaceTablet: received request to replace tablet 0ce5b0bca40b422892510e8667421e94 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:35.949596 796 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 75) took 1247 ms. Trace:
I20260317 20:57:35.949640 796 rpcz_store.cc:276] 0317 20:57:34.702248 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.949338 (+1247090us) service_pool.cc:225] Handling call
0317 20:57:35.949587 (+ 249us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260317 20:57:35.949774 796 master_service.cc:954] ReplaceTablet: received request to replace tablet e5dc15804e4046fdac79204e10ed14fc from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:35.949873 795 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_a4bf6942f68c4cf1b3a98aa499f6d466" } new_table_name: "default.Table_4b318a4173584e1298cc874712d94e47" modify_external_catalogs: true
I20260317 20:57:35.949986 796 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 76) took 1220 ms. Trace:
I20260317 20:57:35.950026 796 rpcz_store.cc:276] 0317 20:57:34.729228 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.949757 (+1220529us) service_pool.cc:225] Handling call
0317 20:57:35.949978 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3328}
I20260317 20:57:35.952780 796 master_service.cc:954] ReplaceTablet: received request to replace tablet aca959e916df4cedbaee283d770f82bc from {username='slave'} at 127.0.0.1:57868
W20260317 20:57:35.950328 792 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e0a1ab3af8974191818e51a5608c5724 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:35.956522 796 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet aca959e916df4cedbaee283d770f82bc
I20260317 20:57:35.957206 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet aca959e916df4cedbaee283d770f82bc with delete_type TABLET_DATA_DELETED (replaced by tablet 2b12559c4b7a44888963ef37d705513f) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:35.957398 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet aca959e916df4cedbaee283d770f82bc with delete_type TABLET_DATA_DELETED (replaced by tablet 2b12559c4b7a44888963ef37d705513f) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:35.957665 1785 tablet_replica.cc:333] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.957840 1785 raft_consensus.cc:2243] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.958103 1785 raft_consensus.cc:2272] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.958199 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet aca959e916df4cedbaee283d770f82bc with delete_type TABLET_DATA_DELETED (replaced by tablet 2b12559c4b7a44888963ef37d705513f) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.958376 1783 tablet_replica.cc:333] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.958499 1783 raft_consensus.cc:2243] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.958539 1785 ts_tablet_manager.cc:1916] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.958618 1783 raft_consensus.cc:2272] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.958779 796 catalog_manager.cc:6741] ReplaceTablet: tablet aca959e916df4cedbaee283d770f82bc deleted and replaced by tablet 2b12559c4b7a44888963ef37d705513f
I20260317 20:57:35.958853 796 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 78) took 1204 ms. Trace:
I20260317 20:57:35.959036 1783 ts_tablet_manager.cc:1916] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.958889 796 rpcz_store.cc:276] 0317 20:57:34.754028 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.952756 (+1198728us) service_pool.cc:225] Handling call
0317 20:57:35.958846 (+ 6090us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:35.953455 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:35.953554 (+ 99us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:35.953558 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:35.953559 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:35.953643 (+ 84us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:35.953653 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:35.953656 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:35.953710 (+ 54us) tablet.cc:700] Row locks acquired
0317 20:57:35.953711 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:35.953745 (+ 34us) write_op.cc:270] Start()
0317 20:57:35.953775 (+ 30us) write_op.cc:276] Timestamp: P: 1773781055953610 usec, L: 0
0317 20:57:35.953777 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:35.953937 (+ 160us) log.cc:844] Serialized 662 byte log entry
0317 20:57:35.956024 (+ 2087us) op_driver.cc:464] REPLICATION: finished
0317 20:57:35.956103 (+ 79us) write_op.cc:301] APPLY: starting
0317 20:57:35.956116 (+ 13us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:35.956144 (+ 28us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:35.956156 (+ 12us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:35.956225 (+ 69us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:35.956258 (+ 33us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0317 20:57:35.956262 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:35.956311 (+ 49us) log.cc:844] Serialized 29 byte log entry
0317 20:57:35.956352 (+ 41us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.956365 (+ 13us) write_op.cc:454] Released schema lock
0317 20:57:35.956370 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:35.956429 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.956431 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":31,"apply.run_cpu_time_us":322,"apply.run_wall_time_us":322,"num_ops":2,"prepare.queue_time_us":66,"prepare.run_cpu_time_us":605,"prepare.run_wall_time_us":601,"raft.queue_time_us":547,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":223,"replication_time_us":2219}]]}
I20260317 20:57:35.959602 1784 tablet_replica.cc:333] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.959761 1784 raft_consensus.cc:2243] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.959892 1784 raft_consensus.cc:2272] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.960273 1784 ts_tablet_manager.cc:1916] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.960909 1785 ts_tablet_manager.cc:1929] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.960986 1785 log.cc:1199] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/aca959e916df4cedbaee283d770f82bc
I20260317 20:57:35.961222 1783 ts_tablet_manager.cc:1929] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.961297 1783 log.cc:1199] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/aca959e916df4cedbaee283d770f82bc
I20260317 20:57:35.961561 1783 ts_tablet_manager.cc:1950] T aca959e916df4cedbaee283d770f82bc P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.961874 1785 ts_tablet_manager.cc:1950] T aca959e916df4cedbaee283d770f82bc P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.962160 796 master_service.cc:954] ReplaceTablet: received request to replace tablet e5dc15804e4046fdac79204e10ed14fc from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:35.962391 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet aca959e916df4cedbaee283d770f82bc (table default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]) successfully deleted
I20260317 20:57:35.962690 796 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 79) took 1153 ms. Trace:
I20260317 20:57:35.962755 796 rpcz_store.cc:276] 0317 20:57:34.809175 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.962131 (+1152956us) service_pool.cc:225] Handling call
0317 20:57:35.962681 (+ 550us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260317 20:57:35.962898 796 master_service.cc:954] ReplaceTablet: received request to replace tablet 1a900d232ebe465eb9fdecd6038cd37f from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:35.963900 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet aca959e916df4cedbaee283d770f82bc (table default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]) successfully deleted
I20260317 20:57:35.965332 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12559c4b7a44888963ef37d705513f (DEFAULT_TABLE table=default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.965523 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12559c4b7a44888963ef37d705513f (DEFAULT_TABLE table=default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.965590 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12559c4b7a44888963ef37d705513f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.965782 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12559c4b7a44888963ef37d705513f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.967372 796 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 1a900d232ebe465eb9fdecd6038cd37f
I20260317 20:57:35.967882 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2b12559c4b7a44888963ef37d705513f (DEFAULT_TABLE table=default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.968142 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b12559c4b7a44888963ef37d705513f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.968149 1842 tablet_bootstrap.cc:492] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:35.969192 1842 tablet_bootstrap.cc:654] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.970420 1842 tablet_bootstrap.cc:492] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:35.970467 796 catalog_manager.cc:6741] ReplaceTablet: tablet 1a900d232ebe465eb9fdecd6038cd37f deleted and replaced by tablet e4124783269f438c803d4fb68f223d20
I20260317 20:57:35.970477 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a900d232ebe465eb9fdecd6038cd37f with delete_type TABLET_DATA_DELETED (replaced by tablet e4124783269f438c803d4fb68f223d20) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:35.970556 796 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 80) took 1047 ms. Trace:
I20260317 20:57:35.970631 1785 tablet_replica.cc:333] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:35.970724 1842 ts_tablet_manager.cc:1403] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:35.970782 1785 raft_consensus.cc:2243] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.970613 796 rpcz_store.cc:276] 0317 20:57:34.923041 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.962878 (+1039837us) service_pool.cc:225] Handling call
0317 20:57:35.970546 (+ 7668us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:35.963726 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:35.963816 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:35.963819 (+ 3us) write_op.cc:435] Acquired schema lock
0317 20:57:35.963820 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:35.963890 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:35.963896 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:35.963900 (+ 4us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:35.963945 (+ 45us) tablet.cc:700] Row locks acquired
0317 20:57:35.963947 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:35.963968 (+ 21us) write_op.cc:270] Start()
0317 20:57:35.963988 (+ 20us) write_op.cc:276] Timestamp: P: 1773781055963954 usec, L: 0
0317 20:57:35.963991 (+ 3us) op_driver.cc:348] REPLICATION: starting
0317 20:57:35.964091 (+ 100us) log.cc:844] Serialized 662 byte log entry
0317 20:57:35.966728 (+ 2637us) op_driver.cc:464] REPLICATION: finished
0317 20:57:35.966817 (+ 89us) write_op.cc:301] APPLY: starting
0317 20:57:35.966830 (+ 13us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:35.966857 (+ 27us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:35.966873 (+ 16us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:35.966948 (+ 75us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:35.966978 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0317 20:57:35.966982 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:35.967023 (+ 41us) log.cc:844] Serialized 29 byte log entry
0317 20:57:35.967063 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.967074 (+ 11us) write_op.cc:454] Released schema lock
0317 20:57:35.967078 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:35.967125 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:35.967127 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":54,"apply.run_cpu_time_us":301,"apply.run_wall_time_us":300,"num_ops":2,"prepare.queue_time_us":32,"prepare.run_cpu_time_us":425,"prepare.run_wall_time_us":426,"raft.queue_time_us":42,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":2716}]]}
I20260317 20:57:35.970899 1785 raft_consensus.cc:2272] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.971148 796 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_881b6f17f7bc4a1ab950e332bd29d36c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:35.971277 1785 ts_tablet_manager.cc:1916] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.971670 1842 raft_consensus.cc:359] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.971794 1842 raft_consensus.cc:385] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.971832 1842 raft_consensus.cc:740] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.971977 1842 consensus_queue.cc:260] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.972270 1842 ts_tablet_manager.cc:1434] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:35.973207 1785 ts_tablet_manager.cc:1929] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.973278 1785 log.cc:1199] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/1a900d232ebe465eb9fdecd6038cd37f
I20260317 20:57:35.973518 1785 ts_tablet_manager.cc:1950] T 1a900d232ebe465eb9fdecd6038cd37f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:35.974509 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 1a900d232ebe465eb9fdecd6038cd37f (table default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]) successfully deleted
I20260317 20:57:35.974890 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a900d232ebe465eb9fdecd6038cd37f with delete_type TABLET_DATA_DELETED (replaced by tablet e4124783269f438c803d4fb68f223d20) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:35.975127 1783 tablet_replica.cc:333] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:35.975255 1783 raft_consensus.cc:2243] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:35.975356 1783 raft_consensus.cc:2272] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.975981 1783 ts_tablet_manager.cc:1916] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.976944 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a900d232ebe465eb9fdecd6038cd37f with delete_type TABLET_DATA_DELETED (replaced by tablet e4124783269f438c803d4fb68f223d20) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:35.977254 1843 tablet_bootstrap.cc:492] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:35.978878 1843 tablet_bootstrap.cc:654] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.978883 1783 ts_tablet_manager.cc:1929] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.978971 1783 log.cc:1199] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/1a900d232ebe465eb9fdecd6038cd37f
I20260317 20:57:35.979401 1783 ts_tablet_manager.cc:1950] T 1a900d232ebe465eb9fdecd6038cd37f P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:35.980680 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 1a900d232ebe465eb9fdecd6038cd37f (table default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]) successfully deleted
I20260317 20:57:35.982012 1176 tablet_service.cc:1511] Processing CreateTablet for tablet e4124783269f438c803d4fb68f223d20 (DEFAULT_TABLE table=default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.982336 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4124783269f438c803d4fb68f223d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.982378 1314 tablet_service.cc:1511] Processing CreateTablet for tablet e4124783269f438c803d4fb68f223d20 (DEFAULT_TABLE table=default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.982654 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4124783269f438c803d4fb68f223d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.984923 1842 tablet_bootstrap.cc:492] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:35.985211 1039 tablet_service.cc:1511] Processing CreateTablet for tablet e4124783269f438c803d4fb68f223d20 (DEFAULT_TABLE table=default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:35.985481 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4124783269f438c803d4fb68f223d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:35.985976 1842 tablet_bootstrap.cc:654] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.987463 1842 tablet_bootstrap.cc:492] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:35.987565 1842 ts_tablet_manager.cc:1403] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:35.988047 1842 raft_consensus.cc:359] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.988181 1842 raft_consensus.cc:385] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.988219 1842 raft_consensus.cc:740] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.988361 1842 consensus_queue.cc:260] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.988492 1784 ts_tablet_manager.cc:1929] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.988596 1784 log.cc:1199] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/aca959e916df4cedbaee283d770f82bc
I20260317 20:57:35.988674 1842 ts_tablet_manager.cc:1434] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:35.989104 1784 ts_tablet_manager.cc:1950] T aca959e916df4cedbaee283d770f82bc P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.989794 1784 tablet_replica.cc:333] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:35.989943 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet aca959e916df4cedbaee283d770f82bc (table default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]) successfully deleted
I20260317 20:57:35.989984 1784 raft_consensus.cc:2243] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:35.990286 1784 raft_consensus.cc:2272] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:35.990770 1784 ts_tablet_manager.cc:1916] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:35.992061 1715 raft_consensus.cc:493] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:35.992156 1715 raft_consensus.cc:515] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.992511 1715 leader_election.cc:290] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.992940 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ed352c406f49138e48fffa6b14a5d2" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:35.993076 1334 raft_consensus.cc:2468] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:35.993459 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ed352c406f49138e48fffa6b14a5d2" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:35.993516 1133 leader_election.cc:304] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:35.993609 1059 raft_consensus.cc:2468] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:35.993666 1715 raft_consensus.cc:2804] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:35.993714 1715 raft_consensus.cc:493] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:35.993759 1715 raft_consensus.cc:3060] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.994503 1841 tablet_bootstrap.cc:492] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:35.994606 1841 ts_tablet_manager.cc:1403] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.058s user 0.001s sys 0.001s
I20260317 20:57:35.994778 1715 raft_consensus.cc:515] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.994850 1784 ts_tablet_manager.cc:1929] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:35.994903 1784 log.cc:1199] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/1a900d232ebe465eb9fdecd6038cd37f
I20260317 20:57:35.995147 1784 ts_tablet_manager.cc:1950] T 1a900d232ebe465eb9fdecd6038cd37f P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:35.995183 1715 leader_election.cc:290] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:35.995177 1841 raft_consensus.cc:359] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.995285 1841 raft_consensus.cc:385] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:35.995321 1841 raft_consensus.cc:740] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:35.995450 1841 consensus_queue.cc:260] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:35.995612 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ed352c406f49138e48fffa6b14a5d2" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:35.995715 1334 raft_consensus.cc:3060] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.995754 1841 ts_tablet_manager.cc:1434] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:35.995963 1841 tablet_bootstrap.cc:492] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:35.996573 1334 raft_consensus.cc:2468] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.997051 1841 tablet_bootstrap.cc:654] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:35.997108 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ed352c406f49138e48fffa6b14a5d2" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:35.997205 1059 raft_consensus.cc:3060] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:35.998092 1059 raft_consensus.cc:2468] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:35.998422 1133 leader_election.cc:304] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:35.999966 1843 tablet_bootstrap.cc:492] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:36.000078 1843 ts_tablet_manager.cc:1403] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.002s
I20260317 20:57:36.000098 1715 raft_consensus.cc:2804] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.000169 1715 raft_consensus.cc:697] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:36.000304 1715 consensus_queue.cc:237] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.000597 1843 raft_consensus.cc:359] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.000707 1843 raft_consensus.cc:385] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.000756 1843 raft_consensus.cc:740] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.000844 1843 consensus_queue.cc:260] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.001617 1843 ts_tablet_manager.cc:1434] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.001878 1843 tablet_bootstrap.cc:492] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:36.003149 1843 tablet_bootstrap.cc:654] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.003245 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 1a900d232ebe465eb9fdecd6038cd37f (table default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299]) successfully deleted
I20260317 20:57:36.007370 1841 tablet_bootstrap.cc:492] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:36.007406 1848 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:36.007526 1841 ts_tablet_manager.cc:1403] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20260317 20:57:36.008176 1848 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:36.008163 1841 raft_consensus.cc:359] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.008301 1841 raft_consensus.cc:385] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.008335 1841 raft_consensus.cc:740] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.008383 1848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:36.008469 1841 consensus_queue.cc:260] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.008766 1841 ts_tablet_manager.cc:1434] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.008962 1841 tablet_bootstrap.cc:492] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:36.010497 1843 tablet_bootstrap.cc:492] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:36.010614 1843 ts_tablet_manager.cc:1403] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260317 20:57:36.010969 1841 tablet_bootstrap.cc:654] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.011163 1843 raft_consensus.cc:359] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.011268 1843 raft_consensus.cc:385] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.011298 1843 raft_consensus.cc:740] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.011425 1843 consensus_queue.cc:260] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.011751 1843 ts_tablet_manager.cc:1434] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.018959 1841 tablet_bootstrap.cc:492] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:36.019127 1841 ts_tablet_manager.cc:1403] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s
I20260317 20:57:36.019714 1841 raft_consensus.cc:359] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.019845 1841 raft_consensus.cc:385] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.019884 1841 raft_consensus.cc:740] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.020059 1841 consensus_queue.cc:260] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.020391 1841 ts_tablet_manager.cc:1434] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:36.022611 1848 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.254:45865
I20260317 20:57:36.024021 1848 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
I20260317 20:57:36.025182 1951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.254:45865 every 8 connection(s)
I20260317 20:57:36.028460 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 1848
I20260317 20:57:36.034075 1952 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:36.037177 1952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap starting.
I20260317 20:57:36.047333 799 catalog_manager.cc:3502] renamed table default.table_b832fcb92ce7484c9bf70cdd65f3a109 [id=a4ba9bce277146cc8c2a1cfcbf90f951] in HMS: new name default.table_a5ab9704ed704e619e80ab8d4d623a68
I20260317 20:57:36.052734 1952 log.cc:826] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:36.078981 1462 raft_consensus.cc:493] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.079123 1462 raft_consensus.cc:515] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.079584 1462 leader_election.cc:290] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.080201 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58ac81836d94bae906e753352c28ff7" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:36.080353 1059 raft_consensus.cc:2468] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.080387 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58ac81836d94bae906e753352c28ff7" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:36.080502 1198 raft_consensus.cc:2468] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.080806 1269 leader_election.cc:304] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.081141 1462 raft_consensus.cc:2804] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.081200 1462 raft_consensus.cc:493] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.081236 1462 raft_consensus.cc:3060] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.082429 1462 raft_consensus.cc:515] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.082790 1462 leader_election.cc:290] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.083340 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58ac81836d94bae906e753352c28ff7" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:36.083459 1198 raft_consensus.cc:3060] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.084529 1198 raft_consensus.cc:2468] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.084934 1268 leader_election.cc:304] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:36.085460 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58ac81836d94bae906e753352c28ff7" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:36.085584 1059 raft_consensus.cc:3060] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.086601 1059 raft_consensus.cc:2468] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.087106 1462 raft_consensus.cc:2804] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.087208 1462 raft_consensus.cc:697] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:36.087334 1462 consensus_queue.cc:237] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.095796 1381 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:36.113353 793 catalog_manager.cc:2174] created HMS catalog entry for table [id=265562f7c8354c4aa654a7283a601543]
I20260317 20:57:36.118320 793 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 67) took 1829 ms. Trace:
I20260317 20:57:36.118412 793 rpcz_store.cc:276] 0317 20:57:34.288787 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.678866 (+1390079us) service_pool.cc:225] Handling call
0317 20:57:35.922864 (+243998us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:35.923235 (+ 371us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:36.113336 (+190101us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:36.118119 (+ 4783us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:36.118214 (+ 95us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:36.118300 (+ 86us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:36.113960 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:36.114071 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:36.114075 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:36.114076 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:36.114142 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:36.114150 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:36.114154 (+ 4us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:36.114200 (+ 46us) tablet.cc:700] Row locks acquired
0317 20:57:36.114203 (+ 3us) write_op.cc:260] PREPARE: finished
0317 20:57:36.114232 (+ 29us) write_op.cc:270] Start()
0317 20:57:36.114255 (+ 23us) write_op.cc:276] Timestamp: P: 1773781056114186 usec, L: 0
0317 20:57:36.114257 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:36.114397 (+ 140us) log.cc:844] Serialized 433 byte log entry
0317 20:57:36.117546 (+ 3149us) op_driver.cc:464] REPLICATION: finished
0317 20:57:36.117669 (+ 123us) write_op.cc:301] APPLY: starting
0317 20:57:36.117682 (+ 13us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:36.117712 (+ 30us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:36.117727 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:36.117807 (+ 80us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:36.117841 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:36.117846 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:36.117895 (+ 49us) log.cc:844] Serialized 29 byte log entry
0317 20:57:36.117954 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.117970 (+ 16us) write_op.cc:454] Released schema lock
0317 20:57:36.117974 (+ 4us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"Hive Metastore.queue_time_us":124028,"Hive Metastore.run_cpu_time_us":236,"Hive Metastore.run_wall_time_us":65810,"child_traces":[["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":358,"apply.run_wall_time_us":358,"num_ops":2,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":540,"prepare.run_wall_time_us":541,"raft.queue_time_us":417,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":224,"replication_time_us":3264}]]}
I20260317 20:57:36.121162 793 catalog_manager.cc:5671] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:36.137931 1952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap replayed 1/1 log segments. Stats: ops{read=106 overwritten=0 applied=106 ignored=0} inserts{seen=75 ignored=0} mutations{seen=85 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:36.138514 1952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap complete.
I20260317 20:57:36.138978 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 492e0f23d6b74854bc68f51c8136d495 (DEFAULT_TABLE table=default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.139147 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 492e0f23d6b74854bc68f51c8136d495 (DEFAULT_TABLE table=default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.139331 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492e0f23d6b74854bc68f51c8136d495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.139463 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492e0f23d6b74854bc68f51c8136d495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.141736 1841 tablet_bootstrap.cc:492] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:36.141763 1842 tablet_bootstrap.cc:492] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:36.142905 1842 tablet_bootstrap.cc:654] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.142905 1841 tablet_bootstrap.cc:654] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.144609 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 492e0f23d6b74854bc68f51c8136d495 (DEFAULT_TABLE table=default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.144402 1952 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:36.144860 1952 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5022d9ddb45c41faa9f114e2a0a31fc3, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.144938 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492e0f23d6b74854bc68f51c8136d495. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.145447 1952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 106, Last appended: 1.106, Last appended by leader: 106, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:36.147060 1952 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:36.147568 1843 tablet_bootstrap.cc:492] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:36.148793 1843 tablet_bootstrap.cc:654] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.149977 1449 consensus_queue.cc:1048] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.170727 1108 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:36.173745 1916 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:33623; Asking this server to re-register.
I20260317 20:57:36.174482 1108 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:36.176045 1960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:36.176306 1960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:36.177003 1565 consensus_queue.cc:1048] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.180676 1916 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:57:36.187300 797 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a9891e641d7144228ae4fa567a20f67d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:36.187647 1916 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:51587; Asking this server to re-register.
I20260317 20:57:36.188565 1381 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:36.189916 793 catalog_manager.cc:5671] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:36.191437 1853 tablet.cc:1723] T d5cd4964ea9d4a2aa4db0bd970b854ea P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:36.192566 1856 tablet.cc:1723] T d5cd4964ea9d4a2aa4db0bd970b854ea P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:36.194324 1916 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.196575 1855 tablet.cc:1723] T d5cd4964ea9d4a2aa4db0bd970b854ea P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:36.202955 1976 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:36.203053 1976 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: loading cluster ID for follower catalog manager: success
I20260317 20:57:36.211660 793 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951] alter complete (version 2)
I20260317 20:57:36.212795 1976 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: acquiring CA information for follower catalog manager: success
I20260317 20:57:36.215193 793 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_4993eb4cbf8d4cd28646b149b3c141bb" } modify_external_catalogs: true
I20260317 20:57:36.215459 793 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_4993eb4cbf8d4cd28646b149b3c141bb" } modify_external_catalogs: true
I20260317 20:57:36.217468 1843 tablet_bootstrap.cc:492] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:36.217597 1843 ts_tablet_manager.cc:1403] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.070s user 0.002s sys 0.001s
I20260317 20:57:36.218344 1843 raft_consensus.cc:359] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.218467 1843 raft_consensus.cc:385] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.218498 1843 raft_consensus.cc:740] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.218631 1843 consensus_queue.cc:260] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.218782 1462 raft_consensus.cc:493] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.218897 1843 ts_tablet_manager.cc:1434] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.218894 1462 raft_consensus.cc:515] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.219288 1462 leader_election.cc:290] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.219920 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4124783269f438c803d4fb68f223d20" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:36.220052 1061 raft_consensus.cc:2468] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.220510 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4124783269f438c803d4fb68f223d20" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:36.220623 1198 raft_consensus.cc:2468] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.220682 1976 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:57:36.221006 1269 leader_election.cc:304] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.221307 1462 raft_consensus.cc:2804] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.221359 1462 raft_consensus.cc:493] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.221392 1462 raft_consensus.cc:3060] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.221736 1841 tablet_bootstrap.cc:492] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:36.221838 1841 ts_tablet_manager.cc:1403] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.080s user 0.002s sys 0.000s
I20260317 20:57:36.222424 1841 raft_consensus.cc:359] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.222535 1841 raft_consensus.cc:385] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.222566 1841 raft_consensus.cc:740] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.222499 1462 raft_consensus.cc:515] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.222699 1841 consensus_queue.cc:260] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.222908 1462 leader_election.cc:290] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.223002 1841 ts_tablet_manager.cc:1434] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.223919 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4124783269f438c803d4fb68f223d20" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:36.224054 1198 raft_consensus.cc:3060] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.225101 1198 raft_consensus.cc:2468] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.225746 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4124783269f438c803d4fb68f223d20" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:36.225876 1061 raft_consensus.cc:3060] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.226871 1061 raft_consensus.cc:2468] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.227425 1268 leader_election.cc:304] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:36.228713 1462 raft_consensus.cc:2804] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.228825 1462 raft_consensus.cc:697] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:36.228961 1462 consensus_queue.cc:237] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.234089 1245 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:36.238755 1916 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:40499; Asking this server to re-register.
I20260317 20:57:36.239507 1245 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:36.242653 1916 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.258464 1842 tablet_bootstrap.cc:492] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:36.258608 1842 ts_tablet_manager.cc:1403] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.117s user 0.003s sys 0.000s
I20260317 20:57:36.259227 1842 raft_consensus.cc:359] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.259367 1842 raft_consensus.cc:385] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.259403 1842 raft_consensus.cc:740] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.259559 1842 consensus_queue.cc:260] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.259917 1842 ts_tablet_manager.cc:1434] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:36.267689 800 catalog_manager.cc:2174] created HMS catalog entry for table [id=fa7454b6e5ff4f85aa96a7ea73b601e5]
I20260317 20:57:36.269405 1462 raft_consensus.cc:493] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.269558 1462 raft_consensus.cc:515] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.270022 1462 leader_election.cc:290] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.270853 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12559c4b7a44888963ef37d705513f" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:36.271051 1061 raft_consensus.cc:2468] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.271319 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12559c4b7a44888963ef37d705513f" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:36.271478 1198 raft_consensus.cc:2468] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.271756 800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 70) took 1913 ms. Trace:
I20260317 20:57:36.271849 1269 leader_election.cc:304] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.271832 800 rpcz_store.cc:276] 0317 20:57:34.358604 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.681564 (+1322960us) service_pool.cc:225] Handling call
0317 20:57:35.947747 (+266183us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:35.948171 (+ 424us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:36.267678 (+319507us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:36.271547 (+ 3869us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:36.271663 (+ 116us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:36.271739 (+ 76us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:36.268260 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:36.268373 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:36.268377 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:36.268378 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:36.268446 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:36.268456 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:36.268460 (+ 4us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:36.268517 (+ 57us) tablet.cc:700] Row locks acquired
0317 20:57:36.268519 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:36.268550 (+ 31us) write_op.cc:270] Start()
0317 20:57:36.268578 (+ 28us) write_op.cc:276] Timestamp: P: 1773781056268473 usec, L: 0
0317 20:57:36.268580 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:36.268722 (+ 142us) log.cc:844] Serialized 433 byte log entry
0317 20:57:36.270966 (+ 2244us) op_driver.cc:464] REPLICATION: finished
0317 20:57:36.271085 (+ 119us) write_op.cc:301] APPLY: starting
0317 20:57:36.271102 (+ 17us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:36.271134 (+ 32us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:36.271149 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:36.271226 (+ 77us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:36.271255 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:36.271261 (+ 6us) write_op.cc:312] APPLY: finished
0317 20:57:36.271319 (+ 58us) log.cc:844] Serialized 29 byte log entry
0317 20:57:36.271377 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.271392 (+ 15us) write_op.cc:454] Released schema lock
0317 20:57:36.271397 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:36.271460 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.271462 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":180742,"Hive Metastore.run_cpu_time_us":239,"Hive Metastore.run_wall_time_us":138607,"spinlock_wait_cycles":10240,"child_traces":[["op",{"apply.queue_time_us":77,"apply.run_cpu_time_us":364,"apply.run_wall_time_us":364,"num_ops":2,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":554,"prepare.run_wall_time_us":554,"raft.queue_time_us":316,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"replication_time_us":2362}]]}
I20260317 20:57:36.272302 1462 raft_consensus.cc:2804] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.272363 1462 raft_consensus.cc:493] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.272403 1462 raft_consensus.cc:3060] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.273535 1462 raft_consensus.cc:515] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.273926 1462 leader_election.cc:290] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.274683 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12559c4b7a44888963ef37d705513f" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:36.274827 1198 raft_consensus.cc:3060] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.275945 1198 raft_consensus.cc:2468] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.276425 1268 leader_election.cc:304] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:36.276655 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b12559c4b7a44888963ef37d705513f" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:36.276774 1061 raft_consensus.cc:3060] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.277724 1061 raft_consensus.cc:2468] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.278216 1462 raft_consensus.cc:2804] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.278311 1462 raft_consensus.cc:697] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:36.278437 1462 consensus_queue.cc:237] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.283601 1039 tablet_service.cc:1511] Processing CreateTablet for tablet a78fdc83a3d54554a08f01915f102f6e (DEFAULT_TABLE table=default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.283682 1314 tablet_service.cc:1511] Processing CreateTablet for tablet a78fdc83a3d54554a08f01915f102f6e (DEFAULT_TABLE table=default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.283989 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fdc83a3d54554a08f01915f102f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.283995 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fdc83a3d54554a08f01915f102f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.286409 1842 tablet_bootstrap.cc:492] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:36.286621 1176 tablet_service.cc:1511] Processing CreateTablet for tablet a78fdc83a3d54554a08f01915f102f6e (DEFAULT_TABLE table=default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.286945 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78fdc83a3d54554a08f01915f102f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.287524 1842 tablet_bootstrap.cc:654] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.289642 1843 tablet_bootstrap.cc:492] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:36.292297 1843 tablet_bootstrap.cc:654] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.295014 800 catalog_manager.cc:5671] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:36.304179 1841 tablet_bootstrap.cc:492] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:36.305737 1841 tablet_bootstrap.cc:654] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.309336 800 catalog_manager.cc:5671] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:36.315667 800 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_5e656cced82044008854c0c5271d95d0" } modify_external_catalogs: true
I20260317 20:57:36.315917 800 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_5e656cced82044008854c0c5271d95d0" } modify_external_catalogs: true
I20260317 20:57:36.325136 1841 tablet_bootstrap.cc:492] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:36.325276 1841 ts_tablet_manager.cc:1403] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20260317 20:57:36.325954 1841 raft_consensus.cc:359] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.327832 1841 raft_consensus.cc:385] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.327893 1841 raft_consensus.cc:740] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.328048 1841 consensus_queue.cc:260] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.328464 1841 ts_tablet_manager.cc:1434] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260317 20:57:36.340667 1843 tablet_bootstrap.cc:492] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:36.340816 1843 ts_tablet_manager.cc:1403] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260317 20:57:36.341521 1843 raft_consensus.cc:359] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.341660 1843 raft_consensus.cc:385] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.341698 1843 raft_consensus.cc:740] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.341857 1843 consensus_queue.cc:260] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.342279 1843 ts_tablet_manager.cc:1434] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:36.343251 1842 tablet_bootstrap.cc:492] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:36.343374 1842 ts_tablet_manager.cc:1403] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.000s
I20260317 20:57:36.343932 1842 raft_consensus.cc:359] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.344058 1842 raft_consensus.cc:385] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.344094 1842 raft_consensus.cc:740] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.344231 1842 consensus_queue.cc:260] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.344517 1842 ts_tablet_manager.cc:1434] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.351433 794 catalog_manager.cc:2174] created HMS catalog entry for table [id=9e830bfaf0f54f649394507a011313d4]
I20260317 20:57:36.359975 794 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 71) took 1852 ms. Trace:
I20260317 20:57:36.360101 794 rpcz_store.cc:276] 0317 20:57:34.507224 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.681863 (+1174639us) service_pool.cc:225] Handling call
0317 20:57:35.947899 (+266036us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:35.948195 (+ 296us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:36.351415 (+403220us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:36.359734 (+ 8319us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:36.359856 (+ 122us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:36.359952 (+ 96us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:36.352399 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:36.352547 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:36.352554 (+ 7us) write_op.cc:435] Acquired schema lock
0317 20:57:36.352557 (+ 3us) tablet.cc:661] Decoding operations
0317 20:57:36.352654 (+ 97us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:36.352669 (+ 15us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:36.352675 (+ 6us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:36.352756 (+ 81us) tablet.cc:700] Row locks acquired
0317 20:57:36.352759 (+ 3us) write_op.cc:260] PREPARE: finished
0317 20:57:36.352799 (+ 40us) write_op.cc:270] Start()
0317 20:57:36.352837 (+ 38us) write_op.cc:276] Timestamp: P: 1773781056352701 usec, L: 0
0317 20:57:36.352841 (+ 4us) op_driver.cc:348] REPLICATION: starting
0317 20:57:36.353018 (+ 177us) log.cc:844] Serialized 433 byte log entry
0317 20:57:36.357334 (+ 4316us) op_driver.cc:464] REPLICATION: finished
0317 20:57:36.357469 (+ 135us) write_op.cc:301] APPLY: starting
0317 20:57:36.357490 (+ 21us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:36.357532 (+ 42us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:36.357554 (+ 22us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:36.357659 (+ 105us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:36.357699 (+ 40us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:36.357706 (+ 7us) write_op.cc:312] APPLY: finished
0317 20:57:36.357811 (+ 105us) log.cc:844] Serialized 29 byte log entry
0317 20:57:36.357872 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.357888 (+ 16us) write_op.cc:454] Released schema lock
0317 20:57:36.357893 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:36.357957 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.357959 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":319388,"Hive Metastore.run_cpu_time_us":234,"Hive Metastore.run_wall_time_us":83491,"mutex_wait_us":71,"child_traces":[["op",{"apply.queue_time_us":85,"apply.run_cpu_time_us":478,"apply.run_wall_time_us":478,"num_ops":2,"prepare.queue_time_us":251,"prepare.run_cpu_time_us":726,"prepare.run_wall_time_us":726,"raft.queue_time_us":1126,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":201,"replication_time_us":4456}]]}
I20260317 20:57:36.372291 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7946629e25418c9c23d09363e305b8 (DEFAULT_TABLE table=default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.372710 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7946629e25418c9c23d09363e305b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.375972 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7946629e25418c9c23d09363e305b8 (DEFAULT_TABLE table=default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.377056 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 0d7946629e25418c9c23d09363e305b8 (DEFAULT_TABLE table=default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.377360 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7946629e25418c9c23d09363e305b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.376371 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d7946629e25418c9c23d09363e305b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.379462 794 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_e63b5215dfe141f78d97647d4e83411d" } new_table_name: "default.Table_59673e06fbb64ab38291807c2e04e319" modify_external_catalogs: true
I20260317 20:57:36.379782 1842 tablet_bootstrap.cc:492] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:36.380903 1842 tablet_bootstrap.cc:654] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.381774 1715 consensus_queue.cc:1048] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.386729 1843 tablet_bootstrap.cc:492] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:36.388337 1843 tablet_bootstrap.cc:654] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.389796 1841 tablet_bootstrap.cc:492] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:36.391386 1841 tablet_bootstrap.cc:654] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.393975 1841 tablet_bootstrap.cc:492] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:36.394138 1841 ts_tablet_manager.cc:1403] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260317 20:57:36.394793 1841 raft_consensus.cc:359] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.394953 1841 raft_consensus.cc:385] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.395009 1841 raft_consensus.cc:740] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.395215 1841 consensus_queue.cc:260] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.402107 1841 ts_tablet_manager.cc:1434] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:36.414469 1565 consensus_queue.cc:1048] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.422324 1843 tablet_bootstrap.cc:492] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:36.422470 1843 ts_tablet_manager.cc:1403] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.036s user 0.003s sys 0.000s
I20260317 20:57:36.423207 1843 raft_consensus.cc:359] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.423367 1843 raft_consensus.cc:385] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.423415 1843 raft_consensus.cc:740] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.423573 1843 consensus_queue.cc:260] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.424000 1843 ts_tablet_manager.cc:1434] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:36.427860 1819 raft_consensus.cc:493] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.428035 1819 raft_consensus.cc:515] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.428488 1819 leader_election.cc:290] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.429137 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492e0f23d6b74854bc68f51c8136d495" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:36.429286 1332 raft_consensus.cc:2468] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:36.429759 996 leader_election.cc:304] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.430208 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492e0f23d6b74854bc68f51c8136d495" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:36.430362 1198 raft_consensus.cc:2468] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:36.430846 1819 raft_consensus.cc:2804] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.430940 1819 raft_consensus.cc:493] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.430990 1819 raft_consensus.cc:3060] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.432108 1819 raft_consensus.cc:515] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.432569 1819 leader_election.cc:290] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.432948 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492e0f23d6b74854bc68f51c8136d495" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:36.433086 1198 raft_consensus.cc:3060] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.433274 1842 tablet_bootstrap.cc:492] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:36.433388 1842 ts_tablet_manager.cc:1403] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.054s user 0.003s sys 0.000s
I20260317 20:57:36.433429 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "492e0f23d6b74854bc68f51c8136d495" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:36.433542 1332 raft_consensus.cc:3060] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.434201 1198 raft_consensus.cc:2468] T 492e0f23d6b74854bc68f51c8136d495 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:36.434636 1332 raft_consensus.cc:2468] T 492e0f23d6b74854bc68f51c8136d495 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:36.434695 995 leader_election.cc:304] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.434880 1842 raft_consensus.cc:359] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.435043 1842 raft_consensus.cc:385] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.435088 1842 raft_consensus.cc:740] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.435246 1842 consensus_queue.cc:260] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.435644 1842 ts_tablet_manager.cc:1434] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:36.438078 1819 raft_consensus.cc:2804] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.438225 1819 raft_consensus.cc:697] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:36.438407 1819 consensus_queue.cc:237] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.451216 1565 raft_consensus.cc:493] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.451381 1565 raft_consensus.cc:515] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.451907 1565 leader_election.cc:290] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.452488 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fdc83a3d54554a08f01915f102f6e" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:36.452633 1061 raft_consensus.cc:2468] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:36.452656 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fdc83a3d54554a08f01915f102f6e" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:36.452785 1332 raft_consensus.cc:2468] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:36.452960 1133 leader_election.cc:304] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.453302 1565 raft_consensus.cc:2804] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.453372 1565 raft_consensus.cc:493] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.453428 1565 raft_consensus.cc:3060] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.454644 1565 raft_consensus.cc:515] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.455017 1565 leader_election.cc:290] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.455498 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fdc83a3d54554a08f01915f102f6e" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:36.455607 1332 raft_consensus.cc:3060] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.456641 1332 raft_consensus.cc:2468] T a78fdc83a3d54554a08f01915f102f6e P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:36.457132 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78fdc83a3d54554a08f01915f102f6e" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:36.457275 1061 raft_consensus.cc:3060] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.458323 1061 raft_consensus.cc:2468] T a78fdc83a3d54554a08f01915f102f6e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:36.458647 1133 leader_election.cc:304] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.458958 1565 raft_consensus.cc:2804] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.459069 1565 raft_consensus.cc:697] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:36.459213 1565 consensus_queue.cc:237] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.464048 798 catalog_manager.cc:2174] created HMS catalog entry for table [id=d3ad9378b2884b7b8b856a82a8cd0ff7]
I20260317 20:57:36.468894 798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 69) took 2161 ms. Trace:
I20260317 20:57:36.468991 798 rpcz_store.cc:276] 0317 20:57:34.307756 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.681172 (+1373416us) service_pool.cc:225] Handling call
0317 20:57:35.948413 (+267241us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:35.948723 (+ 310us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:36.464039 (+515316us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:36.468638 (+ 4599us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:36.468750 (+ 112us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:36.468872 (+ 122us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:36.464911 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:36.465048 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:36.465054 (+ 6us) write_op.cc:435] Acquired schema lock
0317 20:57:36.465057 (+ 3us) tablet.cc:661] Decoding operations
0317 20:57:36.465150 (+ 93us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:36.465162 (+ 12us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:36.465167 (+ 5us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:36.465240 (+ 73us) tablet.cc:700] Row locks acquired
0317 20:57:36.465242 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:36.465272 (+ 30us) write_op.cc:270] Start()
0317 20:57:36.465300 (+ 28us) write_op.cc:276] Timestamp: P: 1773781056465156 usec, L: 0
0317 20:57:36.465304 (+ 4us) op_driver.cc:348] REPLICATION: starting
0317 20:57:36.465466 (+ 162us) log.cc:844] Serialized 433 byte log entry
0317 20:57:36.468171 (+ 2705us) op_driver.cc:464] REPLICATION: finished
0317 20:57:36.468266 (+ 95us) write_op.cc:301] APPLY: starting
0317 20:57:36.468282 (+ 16us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:36.468312 (+ 30us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:36.468327 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:36.468402 (+ 75us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:36.468430 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:36.468434 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:36.468491 (+ 57us) log.cc:844] Serialized 29 byte log entry
0317 20:57:36.468551 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.468569 (+ 18us) write_op.cc:454] Released schema lock
0317 20:57:36.468576 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:36.468640 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.468642 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":402426,"Hive Metastore.run_cpu_time_us":216,"Hive Metastore.run_wall_time_us":112496,"child_traces":[["op",{"apply.queue_time_us":54,"apply.run_cpu_time_us":367,"apply.run_wall_time_us":367,"num_ops":2,"prepare.queue_time_us":328,"prepare.run_cpu_time_us":653,"prepare.run_wall_time_us":653,"raft.queue_time_us":538,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":197,"replication_time_us":2844}]]}
I20260317 20:57:36.482510 798 catalog_manager.cc:5671] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:36.483714 1039 tablet_service.cc:1511] Processing CreateTablet for tablet e69ac6bd9aca4af5aa72d76b4764b14c (DEFAULT_TABLE table=default.table_d75875b48ed64da7a376b2b012ffe68c [id=d3ad9378b2884b7b8b856a82a8cd0ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.483867 1314 tablet_service.cc:1511] Processing CreateTablet for tablet e69ac6bd9aca4af5aa72d76b4764b14c (DEFAULT_TABLE table=default.table_d75875b48ed64da7a376b2b012ffe68c [id=d3ad9378b2884b7b8b856a82a8cd0ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.484119 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69ac6bd9aca4af5aa72d76b4764b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.484166 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69ac6bd9aca4af5aa72d76b4764b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.486649 1842 tablet_bootstrap.cc:492] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:36.487700 1842 tablet_bootstrap.cc:654] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.488610 1841 tablet_bootstrap.cc:492] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:36.489512 1176 tablet_service.cc:1511] Processing CreateTablet for tablet e69ac6bd9aca4af5aa72d76b4764b14c (DEFAULT_TABLE table=default.table_d75875b48ed64da7a376b2b012ffe68c [id=d3ad9378b2884b7b8b856a82a8cd0ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.489858 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e69ac6bd9aca4af5aa72d76b4764b14c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.493793 1842 tablet_bootstrap.cc:492] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:36.493917 1842 ts_tablet_manager.cc:1403] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260317 20:57:36.494488 1843 tablet_bootstrap.cc:492] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:36.494460 1842 raft_consensus.cc:359] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.494568 1842 raft_consensus.cc:385] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.494598 1842 raft_consensus.cc:740] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.494724 1842 consensus_queue.cc:260] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.494987 1842 ts_tablet_manager.cc:1434] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.496114 1843 tablet_bootstrap.cc:654] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.504009 1841 tablet_bootstrap.cc:654] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.506260 1462 consensus_queue.cc:1048] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.527474 798 catalog_manager.cc:5671] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:36.538546 1565 consensus_queue.cc:1048] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.538546 1843 tablet_bootstrap.cc:492] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:36.538967 1843 ts_tablet_manager.cc:1403] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.000s
I20260317 20:57:36.539004 1841 tablet_bootstrap.cc:492] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:36.539085 1841 ts_tablet_manager.cc:1403] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20260317 20:57:36.539484 1843 raft_consensus.cc:359] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.539520 1841 raft_consensus.cc:359] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.539597 1843 raft_consensus.cc:385] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.539609 1841 raft_consensus.cc:385] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.539633 1843 raft_consensus.cc:740] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.539644 1841 raft_consensus.cc:740] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.539749 1843 consensus_queue.cc:260] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.539760 1841 consensus_queue.cc:260] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.540050 1843 ts_tablet_manager.cc:1434] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.540046 1841 ts_tablet_manager.cc:1434] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.552982 1806 consensus_queue.cc:1048] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.558029 1449 consensus_queue.cc:1048] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.562242 1462 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.562367 1462 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.562758 1462 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:36.563472 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7946629e25418c9c23d09363e305b8" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:36.563628 1060 raft_consensus.cc:2468] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.564229 1269 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.564440 1462 raft_consensus.cc:2804] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.564491 1462 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.564538 1462 raft_consensus.cc:3060] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.565765 1462 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.566288 1462 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:36.567394 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7946629e25418c9c23d09363e305b8" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:36.567570 1198 raft_consensus.cc:2468] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.567822 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7946629e25418c9c23d09363e305b8" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:36.567915 1196 raft_consensus.cc:3060] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.569195 1196 raft_consensus.cc:2468] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.571656 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d7946629e25418c9c23d09363e305b8" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:36.571821 1060 raft_consensus.cc:3060] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.572360 1268 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:36.573866 1060 raft_consensus.cc:2468] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.574980 1462 raft_consensus.cc:2804] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.575106 1462 raft_consensus.cc:697] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:36.575290 1462 consensus_queue.cc:237] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.581951 1960 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:36.582185 1960 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:36.593070 1847 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:36.593252 1847 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:36.611830 798 catalog_manager.cc:5671] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:36.619868 798 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_bfa0dd2ccbe04d26bb5885d568cd2393" } modify_external_catalogs: true
I20260317 20:57:36.620179 798 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_bfa0dd2ccbe04d26bb5885d568cd2393" } modify_external_catalogs: true
I20260317 20:57:36.678467 1806 consensus_queue.cc:1048] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.707763 1806 consensus_queue.cc:1048] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.719983 1806 consensus_queue.cc:1048] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.729705 791 catalog_manager.cc:3502] renamed table default.table_e410d42be96e4ac58f16d30d662b4ad4 [id=bc541149fbdd48ea9861ed3c108807cd] in HMS: new name default.table_70c346e7110644f2b3b5b4bec1789d4a
I20260317 20:57:36.730600 1462 consensus_queue.cc:1048] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.749248 1565 raft_consensus.cc:493] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.749435 1565 raft_consensus.cc:515] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.749930 1565 leader_election.cc:290] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.750635 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69ac6bd9aca4af5aa72d76b4764b14c" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:36.750804 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69ac6bd9aca4af5aa72d76b4764b14c" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:36.750844 1059 raft_consensus.cc:2468] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:36.750932 1334 raft_consensus.cc:2468] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:36.751256 1133 leader_election.cc:304] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:36.751607 1565 raft_consensus.cc:2804] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.751667 1565 raft_consensus.cc:493] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.751701 1565 raft_consensus.cc:3060] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.752849 1565 raft_consensus.cc:515] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.753278 1565 leader_election.cc:290] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.754149 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69ac6bd9aca4af5aa72d76b4764b14c" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:36.754290 1334 raft_consensus.cc:3060] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.754321 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e69ac6bd9aca4af5aa72d76b4764b14c" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:36.754452 1059 raft_consensus.cc:3060] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.755429 1059 raft_consensus.cc:2468] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:36.755429 1334 raft_consensus.cc:2468] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:36.755927 1133 leader_election.cc:304] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.756304 1565 raft_consensus.cc:2804] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.756400 1565 raft_consensus.cc:697] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:36.756548 1565 consensus_queue.cc:237] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.764595 792 catalog_manager.cc:2174] created HMS catalog entry for table [id=110ed734bb04495784d1d8ca1a7a8498]
I20260317 20:57:36.772210 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 72) took 2133 ms. Trace:
I20260317 20:57:36.772301 792 rpcz_store.cc:276] 0317 20:57:34.638336 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.834892 (+1196556us) service_pool.cc:225] Handling call
0317 20:57:35.953491 (+118599us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:35.953774 (+ 283us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:36.764580 (+810806us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:36.771988 (+ 7408us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:36.772104 (+ 116us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:36.772190 (+ 86us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:36.765248 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:36.765363 (+ 115us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:36.765367 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:36.765369 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:36.765445 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:36.765455 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:36.765458 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:36.765515 (+ 57us) tablet.cc:700] Row locks acquired
0317 20:57:36.765516 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:36.765542 (+ 26us) write_op.cc:270] Start()
0317 20:57:36.765576 (+ 34us) write_op.cc:276] Timestamp: P: 1773781056765309 usec, L: 0
0317 20:57:36.765579 (+ 3us) op_driver.cc:348] REPLICATION: starting
0317 20:57:36.765723 (+ 144us) log.cc:844] Serialized 433 byte log entry
0317 20:57:36.771226 (+ 5503us) op_driver.cc:464] REPLICATION: finished
0317 20:57:36.771324 (+ 98us) write_op.cc:301] APPLY: starting
0317 20:57:36.771343 (+ 19us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:36.771378 (+ 35us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:36.771393 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:36.771488 (+ 95us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:36.771520 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:36.771525 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:36.771594 (+ 69us) log.cc:844] Serialized 29 byte log entry
0317 20:57:36.771652 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.771670 (+ 18us) write_op.cc:454] Released schema lock
0317 20:57:36.771678 (+ 8us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:36.771754 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.771759 (+ 5us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":775473,"Hive Metastore.run_cpu_time_us":221,"Hive Metastore.run_wall_time_us":34959,"child_traces":[["op",{"apply.queue_time_us":57,"apply.run_cpu_time_us":417,"apply.run_wall_time_us":417,"mutex_wait_us":848,"num_ops":2,"prepare.queue_time_us":51,"prepare.run_cpu_time_us":612,"prepare.run_wall_time_us":1448,"raft.queue_time_us":2397,"raft.run_cpu_time_us":600,"raft.run_wall_time_us":604,"replication_time_us":5618}]]}
I20260317 20:57:36.792665 1039 tablet_service.cc:1511] Processing CreateTablet for tablet d498b1efdbca451087928cdb42d06485 (DEFAULT_TABLE table=default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.792799 1314 tablet_service.cc:1511] Processing CreateTablet for tablet d498b1efdbca451087928cdb42d06485 (DEFAULT_TABLE table=default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.793041 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d498b1efdbca451087928cdb42d06485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.793108 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d498b1efdbca451087928cdb42d06485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.795567 1842 tablet_bootstrap.cc:492] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:36.795574 1841 tablet_bootstrap.cc:492] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:36.796691 1842 tablet_bootstrap.cc:654] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.796693 1841 tablet_bootstrap.cc:654] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.798811 1176 tablet_service.cc:1511] Processing CreateTablet for tablet d498b1efdbca451087928cdb42d06485 (DEFAULT_TABLE table=default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.799170 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d498b1efdbca451087928cdb42d06485. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.801795 1843 tablet_bootstrap.cc:492] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:36.803272 1843 tablet_bootstrap.cc:654] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.808255 1843 tablet_bootstrap.cc:492] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:36.808367 1843 ts_tablet_manager.cc:1403] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260317 20:57:36.808879 1843 raft_consensus.cc:359] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.809001 1843 raft_consensus.cc:385] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.809033 1843 raft_consensus.cc:740] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.809151 1843 consensus_queue.cc:260] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.809434 1843 ts_tablet_manager.cc:1434] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.819427 792 catalog_manager.cc:5671] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
W20260317 20:57:36.821216 796 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_881b6f17f7bc4a1ab950e332bd29d36c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:36.822168 799 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 68) took 2528 ms. Trace:
I20260317 20:57:36.822229 799 rpcz_store.cc:276] 0317 20:57:34.294116 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.679724 (+1385608us) service_pool.cc:225] Handling call
0317 20:57:35.922669 (+242945us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:36.821780 (+899111us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:36.821941 (+ 161us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:36.822154 (+ 213us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":19560,"Hive Metastore.run_cpu_time_us":544,"Hive Metastore.run_wall_time_us":104928}
I20260317 20:57:36.822515 799 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_fe83b51f353e4ece951a13044f816de5" } new_table_name: "default.Table_79079ba13bf044beba452a11826c4ca8" modify_external_catalogs: true
I20260317 20:57:36.822870 797 catalog_manager.cc:2174] created HMS catalog entry for table [id=46afec8330f8417e8d3811d32eda4b06]
I20260317 20:57:36.828233 1842 tablet_bootstrap.cc:492] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:36.828347 1842 ts_tablet_manager.cc:1403] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20260317 20:57:36.828888 1842 raft_consensus.cc:359] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.829011 1842 raft_consensus.cc:385] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.829047 1842 raft_consensus.cc:740] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.829293 1842 consensus_queue.cc:260] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.830412 1842 ts_tablet_manager.cc:1434] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:36.830945 1841 tablet_bootstrap.cc:492] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:36.831044 1841 ts_tablet_manager.cc:1403] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20260317 20:57:36.831528 1841 raft_consensus.cc:359] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.831643 1841 raft_consensus.cc:385] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.831681 1841 raft_consensus.cc:740] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.831809 1841 consensus_queue.cc:260] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.832094 1841 ts_tablet_manager.cc:1434] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.848321 797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 74) took 2147 ms. Trace:
I20260317 20:57:36.848423 797 rpcz_store.cc:276] 0317 20:57:34.700416 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.934502 (+1234086us) service_pool.cc:225] Handling call
0317 20:57:36.187419 (+252917us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:36.187812 (+ 393us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:36.822863 (+635051us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:36.848108 (+ 25245us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:36.848204 (+ 96us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:36.848299 (+ 95us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:36.823606 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:36.823673 (+ 67us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:36.823676 (+ 3us) write_op.cc:435] Acquired schema lock
0317 20:57:36.823678 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:36.823727 (+ 49us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:36.823732 (+ 5us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:36.823735 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:36.823776 (+ 41us) tablet.cc:700] Row locks acquired
0317 20:57:36.823778 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:36.823798 (+ 20us) write_op.cc:270] Start()
0317 20:57:36.823822 (+ 24us) write_op.cc:276] Timestamp: P: 1773781056823555 usec, L: 0
0317 20:57:36.823824 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:36.823943 (+ 119us) log.cc:844] Serialized 433 byte log entry
0317 20:57:36.847194 (+ 23251us) op_driver.cc:464] REPLICATION: finished
0317 20:57:36.847797 (+ 603us) write_op.cc:301] APPLY: starting
0317 20:57:36.847806 (+ 9us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:36.847829 (+ 23us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:36.847841 (+ 12us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:36.847918 (+ 77us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:36.847941 (+ 23us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:36.847946 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:36.847988 (+ 42us) log.cc:844] Serialized 29 byte log entry
0317 20:57:36.848019 (+ 31us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.848028 (+ 9us) write_op.cc:454] Released schema lock
0317 20:57:36.848032 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:36.848099 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.848101 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":584122,"Hive Metastore.run_cpu_time_us":177,"Hive Metastore.run_wall_time_us":50773,"child_traces":[["op",{"apply.queue_time_us":573,"apply.run_cpu_time_us":293,"apply.run_wall_time_us":292,"num_ops":2,"prepare.queue_time_us":384,"prepare.run_cpu_time_us":371,"prepare.run_wall_time_us":370,"replication_time_us":23360}]]}
I20260317 20:57:36.849387 791 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 73) took 2188 ms. Trace:
I20260317 20:57:36.849462 791 rpcz_store.cc:276] 0317 20:57:34.660428 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.896941 (+1236513us) service_pool.cc:225] Handling call
0317 20:57:35.950853 (+ 53912us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:36.849048 (+898195us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:36.849199 (+ 151us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:36.849371 (+ 172us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":512743,"Hive Metastore.run_cpu_time_us":509,"Hive Metastore.run_wall_time_us":265511}
I20260317 20:57:36.849694 791 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_3f1239b88bdb48df909e4bc3f433a9bb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:36.858301 797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_143f9036b95c45388916784f134edd5d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:36.859036 1314 tablet_service.cc:1511] Processing CreateTablet for tablet c18f4a20ec004a0dae553e1a1a331947 (DEFAULT_TABLE table=default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.859057 1039 tablet_service.cc:1511] Processing CreateTablet for tablet c18f4a20ec004a0dae553e1a1a331947 (DEFAULT_TABLE table=default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.859370 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18f4a20ec004a0dae553e1a1a331947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.859380 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18f4a20ec004a0dae553e1a1a331947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.859534 792 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_89e9501cdfa143e797b1116ee618deea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:36.861749 1841 tablet_bootstrap.cc:492] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:36.861866 1176 tablet_service.cc:1511] Processing CreateTablet for tablet c18f4a20ec004a0dae553e1a1a331947 (DEFAULT_TABLE table=default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.862166 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c18f4a20ec004a0dae553e1a1a331947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.862828 1841 tablet_bootstrap.cc:654] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.865938 1842 tablet_bootstrap.cc:492] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:36.867157 1842 tablet_bootstrap.cc:654] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.870249 1841 tablet_bootstrap.cc:492] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:36.870386 1841 ts_tablet_manager.cc:1403] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260317 20:57:36.870404 1843 tablet_bootstrap.cc:492] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:36.870937 1841 raft_consensus.cc:359] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.871097 1841 raft_consensus.cc:385] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.871136 1841 raft_consensus.cc:740] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.871270 1841 consensus_queue.cc:260] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.871578 1843 tablet_bootstrap.cc:654] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:36.871606 1841 ts_tablet_manager.cc:1434] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.876214 2028 tablet.cc:1723] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:36.876753 2026 tablet.cc:1723] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:36.877126 2027 tablet.cc:1723] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:36.878436 1842 tablet_bootstrap.cc:492] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:36.878623 1842 ts_tablet_manager.cc:1403] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260317 20:57:36.883268 1806 raft_consensus.cc:493] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.883399 1806 raft_consensus.cc:515] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.883589 1842 raft_consensus.cc:359] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.883701 1842 raft_consensus.cc:385] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.883731 1842 raft_consensus.cc:740] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.883842 1806 leader_election.cc:290] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.883852 1842 consensus_queue.cc:260] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.884228 1842 ts_tablet_manager.cc:1434] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260317 20:57:36.884375 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d498b1efdbca451087928cdb42d06485" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:36.884521 1059 raft_consensus.cc:2468] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.884682 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d498b1efdbca451087928cdb42d06485" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:36.884814 1198 raft_consensus.cc:2468] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:36.885398 1269 leader_election.cc:304] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:36.885578 1806 raft_consensus.cc:2804] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.885649 1806 raft_consensus.cc:493] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.885697 1806 raft_consensus.cc:3060] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.886821 1806 raft_consensus.cc:515] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.887280 1806 leader_election.cc:290] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:36.888424 1843 tablet_bootstrap.cc:492] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:36.888538 1843 ts_tablet_manager.cc:1403] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260317 20:57:36.888697 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d498b1efdbca451087928cdb42d06485" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:36.888806 1198 raft_consensus.cc:3060] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.889112 1843 raft_consensus.cc:359] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.889199 1843 raft_consensus.cc:385] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:36.889226 1843 raft_consensus.cc:740] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:36.889345 1843 consensus_queue.cc:260] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.889626 1843 ts_tablet_manager.cc:1434] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:36.889870 1198 raft_consensus.cc:2468] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.890576 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d498b1efdbca451087928cdb42d06485" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:36.890722 1059 raft_consensus.cc:3060] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.891876 1059 raft_consensus.cc:2468] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:36.892195 1268 leader_election.cc:304] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:36.892565 1806 raft_consensus.cc:2804] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.892664 1806 raft_consensus.cc:697] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:36.892822 1806 consensus_queue.cc:237] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:36.916364 1565 raft_consensus.cc:493] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:36.916538 1565 raft_consensus.cc:515] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.917033 1565 leader_election.cc:290] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.917905 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18f4a20ec004a0dae553e1a1a331947" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:36.917930 1994 consensus_queue.cc:1048] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.918093 1334 raft_consensus.cc:2468] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:36.918509 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18f4a20ec004a0dae553e1a1a331947" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:36.918642 1059 raft_consensus.cc:2468] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:36.918650 1133 leader_election.cc:304] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:36.919057 1565 raft_consensus.cc:2804] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:36.919158 1565 raft_consensus.cc:493] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:36.919198 1565 raft_consensus.cc:3060] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.920339 1565 raft_consensus.cc:515] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.920742 1565 leader_election.cc:290] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:36.921636 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18f4a20ec004a0dae553e1a1a331947" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:36.921789 1059 raft_consensus.cc:3060] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.922994 1059 raft_consensus.cc:2468] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:36.924082 795 catalog_manager.cc:3502] renamed table default.table_a4bf6942f68c4cf1b3a98aa499f6d466 [id=0e789a2f9f64400eb7e38a789e0ec299] in HMS: new name default.table_4b318a4173584e1298cc874712d94e47
I20260317 20:57:36.924611 1819 consensus_queue.cc:1048] T 492e0f23d6b74854bc68f51c8136d495 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.925050 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c18f4a20ec004a0dae553e1a1a331947" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:36.925182 1334 raft_consensus.cc:3060] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:36.926175 1334 raft_consensus.cc:2468] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:36.930122 1133 leader_election.cc:304] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:36.930542 1715 raft_consensus.cc:2804] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:36.930653 1715 raft_consensus.cc:697] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:36.930840 1715 consensus_queue.cc:237] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:36.955150 796 catalog_manager.cc:2174] created HMS catalog entry for table [id=76e2ba1634604600866a199c9879c427]
I20260317 20:57:36.962114 796 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 81) took 1183 ms. Trace:
I20260317 20:57:36.962204 796 rpcz_store.cc:276] 0317 20:57:35.779172 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.971049 (+191877us) service_pool.cc:225] Handling call
0317 20:57:36.821320 (+850271us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:36.821651 (+ 331us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:36.955137 (+133486us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:36.961913 (+ 6776us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:36.961996 (+ 83us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:36.962095 (+ 99us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:36.955747 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:36.955859 (+ 112us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:36.955863 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:36.955865 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:36.955932 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:36.955942 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:36.955946 (+ 4us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:36.955998 (+ 52us) tablet.cc:700] Row locks acquired
0317 20:57:36.955999 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:36.956029 (+ 30us) write_op.cc:270] Start()
0317 20:57:36.956054 (+ 25us) write_op.cc:276] Timestamp: P: 1773781056955756 usec, L: 0
0317 20:57:36.956056 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:36.956204 (+ 148us) log.cc:844] Serialized 433 byte log entry
0317 20:57:36.960333 (+ 4129us) op_driver.cc:464] REPLICATION: finished
0317 20:57:36.961061 (+ 728us) write_op.cc:301] APPLY: starting
0317 20:57:36.961078 (+ 17us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:36.961114 (+ 36us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:36.961126 (+ 12us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:36.961243 (+ 117us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:36.961274 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:36.961278 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:36.961337 (+ 59us) log.cc:844] Serialized 29 byte log entry
0317 20:57:36.961399 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.961414 (+ 15us) write_op.cc:454] Released schema lock
0317 20:57:36.961418 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:36.961478 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:36.961480 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":101614,"Hive Metastore.run_cpu_time_us":219,"Hive Metastore.run_wall_time_us":31598,"child_traces":[["op",{"apply.queue_time_us":687,"apply.run_cpu_time_us":403,"apply.run_wall_time_us":404,"num_ops":2,"prepare.queue_time_us":86,"prepare.run_cpu_time_us":551,"prepare.run_wall_time_us":551,"raft.queue_time_us":389,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":297,"replication_time_us":4252}]]}
I20260317 20:57:36.981978 2026 tablet.cc:1723] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:36.982406 1449 consensus_queue.cc:1048] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:36.985354 2028 tablet.cc:1723] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:36.989614 2027 tablet.cc:1723] T e4124783269f438c803d4fb68f223d20 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:36.995157 796 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd] alter complete (version 1)
I20260317 20:57:36.998256 1314 tablet_service.cc:1511] Processing CreateTablet for tablet dcc244fe79aa45e18427da2be335636a (DEFAULT_TABLE table=default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.998584 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcc244fe79aa45e18427da2be335636a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.998698 1039 tablet_service.cc:1511] Processing CreateTablet for tablet dcc244fe79aa45e18427da2be335636a (DEFAULT_TABLE table=default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:36.998972 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcc244fe79aa45e18427da2be335636a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:36.999184 1715 consensus_queue.cc:1048] T a78fdc83a3d54554a08f01915f102f6e P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.001046 1176 tablet_service.cc:1511] Processing CreateTablet for tablet dcc244fe79aa45e18427da2be335636a (DEFAULT_TABLE table=default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.001168 1841 tablet_bootstrap.cc:492] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.001325 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcc244fe79aa45e18427da2be335636a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.002169 1841 tablet_bootstrap.cc:654] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.004195 1842 tablet_bootstrap.cc:492] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.005245 1842 tablet_bootstrap.cc:654] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.006373 1843 tablet_bootstrap.cc:492] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.006964 1806 consensus_queue.cc:1048] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.007645 1843 tablet_bootstrap.cc:654] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.011190 796 catalog_manager.cc:5671] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:37.014488 1842 tablet_bootstrap.cc:492] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.014604 1842 ts_tablet_manager.cc:1403] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.000s
I20260317 20:57:37.015153 1842 raft_consensus.cc:359] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.018556 1842 raft_consensus.cc:385] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.018688 1842 raft_consensus.cc:740] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.018888 1842 consensus_queue.cc:260] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.023643 1842 ts_tablet_manager.cc:1434] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20260317 20:57:37.025731 1843 tablet_bootstrap.cc:492] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.025830 1843 ts_tablet_manager.cc:1403] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260317 20:57:37.026335 1843 raft_consensus.cc:359] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.026445 1843 raft_consensus.cc:385] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.026479 1843 raft_consensus.cc:740] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.026593 1843 consensus_queue.cc:260] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.026891 1843 ts_tablet_manager.cc:1434] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.026947 796 catalog_manager.cc:5671] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:37.027791 1841 tablet_bootstrap.cc:492] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.027899 1841 ts_tablet_manager.cc:1403] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.002s
I20260317 20:57:37.028405 1841 raft_consensus.cc:359] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.028510 1841 raft_consensus.cc:385] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.028539 1841 raft_consensus.cc:740] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.028654 1841 consensus_queue.cc:260] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.028891 1841 ts_tablet_manager.cc:1434] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.031517 1462 consensus_queue.cc:1048] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.054942 796 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299] alter complete (version 1)
I20260317 20:57:37.062495 796 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_8cc9c66b97034de7b01437aced6119ed" } modify_external_catalogs: true
I20260317 20:57:37.062829 796 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_8cc9c66b97034de7b01437aced6119ed" } modify_external_catalogs: true
I20260317 20:57:37.074795 793 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_4993eb4cbf8d4cd28646b149b3c141bb [id=29839ff707bc4e67aec781e8653ff8f6]
I20260317 20:57:37.119853 794 catalog_manager.cc:3502] renamed table default.table_e63b5215dfe141f78d97647d4e83411d [id=b4359316a03b48bcb97b2d377b1c5c93] in HMS: new name default.table_59673e06fbb64ab38291807c2e04e319
I20260317 20:57:37.128997 1819 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.129168 1819 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.129722 1819 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.130689 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc244fe79aa45e18427da2be335636a" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:37.130897 1198 raft_consensus.cc:2468] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.131479 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc244fe79aa45e18427da2be335636a" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:37.131640 1332 raft_consensus.cc:2468] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.132339 996 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.132890 1819 raft_consensus.cc:2804] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.132951 1819 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.132984 1819 raft_consensus.cc:3060] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.134382 1819 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.134843 1819 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.135460 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc244fe79aa45e18427da2be335636a" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:37.135594 1198 raft_consensus.cc:3060] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.136669 1198 raft_consensus.cc:2468] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.137317 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcc244fe79aa45e18427da2be335636a" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:37.137446 1332 raft_consensus.cc:3060] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.138557 1332 raft_consensus.cc:2468] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.139010 995 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.139300 1819 raft_consensus.cc:2804] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.139389 1819 raft_consensus.cc:697] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:37.139807 1819 consensus_queue.cc:237] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.152519 798 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_bfa0dd2ccbe04d26bb5885d568cd2393 [id=262f037e46644a98890abee1b764ba1e]
I20260317 20:57:37.161851 1449 consensus_queue.cc:1048] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.170506 1715 consensus_queue.cc:1048] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.199699 800 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]
I20260317 20:57:37.203332 948 catalog_manager.cc:2772] Deleting table default.table_4993eb4cbf8d4cd28646b149b3c141bb [id=29839ff707bc4e67aec781e8653ff8f6] in response to Hive Metastore notification log event 57
I20260317 20:57:37.209654 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 6ebf9468b8a04a49ae2938fa8ea0334d
I20260317 20:57:37.212040 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ebf9468b8a04a49ae2938fa8ea0334d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.212035 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ebf9468b8a04a49ae2938fa8ea0334d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.212356 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet 6ebf9468b8a04a49ae2938fa8ea0334d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.213716 2050 tablet_replica.cc:333] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.213943 2050 raft_consensus.cc:2243] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.214298 2050 raft_consensus.cc:2272] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.214769 2050 ts_tablet_manager.cc:1916] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.217311 948 catalog_manager.cc:2772] Deleting table default.table_bfa0dd2ccbe04d26bb5885d568cd2393 [id=262f037e46644a98890abee1b764ba1e] in response to Hive Metastore notification log event 59
I20260317 20:57:37.217934 2050 ts_tablet_manager.cc:1929] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.218925 2049 tablet_replica.cc:333] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.219094 2049 raft_consensus.cc:2243] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.219255 2049 raft_consensus.cc:2272] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.219623 2049 ts_tablet_manager.cc:1916] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.221242 2051 tablet_replica.cc:333] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.221462 2051 raft_consensus.cc:2243] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.221644 2051 raft_consensus.cc:2272] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.222173 2051 ts_tablet_manager.cc:1916] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.225063 2051 ts_tablet_manager.cc:1929] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.225190 2051 log.cc:1199] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/6ebf9468b8a04a49ae2938fa8ea0334d
I20260317 20:57:37.226414 2050 log.cc:1199] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/6ebf9468b8a04a49ae2938fa8ea0334d
I20260317 20:57:37.227177 2050 ts_tablet_manager.cc:1950] T 6ebf9468b8a04a49ae2938fa8ea0334d P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.227757 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 6891158271934f21b1f08d094622976e
I20260317 20:57:37.228451 948 catalog_manager.cc:2772] Deleting table default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c] in response to Hive Metastore notification log event 60
I20260317 20:57:37.228726 2049 ts_tablet_manager.cc:1929] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.228827 2049 log.cc:1199] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/6ebf9468b8a04a49ae2938fa8ea0334d
I20260317 20:57:37.229082 2049 ts_tablet_manager.cc:1950] T 6ebf9468b8a04a49ae2938fa8ea0334d P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.228339 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet 6891158271934f21b1f08d094622976e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.229554 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 6ebf9468b8a04a49ae2938fa8ea0334d (table default.table_4993eb4cbf8d4cd28646b149b3c141bb [id=29839ff707bc4e67aec781e8653ff8f6]) successfully deleted
I20260317 20:57:37.229810 2051 ts_tablet_manager.cc:1950] T 6ebf9468b8a04a49ae2938fa8ea0334d P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.230073 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 6891158271934f21b1f08d094622976e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.230403 2049 tablet_replica.cc:333] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.230547 2051 tablet_replica.cc:333] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.230625 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 6ebf9468b8a04a49ae2938fa8ea0334d (table default.table_4993eb4cbf8d4cd28646b149b3c141bb [id=29839ff707bc4e67aec781e8653ff8f6]) successfully deleted
I20260317 20:57:37.230726 2051 raft_consensus.cc:2243] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.230952 2051 raft_consensus.cc:2272] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.231068 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 6ebf9468b8a04a49ae2938fa8ea0334d (table default.table_4993eb4cbf8d4cd28646b149b3c141bb [id=29839ff707bc4e67aec781e8653ff8f6]) successfully deleted
I20260317 20:57:37.231166 2049 raft_consensus.cc:2243] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.231281 2049 raft_consensus.cc:2272] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.231437 2051 ts_tablet_manager.cc:1916] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.231738 2049 ts_tablet_manager.cc:1916] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.233206 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet 6891158271934f21b1f08d094622976e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.233429 2050 tablet_replica.cc:333] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.233577 2050 raft_consensus.cc:2243] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.233721 2050 raft_consensus.cc:2272] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.234102 2049 ts_tablet_manager.cc:1929] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260317 20:57:37.234216 2049 log.cc:1199] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/6891158271934f21b1f08d094622976e
I20260317 20:57:37.234350 2050 ts_tablet_manager.cc:1916] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.234508 2049 ts_tablet_manager.cc:1950] T 6891158271934f21b1f08d094622976e P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.235365 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 6891158271934f21b1f08d094622976e (table default.table_bfa0dd2ccbe04d26bb5885d568cd2393 [id=262f037e46644a98890abee1b764ba1e]) successfully deleted
I20260317 20:57:37.237469 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 2b12559c4b7a44888963ef37d705513f
I20260317 20:57:37.238157 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b12559c4b7a44888963ef37d705513f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.238157 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b12559c4b7a44888963ef37d705513f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.237977 2050 ts_tablet_manager.cc:1929] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260317 20:57:37.238332 2050 log.cc:1199] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/6891158271934f21b1f08d094622976e
I20260317 20:57:37.238449 2049 tablet_replica.cc:333] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.238646 2049 raft_consensus.cc:2243] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.238682 2050 ts_tablet_manager.cc:1950] T 6891158271934f21b1f08d094622976e P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.238816 2049 raft_consensus.cc:2272] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.240089 2051 ts_tablet_manager.cc:1929] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260317 20:57:37.240223 2049 ts_tablet_manager.cc:1916] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.241014 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 6891158271934f21b1f08d094622976e (table default.table_bfa0dd2ccbe04d26bb5885d568cd2393 [id=262f037e46644a98890abee1b764ba1e]) successfully deleted
I20260317 20:57:37.241238 2051 log.cc:1199] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/6891158271934f21b1f08d094622976e
I20260317 20:57:37.242115 2051 ts_tablet_manager.cc:1950] T 6891158271934f21b1f08d094622976e P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.242587 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b12559c4b7a44888963ef37d705513f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.242797 2050 tablet_replica.cc:333] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.242971 2050 raft_consensus.cc:2243] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.243278 2050 raft_consensus.cc:2272] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.243379 2049 ts_tablet_manager.cc:1929] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.243495 2049 log.cc:1199] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/2b12559c4b7a44888963ef37d705513f
I20260317 20:57:37.243815 2049 ts_tablet_manager.cc:1950] T 2b12559c4b7a44888963ef37d705513f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.243971 2050 ts_tablet_manager.cc:1916] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260317 20:57:37.244176 791 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3f1239b88bdb48df909e4bc3f433a9bb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:37.245043 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 2b12559c4b7a44888963ef37d705513f (table default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]) successfully deleted
W20260317 20:57:37.245455 797 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_143f9036b95c45388916784f134edd5d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:37.245463 792 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_89e9501cdfa143e797b1116ee618deea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:37.245899 795 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 77) took 2505 ms. Trace:
I20260317 20:57:37.245963 795 rpcz_store.cc:276] 0317 20:57:34.740769 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:35.949806 (+1209037us) service_pool.cc:225] Handling call
0317 20:57:36.820823 (+871017us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.245560 (+424737us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.245729 (+ 169us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:37.245886 (+ 157us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":4902,"Hive Metastore.run_cpu_time_us":459,"Hive Metastore.run_wall_time_us":97438}
I20260317 20:57:37.246634 2051 tablet_replica.cc:333] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.246724 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 6891158271934f21b1f08d094622976e (table default.table_bfa0dd2ccbe04d26bb5885d568cd2393 [id=262f037e46644a98890abee1b764ba1e]) successfully deleted
I20260317 20:57:37.246910 2051 raft_consensus.cc:2243] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.246850 795 catalog_manager.cc:5671] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:37.247066 2051 raft_consensus.cc:2272] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.248204 2050 ts_tablet_manager.cc:1929] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.248308 2050 log.cc:1199] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/2b12559c4b7a44888963ef37d705513f
I20260317 20:57:37.248854 2051 ts_tablet_manager.cc:1916] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.251894 2050 ts_tablet_manager.cc:1950] T 2b12559c4b7a44888963ef37d705513f P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.252701 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 2b12559c4b7a44888963ef37d705513f (table default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]) successfully deleted
I20260317 20:57:37.253839 2051 ts_tablet_manager.cc:1929] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.253976 2051 log.cc:1199] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/2b12559c4b7a44888963ef37d705513f
I20260317 20:57:37.254335 2051 ts_tablet_manager.cc:1950] T 2b12559c4b7a44888963ef37d705513f P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.254796 795 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_395f00deaf674e7cac8e63f23538af32" } modify_external_catalogs: true
I20260317 20:57:37.254933 795 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_395f00deaf674e7cac8e63f23538af32" } modify_external_catalogs: true
I20260317 20:57:37.255268 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 2b12559c4b7a44888963ef37d705513f (table default.table_5e656cced82044008854c0c5271d95d0 [id=ca7b69998d7a40afbb2b2cf254ba261c]) successfully deleted
I20260317 20:57:37.259084 2027 tablet.cc:1723] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:37.267338 2028 tablet.cc:1723] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:37.267717 2026 tablet.cc:1723] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:37.294637 799 catalog_manager.cc:3502] renamed table default.table_fe83b51f353e4ece951a13044f816de5 [id=7eb5962822e84dfd9a9180115824aeb3] in HMS: new name default.table_79079ba13bf044beba452a11826c4ca8
I20260317 20:57:37.315160 791 catalog_manager.cc:2174] created HMS catalog entry for table [id=4c6775ab37ed4575bdfbcf3930e3acd2]
I20260317 20:57:37.323575 791 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 87) took 1313 ms. Trace:
I20260317 20:57:37.323669 791 rpcz_store.cc:276] 0317 20:57:36.010478 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:36.849605 (+839127us) service_pool.cc:225] Handling call
0317 20:57:37.244286 (+394681us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:37.244685 (+ 399us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:37.315147 (+ 70462us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:37.323378 (+ 8231us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:37.323476 (+ 98us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:37.323555 (+ 79us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.315855 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.315973 (+ 118us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.315978 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:37.315979 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:37.316049 (+ 70us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.316060 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.316063 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.316124 (+ 61us) tablet.cc:700] Row locks acquired
0317 20:57:37.316125 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:37.316158 (+ 33us) write_op.cc:270] Start()
0317 20:57:37.316191 (+ 33us) write_op.cc:276] Timestamp: P: 1773781057315287 usec, L: 0
0317 20:57:37.316193 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.316372 (+ 179us) log.cc:844] Serialized 433 byte log entry
0317 20:57:37.321351 (+ 4979us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.321450 (+ 99us) write_op.cc:301] APPLY: starting
0317 20:57:37.321468 (+ 18us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.321501 (+ 33us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.321516 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.321595 (+ 79us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.321624 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:37.321628 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:37.321694 (+ 66us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.321761 (+ 67us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.321777 (+ 16us) write_op.cc:454] Released schema lock
0317 20:57:37.321781 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.321850 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.321853 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":49861,"Hive Metastore.run_cpu_time_us":261,"Hive Metastore.run_wall_time_us":20312,"child_traces":[["op",{"apply.queue_time_us":54,"apply.run_cpu_time_us":379,"apply.run_wall_time_us":378,"num_ops":2,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":648,"prepare.run_wall_time_us":648,"raft.queue_time_us":625,"raft.run_cpu_time_us":531,"raft.run_wall_time_us":529,"replication_time_us":5130,"spinlock_wait_cycles":106752}]]}
I20260317 20:57:37.336205 1314 tablet_service.cc:1511] Processing CreateTablet for tablet b5739d6cb9a84de78767b471608f1671 (DEFAULT_TABLE table=default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.336229 1039 tablet_service.cc:1511] Processing CreateTablet for tablet b5739d6cb9a84de78767b471608f1671 (DEFAULT_TABLE table=default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.336545 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5739d6cb9a84de78767b471608f1671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.336550 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5739d6cb9a84de78767b471608f1671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.339389 1842 tablet_bootstrap.cc:492] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.339341 1176 tablet_service.cc:1511] Processing CreateTablet for tablet b5739d6cb9a84de78767b471608f1671 (DEFAULT_TABLE table=default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.339628 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5739d6cb9a84de78767b471608f1671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.340454 1842 tablet_bootstrap.cc:654] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.341246 1841 tablet_bootstrap.cc:492] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.342344 1841 tablet_bootstrap.cc:654] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.343123 1843 tablet_bootstrap.cc:492] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.344185 1843 tablet_bootstrap.cc:654] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.344345 791 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93] alter complete (version 2)
I20260317 20:57:37.350666 800 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 83) took 1466 ms. Trace:
I20260317 20:57:37.350780 800 rpcz_store.cc:276] 0317 20:57:35.883772 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:36.315587 (+431815us) service_pool.cc:225] Handling call
0317 20:57:36.848689 (+533102us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.350643 (+501954us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":302188,"Hive Metastore.run_cpu_time_us":154,"Hive Metastore.run_wall_time_us":47130,"mutex_wait_us":1414}
I20260317 20:57:37.351295 794 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 84) took 1467 ms. Trace:
I20260317 20:57:37.351363 794 rpcz_store.cc:276] 0317 20:57:35.883842 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:36.379386 (+495544us) service_pool.cc:225] Handling call
0317 20:57:36.848752 (+469366us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.350871 (+502119us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.351058 (+ 187us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:37.351279 (+ 221us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":225855,"Hive Metastore.run_cpu_time_us":622,"Hive Metastore.run_wall_time_us":44933}
I20260317 20:57:37.351536 794 master_service.cc:954] ReplaceTablet: received request to replace tablet 71ed1a25a2d849eba1adb7ebf2c6a733 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:37.351694 798 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 85) took 1467 ms. Trace:
I20260317 20:57:37.351754 798 rpcz_store.cc:276] 0317 20:57:35.883896 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:36.619773 (+735877us) service_pool.cc:225] Handling call
0317 20:57:36.848952 (+229179us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.351685 (+502733us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":270759,"Hive Metastore.run_cpu_time_us":229,"Hive Metastore.run_wall_time_us":32568}
I20260317 20:57:37.351918 798 master_service.cc:954] ReplaceTablet: received request to replace tablet ac00453b303f4af780abc0f39f0f0ada from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:37.350672 793 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 82) took 1477 ms. Trace:
I20260317 20:57:37.352692 793 rpcz_store.cc:276] 0317 20:57:35.873398 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:36.215123 (+341725us) service_pool.cc:225] Handling call
0317 20:57:36.848547 (+633424us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.350666 (+502119us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":110915,"Hive Metastore.run_cpu_time_us":181,"Hive Metastore.run_wall_time_us":115153}
I20260317 20:57:37.352851 793 master_service.cc:954] ReplaceTablet: received request to replace tablet 6891158271934f21b1f08d094622976e from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:37.353081 793 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 94) took 1182 ms. Trace:
I20260317 20:57:37.353127 793 rpcz_store.cc:276] 0317 20:57:36.170870 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.352820 (+1181950us) service_pool.cc:225] Handling call
0317 20:57:37.353069 (+ 249us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260317 20:57:37.353248 793 master_service.cc:954] ReplaceTablet: received request to replace tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:37.353621 1843 tablet_bootstrap.cc:492] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.353703 1841 tablet_bootstrap.cc:492] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.353726 1843 ts_tablet_manager.cc:1403] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260317 20:57:37.353783 1841 ts_tablet_manager.cc:1403] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260317 20:57:37.354296 1843 raft_consensus.cc:359] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.354296 1841 raft_consensus.cc:359] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.354414 1843 raft_consensus.cc:385] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.354414 1841 raft_consensus.cc:385] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.354449 1841 raft_consensus.cc:740] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.354449 1843 raft_consensus.cc:740] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.354570 1841 consensus_queue.cc:260] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.354590 1843 consensus_queue.cc:260] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.354854 1843 ts_tablet_manager.cc:1434] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.354854 1841 ts_tablet_manager.cc:1434] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.361629 798 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet ac00453b303f4af780abc0f39f0f0ada
I20260317 20:57:37.361991 798 catalog_manager.cc:6741] ReplaceTablet: tablet ac00453b303f4af780abc0f39f0f0ada deleted and replaced by tablet 1947a091d5c8450abb0b7ed7acc05136
I20260317 20:57:37.362504 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet ac00453b303f4af780abc0f39f0f0ada with delete_type TABLET_DATA_DELETED (replaced by tablet 1947a091d5c8450abb0b7ed7acc05136) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.362646 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet ac00453b303f4af780abc0f39f0f0ada with delete_type TABLET_DATA_DELETED (replaced by tablet 1947a091d5c8450abb0b7ed7acc05136) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.362789 2050 tablet_replica.cc:333] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.362836 2049 tablet_replica.cc:333] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.362933 2050 raft_consensus.cc:2243] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.362974 2049 raft_consensus.cc:2243] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.363051 2050 raft_consensus.cc:2272] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.363075 2049 raft_consensus.cc:2272] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.363463 2050 ts_tablet_manager.cc:1916] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.363463 2049 ts_tablet_manager.cc:1916] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.364992 798 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 93) took 1202 ms. Trace:
I20260317 20:57:37.365065 798 rpcz_store.cc:276] 0317 20:57:36.162754 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.351899 (+1189145us) service_pool.cc:225] Handling call
0317 20:57:37.364975 (+ 13076us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.355139 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.355255 (+ 116us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.355280 (+ 25us) write_op.cc:435] Acquired schema lock
0317 20:57:37.355281 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:37.355369 (+ 88us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.355380 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.355383 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.355437 (+ 54us) tablet.cc:700] Row locks acquired
0317 20:57:37.355439 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:37.355471 (+ 32us) write_op.cc:270] Start()
0317 20:57:37.355499 (+ 28us) write_op.cc:276] Timestamp: P: 1773781057354592 usec, L: 0
0317 20:57:37.355501 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.355637 (+ 136us) log.cc:844] Serialized 662 byte log entry
0317 20:57:37.360680 (+ 5043us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.361030 (+ 350us) write_op.cc:301] APPLY: starting
0317 20:57:37.361050 (+ 20us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.361080 (+ 30us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.361095 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.361175 (+ 80us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.361214 (+ 39us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0317 20:57:37.361218 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:37.361277 (+ 59us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.361343 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.361360 (+ 17us) write_op.cc:454] Released schema lock
0317 20:57:37.361366 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.361441 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.361444 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":294,"apply.run_cpu_time_us":408,"apply.run_wall_time_us":408,"num_ops":2,"prepare.queue_time_us":2506,"prepare.run_cpu_time_us":642,"prepare.run_wall_time_us":3924,"raft.queue_time_us":433,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":477,"replication_time_us":5153}]]}
I20260317 20:57:37.365849 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet ac00453b303f4af780abc0f39f0f0ada with delete_type TABLET_DATA_DELETED (replaced by tablet 1947a091d5c8450abb0b7ed7acc05136) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.366079 2051 tablet_replica.cc:333] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.366245 2051 raft_consensus.cc:2243] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.366461 2051 raft_consensus.cc:2272] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.366523 798 master_service.cc:954] ReplaceTablet: received request to replace tablet e58ac81836d94bae906e753352c28ff7 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:37.366896 2051 ts_tablet_manager.cc:1916] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.369501 793 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet dd37fcd2fe5b4c4fbb739aa7fd75a517
I20260317 20:57:37.369854 793 catalog_manager.cc:6741] ReplaceTablet: tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 deleted and replaced by tablet fc76f8e8a4af47aba2a64bd60fc6941f
I20260317 20:57:37.369921 793 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 95) took 1199 ms. Trace:
I20260317 20:57:37.369961 793 rpcz_store.cc:276] 0317 20:57:36.170926 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.353233 (+1182307us) service_pool.cc:225] Handling call
0317 20:57:37.369913 (+ 16680us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.359094 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.359207 (+ 113us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.359211 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:37.359212 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:37.359297 (+ 85us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.359307 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.359310 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.359368 (+ 58us) tablet.cc:700] Row locks acquired
0317 20:57:37.359369 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:37.359397 (+ 28us) write_op.cc:270] Start()
0317 20:57:37.359425 (+ 28us) write_op.cc:276] Timestamp: P: 1773781057358519 usec, L: 0
0317 20:57:37.359427 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.359567 (+ 140us) log.cc:844] Serialized 662 byte log entry
0317 20:57:37.368508 (+ 8941us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.368926 (+ 418us) write_op.cc:301] APPLY: starting
0317 20:57:37.368946 (+ 20us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.368977 (+ 31us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.368992 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.369070 (+ 78us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.369111 (+ 41us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0317 20:57:37.369116 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:37.369183 (+ 67us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.369245 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.369261 (+ 16us) write_op.cc:454] Released schema lock
0317 20:57:37.369266 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.369329 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.369331 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":359,"apply.run_cpu_time_us":400,"apply.run_wall_time_us":401,"num_ops":2,"prepare.queue_time_us":5196,"prepare.run_cpu_time_us":536,"prepare.run_wall_time_us":535,"replication_time_us":9053}]]}
I20260317 20:57:37.370348 793 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_679a54af9b06407d9c33d94b850dc43b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:37.371289 2049 ts_tablet_manager.cc:1929] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.371372 2049 log.cc:1199] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/ac00453b303f4af780abc0f39f0f0ada
I20260317 20:57:37.371654 2049 ts_tablet_manager.cc:1950] T ac00453b303f4af780abc0f39f0f0ada P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.371814 2051 ts_tablet_manager.cc:1929] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.371891 2051 log.cc:1199] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/ac00453b303f4af780abc0f39f0f0ada
I20260317 20:57:37.371860 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 with delete_type TABLET_DATA_DELETED (replaced by tablet fc76f8e8a4af47aba2a64bd60fc6941f) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.371903 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 with delete_type TABLET_DATA_DELETED (replaced by tablet fc76f8e8a4af47aba2a64bd60fc6941f) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.372159 2051 ts_tablet_manager.cc:1950] T ac00453b303f4af780abc0f39f0f0ada P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.372712 2049 tablet_replica.cc:333] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.372691 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 with delete_type TABLET_DATA_DELETED (replaced by tablet fc76f8e8a4af47aba2a64bd60fc6941f) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.372843 2049 raft_consensus.cc:2243] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.372857 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet ac00453b303f4af780abc0f39f0f0ada (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]) successfully deleted
I20260317 20:57:37.372957 2049 raft_consensus.cc:2272] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.373176 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet ac00453b303f4af780abc0f39f0f0ada (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]) successfully deleted
I20260317 20:57:37.373385 2051 tablet_replica.cc:333] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.373528 2051 raft_consensus.cc:2243] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.373629 2051 raft_consensus.cc:2272] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.373831 2049 ts_tablet_manager.cc:1916] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.374188 2051 ts_tablet_manager.cc:1916] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.376624 2049 ts_tablet_manager.cc:1929] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:37.376703 2049 log.cc:1199] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/dd37fcd2fe5b4c4fbb739aa7fd75a517
I20260317 20:57:37.376957 2049 ts_tablet_manager.cc:1950] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.377453 2051 ts_tablet_manager.cc:1929] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:37.377736 1565 raft_consensus.cc:493] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.377817 1565 raft_consensus.cc:515] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.378259 1565 leader_election.cc:290] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.378371 2050 ts_tablet_manager.cc:1929] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.378446 2050 log.cc:1199] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/ac00453b303f4af780abc0f39f0f0ada
I20260317 20:57:37.378701 2050 ts_tablet_manager.cc:1950] T ac00453b303f4af780abc0f39f0f0ada P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.378849 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5739d6cb9a84de78767b471608f1671" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:37.378855 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5739d6cb9a84de78767b471608f1671" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:37.378983 1060 raft_consensus.cc:2468] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:37.379348 2050 tablet_replica.cc:333] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.379349 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]) successfully deleted
I20260317 20:57:37.379474 2050 raft_consensus.cc:2243] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.379510 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet ac00453b303f4af780abc0f39f0f0ada (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]) successfully deleted
I20260317 20:57:37.379632 1133 leader_election.cc:304] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.379648 2050 raft_consensus.cc:2272] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260317 20:57:37.379837 1133 leader_election.cc:343] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:37.379969 1565 raft_consensus.cc:2804] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.380003 2051 log.cc:1199] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/dd37fcd2fe5b4c4fbb739aa7fd75a517
I20260317 20:57:37.380020 1565 raft_consensus.cc:493] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.380031 792 catalog_manager.cc:2174] created HMS catalog entry for table [id=d7c13d82129f4480806573f2a089e113]
I20260317 20:57:37.380062 1565 raft_consensus.cc:3060] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.380293 2051 ts_tablet_manager.cc:1950] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.380927 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]) successfully deleted
I20260317 20:57:37.381070 1565 raft_consensus.cc:515] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.381460 1565 leader_election.cc:290] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.381598 800 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_7ae68704f7cd4052955e0c7a7a3fd162"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:37.382942 2050 ts_tablet_manager.cc:1916] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.383677 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5739d6cb9a84de78767b471608f1671" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:37.383809 1060 raft_consensus.cc:3060] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.384959 1060 raft_consensus.cc:2468] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:37.385282 1133 leader_election.cc:304] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.385459 1565 raft_consensus.cc:2804] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.385535 1565 raft_consensus.cc:697] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:37.385665 1565 consensus_queue.cc:237] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.383356 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5739d6cb9a84de78767b471608f1671" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
W20260317 20:57:37.390270 1133 leader_election.cc:343] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:37.390894 2050 ts_tablet_manager.cc:1929] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:37.391036 2050 log.cc:1199] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/dd37fcd2fe5b4c4fbb739aa7fd75a517
I20260317 20:57:37.391388 2050 ts_tablet_manager.cc:1950] T dd37fcd2fe5b4c4fbb739aa7fd75a517 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.392225 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet dd37fcd2fe5b4c4fbb739aa7fd75a517 (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]) successfully deleted
I20260317 20:57:37.393101 1842 tablet_bootstrap.cc:492] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.393082 2027 tablet.cc:1723] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:37.393199 1842 ts_tablet_manager.cc:1403] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20260317 20:57:37.393693 1842 raft_consensus.cc:359] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.393822 1842 raft_consensus.cc:385] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.393862 1842 raft_consensus.cc:740] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.393977 1842 consensus_queue.cc:260] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.394119 2028 tablet.cc:1723] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:37.394277 1842 ts_tablet_manager.cc:1434] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.398381 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 89) took 1272 ms. Trace:
I20260317 20:57:37.398460 792 rpcz_store.cc:276] 0317 20:57:36.125848 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:36.859457 (+733609us) service_pool.cc:225] Handling call
0317 20:57:37.245782 (+386325us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:37.246099 (+ 317us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:37.380025 (+133926us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:37.398206 (+ 18181us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:37.398297 (+ 91us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:37.398364 (+ 67us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.387492 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.387565 (+ 73us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.387568 (+ 3us) write_op.cc:435] Acquired schema lock
0317 20:57:37.387569 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:37.387617 (+ 48us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.387625 (+ 8us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.387630 (+ 5us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.387671 (+ 41us) tablet.cc:700] Row locks acquired
0317 20:57:37.387672 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:37.387693 (+ 21us) write_op.cc:270] Start()
0317 20:57:37.387714 (+ 21us) write_op.cc:276] Timestamp: P: 1773781057386810 usec, L: 0
0317 20:57:37.387715 (+ 1us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.387819 (+ 104us) log.cc:844] Serialized 433 byte log entry
0317 20:57:37.397068 (+ 9249us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.397543 (+ 475us) write_op.cc:301] APPLY: starting
0317 20:57:37.397551 (+ 8us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.397571 (+ 20us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.397581 (+ 10us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.397647 (+ 66us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.397693 (+ 46us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:37.397700 (+ 7us) write_op.cc:312] APPLY: finished
0317 20:57:37.397741 (+ 41us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.397770 (+ 29us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.397778 (+ 8us) write_op.cc:454] Released schema lock
0317 20:57:37.397782 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.397835 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.397838 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":72955,"Hive Metastore.run_cpu_time_us":187,"Hive Metastore.run_wall_time_us":60726,"spinlock_wait_cycles":4352,"child_traces":[["op",{"apply.queue_time_us":453,"apply.run_cpu_time_us":280,"apply.run_wall_time_us":280,"num_ops":2,"prepare.queue_time_us":7086,"prepare.run_cpu_time_us":372,"prepare.run_wall_time_us":371,"replication_time_us":9339}]]}
I20260317 20:57:37.403957 794 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 71ed1a25a2d849eba1adb7ebf2c6a733
I20260317 20:57:37.404215 794 catalog_manager.cc:6741] ReplaceTablet: tablet 71ed1a25a2d849eba1adb7ebf2c6a733 deleted and replaced by tablet 4dbe1ef827b545dfa7a4aba06e254a03
I20260317 20:57:37.404273 794 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 92) took 1245 ms. Trace:
I20260317 20:57:37.404310 794 rpcz_store.cc:276] 0317 20:57:36.158682 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.351514 (+1192832us) service_pool.cc:225] Handling call
0317 20:57:37.404264 (+ 52750us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.387894 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.387964 (+ 70us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.387967 (+ 3us) write_op.cc:435] Acquired schema lock
0317 20:57:37.387969 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:37.388025 (+ 56us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.388031 (+ 6us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.388034 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.388070 (+ 36us) tablet.cc:700] Row locks acquired
0317 20:57:37.388071 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:37.388094 (+ 23us) write_op.cc:270] Start()
0317 20:57:37.388114 (+ 20us) write_op.cc:276] Timestamp: P: 1773781057387211 usec, L: 0
0317 20:57:37.388116 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.388213 (+ 97us) log.cc:844] Serialized 662 byte log entry
0317 20:57:37.397101 (+ 8888us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.397885 (+ 784us) write_op.cc:301] APPLY: starting
0317 20:57:37.397895 (+ 10us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.397916 (+ 21us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.397930 (+ 14us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.397986 (+ 56us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.398021 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0317 20:57:37.398024 (+ 3us) write_op.cc:312] APPLY: finished
0317 20:57:37.401099 (+ 3075us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.401137 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.401160 (+ 23us) write_op.cc:454] Released schema lock
0317 20:57:37.401164 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.401226 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.401228 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":757,"apply.run_cpu_time_us":345,"apply.run_wall_time_us":3330,"num_ops":2,"prepare.queue_time_us":5262,"prepare.run_cpu_time_us":354,"prepare.run_wall_time_us":354,"replication_time_us":8976}]]}
I20260317 20:57:37.405786 1314 tablet_service.cc:1511] Processing CreateTablet for tablet fc76f8e8a4af47aba2a64bd60fc6941f (DEFAULT_TABLE table=default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.406132 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc76f8e8a4af47aba2a64bd60fc6941f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.406137 1039 tablet_service.cc:1511] Processing CreateTablet for tablet fc76f8e8a4af47aba2a64bd60fc6941f (DEFAULT_TABLE table=default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.406271 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ed1a25a2d849eba1adb7ebf2c6a733 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dbe1ef827b545dfa7a4aba06e254a03) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.406396 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc76f8e8a4af47aba2a64bd60fc6941f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.406524 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 1947a091d5c8450abb0b7ed7acc05136 (DEFAULT_TABLE table=default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.406723 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1947a091d5c8450abb0b7ed7acc05136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.408474 2049 tablet_replica.cc:333] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.408589 2049 raft_consensus.cc:2243] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.408614 1312 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ed1a25a2d849eba1adb7ebf2c6a733 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dbe1ef827b545dfa7a4aba06e254a03) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.408702 2049 raft_consensus.cc:2272] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.408891 1842 tablet_bootstrap.cc:492] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.408890 1841 tablet_bootstrap.cc:492] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.408850 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 1947a091d5c8450abb0b7ed7acc05136 (DEFAULT_TABLE table=default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.409077 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1947a091d5c8450abb0b7ed7acc05136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.409907 1841 tablet_bootstrap.cc:654] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.409914 1842 tablet_bootstrap.cc:654] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.410518 2050 tablet_replica.cc:333] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.410643 2050 raft_consensus.cc:2243] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.410667 2049 ts_tablet_manager.cc:1916] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.410753 2050 raft_consensus.cc:2272] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.411317 2050 ts_tablet_manager.cc:1916] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.412873 2049 ts_tablet_manager.cc:1929] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260317 20:57:37.412945 2049 log.cc:1199] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/71ed1a25a2d849eba1adb7ebf2c6a733
I20260317 20:57:37.413213 2049 ts_tablet_manager.cc:1950] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.413306 2050 ts_tablet_manager.cc:1929] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260317 20:57:37.413372 2050 log.cc:1199] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/71ed1a25a2d849eba1adb7ebf2c6a733
I20260317 20:57:37.413609 2050 ts_tablet_manager.cc:1950] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.415678 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 71ed1a25a2d849eba1adb7ebf2c6a733 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]) successfully deleted
I20260317 20:57:37.417577 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 71ed1a25a2d849eba1adb7ebf2c6a733 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]) successfully deleted
I20260317 20:57:37.420955 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 71ed1a25a2d849eba1adb7ebf2c6a733 with delete_type TABLET_DATA_DELETED (replaced by tablet 4dbe1ef827b545dfa7a4aba06e254a03) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.421123 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 1947a091d5c8450abb0b7ed7acc05136 (DEFAULT_TABLE table=default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.421336 2051 tablet_replica.cc:333] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.421329 798 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet e58ac81836d94bae906e753352c28ff7
I20260317 20:57:37.421461 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1947a091d5c8450abb0b7ed7acc05136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.421613 2051 raft_consensus.cc:2243] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.421697 798 catalog_manager.cc:6741] ReplaceTablet: tablet e58ac81836d94bae906e753352c28ff7 deleted and replaced by tablet fd30c05f47bd41eebebbf27844cf4fc6
I20260317 20:57:37.421784 798 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:57868 (request call id 96) took 1242 ms. Trace:
I20260317 20:57:37.421972 2051 raft_consensus.cc:2272] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.421834 798 rpcz_store.cc:276] 0317 20:57:36.179585 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.366498 (+1186913us) service_pool.cc:225] Handling call
0317 20:57:37.421773 (+ 55275us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.382007 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.382150 (+ 143us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.382155 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:37.382157 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:37.382244 (+ 87us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.382254 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.382257 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.382312 (+ 55us) tablet.cc:700] Row locks acquired
0317 20:57:37.382314 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:37.382347 (+ 33us) write_op.cc:270] Start()
0317 20:57:37.382376 (+ 29us) write_op.cc:276] Timestamp: P: 1773781057381463 usec, L: 0
0317 20:57:37.382378 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.382508 (+ 130us) log.cc:844] Serialized 662 byte log entry
0317 20:57:37.390793 (+ 8285us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.391546 (+ 753us) write_op.cc:301] APPLY: starting
0317 20:57:37.391561 (+ 15us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.391595 (+ 34us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.391609 (+ 14us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.391687 (+ 78us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.391723 (+ 36us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0317 20:57:37.391728 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:37.391785 (+ 57us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.391832 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.391847 (+ 15us) write_op.cc:454] Released schema lock
0317 20:57:37.391854 (+ 7us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.391916 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.391918 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":697,"apply.run_cpu_time_us":366,"apply.run_wall_time_us":365,"num_ops":2,"prepare.queue_time_us":14802,"prepare.run_cpu_time_us":612,"prepare.run_wall_time_us":4988,"raft.queue_time_us":1228,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":318,"replication_time_us":8384}]]}
I20260317 20:57:37.423239 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet e58ac81836d94bae906e753352c28ff7 with delete_type TABLET_DATA_DELETED (replaced by tablet fd30c05f47bd41eebebbf27844cf4fc6) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.423512 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet e58ac81836d94bae906e753352c28ff7 with delete_type TABLET_DATA_DELETED (replaced by tablet fd30c05f47bd41eebebbf27844cf4fc6) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.423820 1843 tablet_bootstrap.cc:492] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.424422 2026 tablet.cc:1723] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:37.425005 1176 tablet_service.cc:1511] Processing CreateTablet for tablet fc76f8e8a4af47aba2a64bd60fc6941f (DEFAULT_TABLE table=default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.425100 1843 tablet_bootstrap.cc:654] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.425266 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc76f8e8a4af47aba2a64bd60fc6941f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.426227 1843 tablet_bootstrap.cc:492] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.426319 1843 ts_tablet_manager.cc:1403] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:37.426818 1843 raft_consensus.cc:359] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.427114 2049 tablet_replica.cc:333] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.427277 2049 raft_consensus.cc:2243] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.427390 2049 raft_consensus.cc:2272] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.426947 1843 raft_consensus.cc:385] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.427639 1843 raft_consensus.cc:740] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.427785 1843 consensus_queue.cc:260] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.427891 1565 consensus_queue.cc:1048] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.428083 1843 ts_tablet_manager.cc:1434] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:37.428225 797 catalog_manager.cc:2174] created HMS catalog entry for table [id=4298738fab6d487d957cf73164bf35cd]
I20260317 20:57:37.428659 2051 ts_tablet_manager.cc:1916] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.430260 1843 tablet_bootstrap.cc:492] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.430938 2051 ts_tablet_manager.cc:1929] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260317 20:57:37.431005 2051 log.cc:1199] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/71ed1a25a2d849eba1adb7ebf2c6a733
I20260317 20:57:37.431272 2051 ts_tablet_manager.cc:1950] T 71ed1a25a2d849eba1adb7ebf2c6a733 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.432340 1843 tablet_bootstrap.cc:654] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.433638 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 71ed1a25a2d849eba1adb7ebf2c6a733 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]) successfully deleted
I20260317 20:57:37.433779 2050 tablet_replica.cc:333] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.433929 2049 ts_tablet_manager.cc:1916] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.433941 2050 raft_consensus.cc:2243] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.434201 2050 raft_consensus.cc:2272] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.436002 2050 ts_tablet_manager.cc:1916] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.437331 2038 consensus_queue.cc:1048] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.437897 798 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_b9b69d0268774a8a8a0d7fb130e53075"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:37.438558 2050 ts_tablet_manager.cc:1929] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.438632 2050 log.cc:1199] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/e58ac81836d94bae906e753352c28ff7
I20260317 20:57:37.447710 1178 tablet_service.cc:1511] Processing CreateTablet for tablet b9794f5cae264d1392074b3a3daf3f46 (DEFAULT_TABLE table=default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.448149 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9794f5cae264d1392074b3a3daf3f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.447683 1313 tablet_service.cc:1511] Processing CreateTablet for tablet b9794f5cae264d1392074b3a3daf3f46 (DEFAULT_TABLE table=default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.448874 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9794f5cae264d1392074b3a3daf3f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.450594 1041 tablet_service.cc:1511] Processing CreateTablet for tablet b9794f5cae264d1392074b3a3daf3f46 (DEFAULT_TABLE table=default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.450896 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet e58ac81836d94bae906e753352c28ff7 with delete_type TABLET_DATA_DELETED (replaced by tablet fd30c05f47bd41eebebbf27844cf4fc6) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.450939 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9794f5cae264d1392074b3a3daf3f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.451067 2051 tablet_replica.cc:333] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.451196 2051 raft_consensus.cc:2243] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.451313 2051 raft_consensus.cc:2272] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.451969 2051 ts_tablet_manager.cc:1916] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.454305 2051 ts_tablet_manager.cc:1929] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.454437 2051 log.cc:1199] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/e58ac81836d94bae906e753352c28ff7
I20260317 20:57:37.454713 2051 ts_tablet_manager.cc:1950] T e58ac81836d94bae906e753352c28ff7 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.465153 794 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_87b0031e8517466b85bf93c1d68fa16d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:37.443812 797 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 88) took 1377 ms. Trace:
I20260317 20:57:37.465817 797 rpcz_store.cc:276] 0317 20:57:36.066751 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:36.858188 (+791437us) service_pool.cc:225] Handling call
0317 20:57:37.245663 (+387475us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:37.246061 (+ 398us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:37.428215 (+182154us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:37.443619 (+ 15404us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:37.443720 (+ 101us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:37.443792 (+ 72us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.429203 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.429378 (+ 175us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.429384 (+ 6us) write_op.cc:435] Acquired schema lock
0317 20:57:37.429386 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:37.429460 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.429484 (+ 24us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.429487 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.429542 (+ 55us) tablet.cc:700] Row locks acquired
0317 20:57:37.429544 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:37.429572 (+ 28us) write_op.cc:270] Start()
0317 20:57:37.429596 (+ 24us) write_op.cc:276] Timestamp: P: 1773781057428679 usec, L: 0
0317 20:57:37.429598 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.438391 (+ 8793us) log.cc:844] Serialized 433 byte log entry
0317 20:57:37.438563 (+ 172us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x55b8f14ac554. stack: 00007fa13012bac1 00007fa13012c0b1 00007fa12fc08add 000055b8ec69937e 000055b8ec6993d1 000055b8ec69d690 00007fa131d98572 00007fa13233a5b9 00007fa13233971e 00007fa132338fec 00007fa13233e97c 000055b8ec726189 00007fa13014f28c 00007fa13014fbb4 00007fa130151300 000055b8ec726189
0317 20:57:37.442643 (+ 4080us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.443266 (+ 623us) write_op.cc:301] APPLY: starting
0317 20:57:37.443275 (+ 9us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.443296 (+ 21us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.443298 (+ 2us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.443360 (+ 62us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.443380 (+ 20us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:37.443384 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:37.443421 (+ 37us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.443446 (+ 25us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.443456 (+ 10us) write_op.cc:454] Released schema lock
0317 20:57:37.443460 (+ 4us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.443504 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.443506 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":133721,"Hive Metastore.run_cpu_time_us":193,"Hive Metastore.run_wall_time_us":48180,"mutex_wait_us":24,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":596,"apply.run_cpu_time_us":232,"apply.run_wall_time_us":232,"num_ops":2,"prepare.queue_time_us":525,"prepare.run_cpu_time_us":839,"prepare.run_wall_time_us":9762,"raft.queue_time_us":45,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"replication_time_us":13027,"spinlock_wait_cycles":19868032}]]}
I20260317 20:57:37.458278 799 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:57868 (request call id 86) took 1574 ms. Trace:
I20260317 20:57:37.467555 799 rpcz_store.cc:276] 0317 20:57:35.883943 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:36.822443 (+938500us) service_pool.cc:225] Handling call
0317 20:57:37.009426 (+186983us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.457830 (+448404us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.458022 (+ 192us) catalog_manager.cc:3725] Apply alter schema
0317 20:57:37.458262 (+ 240us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":193364,"Hive Metastore.run_cpu_time_us":520,"Hive Metastore.run_wall_time_us":91637}
I20260317 20:57:37.467856 799 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_f032e881f2224caa93060a22bf502dc4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:37.468190 2049 ts_tablet_manager.cc:1929] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.468274 2049 log.cc:1199] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/e58ac81836d94bae906e753352c28ff7
I20260317 20:57:37.468550 2049 ts_tablet_manager.cc:1950] T e58ac81836d94bae906e753352c28ff7 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.469062 791 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_d75875b48ed64da7a376b2b012ffe68c" } new_table_name: "default.Table_4ff5658252364bb1bf6fa149608be43f" modify_external_catalogs: true
I20260317 20:57:37.458278 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet e58ac81836d94bae906e753352c28ff7 (table default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]) successfully deleted
I20260317 20:57:37.470019 792 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_e4fa526f77d344718df6708418c87f82"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:37.472401 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet e58ac81836d94bae906e753352c28ff7 (table default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]) successfully deleted
I20260317 20:57:37.477839 797 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3] alter complete (version 1)
I20260317 20:57:37.479614 1177 tablet_service.cc:1511] Processing CreateTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 (DEFAULT_TABLE table=default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.479976 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd30c05f47bd41eebebbf27844cf4fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.480298 797 catalog_manager.cc:5671] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:37.483021 1312 tablet_service.cc:1511] Processing CreateTablet for tablet 2919b2a953ef4d74955ca04b622b6c33 (DEFAULT_TABLE table=default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.483367 1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2919b2a953ef4d74955ca04b622b6c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.483660 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (DEFAULT_TABLE table=default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.483978 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbe1ef827b545dfa7a4aba06e254a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.486336 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 2919b2a953ef4d74955ca04b622b6c33 (DEFAULT_TABLE table=default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.486425 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (DEFAULT_TABLE table=default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.486651 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2919b2a953ef4d74955ca04b622b6c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.486658 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbe1ef827b545dfa7a4aba06e254a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.487835 1040 tablet_service.cc:1511] Processing CreateTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 (DEFAULT_TABLE table=default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.488087 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd30c05f47bd41eebebbf27844cf4fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.489120 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 2919b2a953ef4d74955ca04b622b6c33 (DEFAULT_TABLE table=default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.489496 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2919b2a953ef4d74955ca04b622b6c33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.490303 2050 ts_tablet_manager.cc:1950] T e58ac81836d94bae906e753352c28ff7 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.492519 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet e58ac81836d94bae906e753352c28ff7 (table default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]) successfully deleted
I20260317 20:57:37.494269 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (DEFAULT_TABLE table=default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.494623 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dbe1ef827b545dfa7a4aba06e254a03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.496119 1565 raft_consensus.cc:493] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.496209 1565 raft_consensus.cc:515] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.496574 1565 leader_election.cc:290] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.499622 1841 tablet_bootstrap.cc:492] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.499748 1841 ts_tablet_manager.cc:1403] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.091s user 0.002s sys 0.000s
I20260317 20:57:37.500340 1841 raft_consensus.cc:359] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.500476 1841 raft_consensus.cc:385] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.500509 1841 raft_consensus.cc:740] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.500638 1841 consensus_queue.cc:260] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.500905 1841 ts_tablet_manager.cc:1434] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.501154 1841 tablet_bootstrap.cc:492] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.502532 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1947a091d5c8450abb0b7ed7acc05136" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:37.504458 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1947a091d5c8450abb0b7ed7acc05136" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:37.507829 1841 tablet_bootstrap.cc:654] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
W20260317 20:57:37.516674 1133 leader_election.cc:343] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Illegal state: must be running to vote when last-logged opid is not known
W20260317 20:57:37.517445 1133 leader_election.cc:343] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:37.517531 1133 leader_election.cc:304] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:37.517668 1449 raft_consensus.cc:2749] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260317 20:57:37.517962 1449 consensus_queue.cc:1048] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.518587 2038 consensus_queue.cc:1048] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.519518 1313 tablet_service.cc:1511] Processing CreateTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 (DEFAULT_TABLE table=default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.519848 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd30c05f47bd41eebebbf27844cf4fc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.531440 797 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]). Expected version 1 got 0
W20260317 20:57:37.531982 797 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet fc76f8e8a4af47aba2a64bd60fc6941f consensus state has no leader
I20260317 20:57:37.533903 1843 tablet_bootstrap.cc:492] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.534020 1843 ts_tablet_manager.cc:1403] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.104s user 0.002s sys 0.000s
I20260317 20:57:37.534574 1843 raft_consensus.cc:359] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.534704 1843 raft_consensus.cc:385] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.534747 1843 raft_consensus.cc:740] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.534878 1843 consensus_queue.cc:260] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.535444 1843 ts_tablet_manager.cc:1434] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.535681 1843 tablet_bootstrap.cc:492] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.536973 1843 tablet_bootstrap.cc:654] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.537858 797 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_70c346e7110644f2b3b5b4bec1789d4a" } new_table_name: "default.Table_fb41c97ca0a9409c963fbe195007a57f" modify_external_catalogs: true
I20260317 20:57:37.538758 1842 tablet_bootstrap.cc:492] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.538859 1842 ts_tablet_manager.cc:1403] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.130s user 0.000s sys 0.002s
I20260317 20:57:37.539374 1842 raft_consensus.cc:359] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.539482 1842 raft_consensus.cc:385] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.539515 1842 raft_consensus.cc:740] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.539649 1842 consensus_queue.cc:260] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.540001 1842 ts_tablet_manager.cc:1434] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:37.540201 1842 tablet_bootstrap.cc:492] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.540681 1843 tablet_bootstrap.cc:492] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.540759 1843 ts_tablet_manager.cc:1403] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260317 20:57:37.541232 1842 tablet_bootstrap.cc:654] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.541227 1843 raft_consensus.cc:359] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.541330 1843 raft_consensus.cc:385] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.541368 1843 raft_consensus.cc:740] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.541477 1843 consensus_queue.cc:260] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.541723 1843 ts_tablet_manager.cc:1434] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.541903 1843 tablet_bootstrap.cc:492] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.543604 1843 tablet_bootstrap.cc:654] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.548301 1843 tablet_bootstrap.cc:492] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.548410 1843 ts_tablet_manager.cc:1403] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260317 20:57:37.548629 1841 tablet_bootstrap.cc:492] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.548723 1841 ts_tablet_manager.cc:1403] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20260317 20:57:37.548974 1843 raft_consensus.cc:359] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.549093 1843 raft_consensus.cc:385] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.549124 1843 raft_consensus.cc:740] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.549193 1841 raft_consensus.cc:359] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.549295 1841 raft_consensus.cc:385] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.549266 1843 consensus_queue.cc:260] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.549328 1841 raft_consensus.cc:740] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.549446 1841 consensus_queue.cc:260] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.549731 1841 ts_tablet_manager.cc:1434] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.550132 796 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]
I20260317 20:57:37.550916 1841 tablet_bootstrap.cc:492] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.551642 1843 ts_tablet_manager.cc:1434] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:37.551843 1843 tablet_bootstrap.cc:492] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.552181 1841 tablet_bootstrap.cc:654] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.552851 1843 tablet_bootstrap.cc:654] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.555229 1841 tablet_bootstrap.cc:492] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.555338 1841 ts_tablet_manager.cc:1403] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:37.559438 1841 raft_consensus.cc:359] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.559557 1841 raft_consensus.cc:385] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.559580 1841 raft_consensus.cc:740] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.559744 1841 consensus_queue.cc:260] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.560065 1841 ts_tablet_manager.cc:1434] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260317 20:57:37.560251 1841 tablet_bootstrap.cc:492] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.561300 1841 tablet_bootstrap.cc:654] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.566152 1843 tablet_bootstrap.cc:492] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.566320 1843 ts_tablet_manager.cc:1403] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260317 20:57:37.567864 1843 raft_consensus.cc:359] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.567989 1843 raft_consensus.cc:385] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.568023 1843 raft_consensus.cc:740] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.568140 1843 consensus_queue.cc:260] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.568445 1843 ts_tablet_manager.cc:1434] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260317 20:57:37.573433 1843 tablet_bootstrap.cc:492] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.576153 1843 tablet_bootstrap.cc:654] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.578715 1843 tablet_bootstrap.cc:492] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.578811 1843 ts_tablet_manager.cc:1403] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260317 20:57:37.579310 1843 raft_consensus.cc:359] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.579430 1843 raft_consensus.cc:385] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.579471 1843 raft_consensus.cc:740] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.579596 1843 consensus_queue.cc:260] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.579869 1843 ts_tablet_manager.cc:1434] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:37.582084 948 catalog_manager.cc:2772] Deleting table default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b] in response to Hive Metastore notification log event 65
W20260317 20:57:37.583470 785 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fc76f8e8a4af47aba2a64bd60fc6941f consensus state has no leader
I20260317 20:57:37.585821 1842 tablet_bootstrap.cc:492] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.585945 1842 ts_tablet_manager.cc:1403] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.001s
I20260317 20:57:37.586763 1842 raft_consensus.cc:359] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.586896 1842 raft_consensus.cc:385] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.586932 1842 raft_consensus.cc:740] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.587085 1842 consensus_queue.cc:260] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.587386 1842 ts_tablet_manager.cc:1434] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.587616 1842 tablet_bootstrap.cc:492] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.588723 1842 tablet_bootstrap.cc:654] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.595675 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet fd30c05f47bd41eebebbf27844cf4fc6
W20260317 20:57:37.596666 800 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7ae68704f7cd4052955e0c7a7a3fd162 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:37.596794 793 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_679a54af9b06407d9c33d94b850dc43b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:37.597470 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.597651 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:59376
W20260317 20:57:37.598255 786 catalog_manager.cc:4982] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): delete failed for tablet fd30c05f47bd41eebebbf27844cf4fc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd30c05f47bd41eebebbf27844cf4fc6 already in progress: creating tablet
W20260317 20:57:37.598428 786 catalog_manager.cc:4982] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet fd30c05f47bd41eebebbf27844cf4fc6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fd30c05f47bd41eebebbf27844cf4fc6 already in progress: creating tablet
I20260317 20:57:37.598858 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.599037 2051 tablet_replica.cc:333] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.599043 2038 raft_consensus.cc:493] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.599179 2051 raft_consensus.cc:2243] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.599292 2051 raft_consensus.cc:2272] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.599148 2038 raft_consensus.cc:515] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.599705 2038 leader_election.cc:290] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.600277 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5739d6cb9a84de78767b471608f1671" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:37.600468 1059 raft_consensus.cc:2393] T b5739d6cb9a84de78767b471608f1671 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 630e777e97c141a69e35660f32b26f6d in current term 1: Already voted for candidate 35518b51259b46d1b9b5e82b6841057b in this term.
I20260317 20:57:37.601477 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5739d6cb9a84de78767b471608f1671" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:37.601900 1268 leader_election.cc:304] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d; no voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:37.602265 2038 raft_consensus.cc:3060] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.602456 2051 ts_tablet_manager.cc:1916] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.603399 2038 raft_consensus.cc:2749] T b5739d6cb9a84de78767b471608f1671 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260317 20:57:37.604261 1842 tablet_bootstrap.cc:492] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.604355 1842 ts_tablet_manager.cc:1403] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260317 20:57:37.604765 2051 ts_tablet_manager.cc:1929] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:37.604866 2051 log.cc:1199] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/fd30c05f47bd41eebebbf27844cf4fc6
I20260317 20:57:37.604935 1842 raft_consensus.cc:359] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.605082 2051 ts_tablet_manager.cc:1950] T fd30c05f47bd41eebebbf27844cf4fc6 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.605074 1842 raft_consensus.cc:385] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.605113 1842 raft_consensus.cc:740] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.605254 1842 consensus_queue.cc:260] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.605556 1842 ts_tablet_manager.cc:1434] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.605886 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet fd30c05f47bd41eebebbf27844cf4fc6 (table default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]) successfully deleted
I20260317 20:57:37.607306 1842 tablet_bootstrap.cc:492] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.608508 1842 tablet_bootstrap.cc:654] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.610097 2038 raft_consensus.cc:493] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.610199 2038 raft_consensus.cc:515] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.610589 2038 leader_election.cc:290] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.611073 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1947a091d5c8450abb0b7ed7acc05136" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:37.611203 1059 raft_consensus.cc:2468] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:37.611572 1269 leader_election.cc:304] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.612190 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1947a091d5c8450abb0b7ed7acc05136" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:37.612334 1198 raft_consensus.cc:2468] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:37.612818 2038 raft_consensus.cc:2804] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.612876 2038 raft_consensus.cc:493] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.612915 2038 raft_consensus.cc:3060] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.613966 2038 raft_consensus.cc:515] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.614759 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1947a091d5c8450abb0b7ed7acc05136" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:37.614887 1059 raft_consensus.cc:3060] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.615384 1994 consensus_queue.cc:1048] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.615962 1059 raft_consensus.cc:2468] T 1947a091d5c8450abb0b7ed7acc05136 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:37.616317 1269 leader_election.cc:304] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.616515 1462 raft_consensus.cc:2804] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.616586 1462 raft_consensus.cc:697] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:37.616711 1462 consensus_queue.cc:237] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.617869 2038 leader_election.cc:290] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.618511 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1947a091d5c8450abb0b7ed7acc05136" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:37.618649 1198 raft_consensus.cc:3060] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.619822 1198 raft_consensus.cc:2468] T 1947a091d5c8450abb0b7ed7acc05136 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:37.627416 1841 tablet_bootstrap.cc:492] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.627538 1841 ts_tablet_manager.cc:1403] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.000s
I20260317 20:57:37.628088 1841 raft_consensus.cc:359] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.628212 1841 raft_consensus.cc:385] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.628248 1841 raft_consensus.cc:740] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.628378 1841 consensus_queue.cc:260] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.628695 1841 ts_tablet_manager.cc:1434] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.628883 1841 tablet_bootstrap.cc:492] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.631807 1841 tablet_bootstrap.cc:654] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.638074 1842 tablet_bootstrap.cc:492] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.638231 1842 ts_tablet_manager.cc:1403] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20260317 20:57:37.638902 1842 raft_consensus.cc:359] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.639070 1842 raft_consensus.cc:385] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.639140 1842 raft_consensus.cc:740] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.639364 1842 consensus_queue.cc:260] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.641692 1842 ts_tablet_manager.cc:1434] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260317 20:57:37.642127 1842 tablet_bootstrap.cc:492] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.645548 1462 raft_consensus.cc:493] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.645896 1462 raft_consensus.cc:515] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.646502 1462 leader_election.cc:290] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.646898 1841 tablet_bootstrap.cc:492] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.647027 1841 ts_tablet_manager.cc:1403] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260317 20:57:37.647146 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc76f8e8a4af47aba2a64bd60fc6941f" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:37.647313 1198 raft_consensus.cc:2468] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:37.647493 1842 tablet_bootstrap.cc:654] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.647615 1841 raft_consensus.cc:359] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.647732 1841 raft_consensus.cc:385] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.647723 1268 leader_election.cc:304] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:37.647765 1841 raft_consensus.cc:740] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.647897 1841 consensus_queue.cc:260] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.648100 1462 raft_consensus.cc:2804] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.648159 1462 raft_consensus.cc:493] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.648196 1462 raft_consensus.cc:3060] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.648273 1841 ts_tablet_manager.cc:1434] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.648475 1841 tablet_bootstrap.cc:492] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.649236 1462 raft_consensus.cc:515] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.649576 1462 leader_election.cc:290] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.649758 1841 tablet_bootstrap.cc:654] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.650403 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc76f8e8a4af47aba2a64bd60fc6941f" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:37.650519 1059 raft_consensus.cc:2468] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:37.650610 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc76f8e8a4af47aba2a64bd60fc6941f" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:37.650707 1061 raft_consensus.cc:3060] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.651369 1994 consensus_queue.cc:1048] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.651631 1061 raft_consensus.cc:2468] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:37.651908 1269 leader_election.cc:304] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.653285 1806 raft_consensus.cc:2804] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.653378 1806 raft_consensus.cc:697] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:37.653509 1806 consensus_queue.cc:237] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.654767 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc76f8e8a4af47aba2a64bd60fc6941f" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:37.654891 1198 raft_consensus.cc:3060] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.655887 1198 raft_consensus.cc:2468] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:37.670953 1841 tablet_bootstrap.cc:492] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.671106 1841 ts_tablet_manager.cc:1403] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260317 20:57:37.671713 1841 raft_consensus.cc:359] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.671859 1841 raft_consensus.cc:385] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.671901 1841 raft_consensus.cc:740] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.671977 1842 tablet_bootstrap.cc:492] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.672036 1841 consensus_queue.cc:260] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.672083 1842 ts_tablet_manager.cc:1403] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20260317 20:57:37.672348 1841 ts_tablet_manager.cc:1434] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:37.672608 1842 raft_consensus.cc:359] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.672725 1842 raft_consensus.cc:385] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.672760 1842 raft_consensus.cc:740] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.672879 1842 consensus_queue.cc:260] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.673189 1842 ts_tablet_manager.cc:1434] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.674572 1842 tablet_bootstrap.cc:492] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.679962 1842 tablet_bootstrap.cc:654] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.691282 1842 tablet_bootstrap.cc:492] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.691440 1842 ts_tablet_manager.cc:1403] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20260317 20:57:37.692058 1842 raft_consensus.cc:359] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.692231 1842 raft_consensus.cc:385] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.692271 1842 raft_consensus.cc:740] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.692431 1842 consensus_queue.cc:260] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.692764 1842 ts_tablet_manager.cc:1434] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:37.693006 795 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_395f00deaf674e7cac8e63f23538af32 [id=1b93f2aee69044b2b3252d17d5e4fab4]
I20260317 20:57:37.694434 948 catalog_manager.cc:2772] Deleting table default.table_395f00deaf674e7cac8e63f23538af32 [id=1b93f2aee69044b2b3252d17d5e4fab4] in response to Hive Metastore notification log event 66
I20260317 20:57:37.707350 948 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet f8ed352c406f49138e48fffa6b14a5d2
W20260317 20:57:37.708505 798 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b9b69d0268774a8a8a0d7fb130e53075 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:37.709360 794 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_87b0031e8517466b85bf93c1d68fa16d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:37.710122 799 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f032e881f2224caa93060a22bf502dc4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260317 20:57:37.710914 792 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e4fa526f77d344718df6708418c87f82 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:37.711592 796 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 90) took 1560 ms. Trace:
I20260317 20:57:37.711655 796 rpcz_store.cc:276] 0317 20:57:36.151249 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.062431 (+911182us) service_pool.cc:225] Handling call
0317 20:57:37.350708 (+288277us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.711571 (+360863us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":93176,"Hive Metastore.run_cpu_time_us":134,"Hive Metastore.run_wall_time_us":105912}
I20260317 20:57:37.712538 796 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]). Expected version 1 got 0
I20260317 20:57:37.713547 796 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]). Expected version 1 got 0
I20260317 20:57:37.714809 796 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_f3bf180436c74527a1909f1af367814e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:37.715332 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet f8ed352c406f49138e48fffa6b14a5d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.715538 2050 tablet_replica.cc:333] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.715685 2050 raft_consensus.cc:2243] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.715834 2050 raft_consensus.cc:2272] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.716313 2050 ts_tablet_manager.cc:1916] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.717739 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet f8ed352c406f49138e48fffa6b14a5d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.718616 2049 tablet_replica.cc:333] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.718772 2049 raft_consensus.cc:2243] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.718801 2050 ts_tablet_manager.cc:1929] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.718865 2050 log.cc:1199] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/f8ed352c406f49138e48fffa6b14a5d2
I20260317 20:57:37.718901 2049 raft_consensus.cc:2272] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.719141 2050 ts_tablet_manager.cc:1950] T f8ed352c406f49138e48fffa6b14a5d2 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.719399 2049 ts_tablet_manager.cc:1916] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.715548 1806 raft_consensus.cc:493] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.720049 1806 raft_consensus.cc:515] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.720455 1806 leader_election.cc:290] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.720626 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet f8ed352c406f49138e48fffa6b14a5d2 (table default.table_395f00deaf674e7cac8e63f23538af32 [id=1b93f2aee69044b2b3252d17d5e4fab4]) successfully deleted
I20260317 20:57:37.721407 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919b2a953ef4d74955ca04b622b6c33" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:37.721563 1196 raft_consensus.cc:2468] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:37.721833 2049 ts_tablet_manager.cc:1929] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.721895 1268 leader_election.cc:304] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:37.722008 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet f8ed352c406f49138e48fffa6b14a5d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:37.722563 2051 tablet_replica.cc:333] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:37.722711 2051 raft_consensus.cc:2243] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.722919 2051 raft_consensus.cc:2272] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.723384 2051 ts_tablet_manager.cc:1916] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.723521 1806 raft_consensus.cc:2804] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.723573 1806 raft_consensus.cc:493] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.723608 1806 raft_consensus.cc:3060] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.724622 1806 raft_consensus.cc:515] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.725057 1806 leader_election.cc:290] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.725849 2051 ts_tablet_manager.cc:1929] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.725920 2051 log.cc:1199] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/f8ed352c406f49138e48fffa6b14a5d2
I20260317 20:57:37.726212 2051 ts_tablet_manager.cc:1950] T f8ed352c406f49138e48fffa6b14a5d2 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:37.726163 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919b2a953ef4d74955ca04b622b6c33" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:37.726300 1196 raft_consensus.cc:3060] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.726972 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet f8ed352c406f49138e48fffa6b14a5d2 (table default.table_395f00deaf674e7cac8e63f23538af32 [id=1b93f2aee69044b2b3252d17d5e4fab4]) successfully deleted
I20260317 20:57:37.727306 1196 raft_consensus.cc:2468] T 2919b2a953ef4d74955ca04b622b6c33 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:37.727676 1268 leader_election.cc:304] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:37.727888 1806 raft_consensus.cc:2804] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.727974 1806 raft_consensus.cc:697] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:37.723392 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919b2a953ef4d74955ca04b622b6c33" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:37.728137 1061 raft_consensus.cc:2468] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:37.728127 1806 consensus_queue.cc:237] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.725598 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2919b2a953ef4d74955ca04b622b6c33" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:37.728343 1059 raft_consensus.cc:3060] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.729507 1059 raft_consensus.cc:2468] T 2919b2a953ef4d74955ca04b622b6c33 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:37.730365 2049 log.cc:1199] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/f8ed352c406f49138e48fffa6b14a5d2
I20260317 20:57:37.730675 2049 ts_tablet_manager.cc:1950] T f8ed352c406f49138e48fffa6b14a5d2 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.731747 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet f8ed352c406f49138e48fffa6b14a5d2 (table default.table_395f00deaf674e7cac8e63f23538af32 [id=1b93f2aee69044b2b3252d17d5e4fab4]) successfully deleted
I20260317 20:57:37.751102 800 catalog_manager.cc:2174] created HMS catalog entry for table [id=67ccf689c8cc40c291fa641510e5308d]
I20260317 20:57:37.757982 800 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 98) took 1279 ms. Trace:
I20260317 20:57:37.758101 800 rpcz_store.cc:276] 0317 20:57:36.478272 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.381501 (+903229us) service_pool.cc:225] Handling call
0317 20:57:37.596764 (+215263us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:37.597141 (+ 377us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:37.751090 (+153949us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:37.757780 (+ 6690us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:37.757872 (+ 92us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:37.757950 (+ 78us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.751682 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.751787 (+ 105us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.751791 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:37.751793 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:37.751859 (+ 66us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.751869 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.751872 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.751927 (+ 55us) tablet.cc:700] Row locks acquired
0317 20:57:37.751928 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:37.751956 (+ 28us) write_op.cc:270] Start()
0317 20:57:37.751994 (+ 38us) write_op.cc:276] Timestamp: P: 1773781057751898 usec, L: 0
0317 20:57:37.751996 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.752139 (+ 143us) log.cc:844] Serialized 433 byte log entry
0317 20:57:37.756873 (+ 4734us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.756967 (+ 94us) write_op.cc:301] APPLY: starting
0317 20:57:37.756994 (+ 27us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.757027 (+ 33us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.757042 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.757118 (+ 76us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.757146 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:37.757150 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:37.757212 (+ 62us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.757269 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.757283 (+ 14us) write_op.cc:454] Released schema lock
0317 20:57:37.757288 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.757349 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.757351 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":96710,"Hive Metastore.run_cpu_time_us":237,"Hive Metastore.run_wall_time_us":56902,"child_traces":[["op",{"apply.queue_time_us":49,"apply.run_cpu_time_us":374,"apply.run_wall_time_us":374,"num_ops":2,"prepare.queue_time_us":92,"prepare.run_cpu_time_us":550,"prepare.run_wall_time_us":549,"raft.queue_time_us":508,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":382,"replication_time_us":4847,"spinlock_wait_cycles":35584}]]}
I20260317 20:57:37.759512 800 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]). Expected version 2 got 0
W20260317 20:57:37.760200 800 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 4dbe1ef827b545dfa7a4aba06e254a03 consensus state has no leader
I20260317 20:57:37.762490 1994 raft_consensus.cc:493] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.762622 1994 raft_consensus.cc:515] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.763095 1994 leader_election.cc:290] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.763607 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbe1ef827b545dfa7a4aba06e254a03" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:37.763772 1196 raft_consensus.cc:2468] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.763862 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbe1ef827b545dfa7a4aba06e254a03" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:37.763989 1332 raft_consensus.cc:2468] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.764091 995 leader_election.cc:304] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.764276 1994 raft_consensus.cc:2804] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.764315 1994 raft_consensus.cc:493] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.764345 1994 raft_consensus.cc:3060] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.765475 1994 raft_consensus.cc:515] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.765872 1994 leader_election.cc:290] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.766258 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbe1ef827b545dfa7a4aba06e254a03" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:37.766382 1332 raft_consensus.cc:3060] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.767606 1332 raft_consensus.cc:2468] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.767932 996 leader_election.cc:304] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.768148 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4dbe1ef827b545dfa7a4aba06e254a03" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:37.768188 1994 raft_consensus.cc:2804] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.768277 1994 raft_consensus.cc:697] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:37.768286 1196 raft_consensus.cc:3060] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.768424 1994 consensus_queue.cc:237] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.769384 1196 raft_consensus.cc:2468] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.773695 1994 raft_consensus.cc:493] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.773813 1994 raft_consensus.cc:515] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.774376 1994 leader_election.cc:290] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.774763 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30c05f47bd41eebebbf27844cf4fc6" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:37.774914 1332 raft_consensus.cc:2468] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.775246 996 leader_election.cc:304] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.775493 1994 raft_consensus.cc:2804] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.775548 1994 raft_consensus.cc:493] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.775584 1994 raft_consensus.cc:3060] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.776882 1994 raft_consensus.cc:515] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.777721 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd30c05f47bd41eebebbf27844cf4fc6" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:37.777853 1332 raft_consensus.cc:3060] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
W20260317 20:57:37.778378 995 leader_election.cc:343] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: fd30c05f47bd41eebebbf27844cf4fc6
I20260317 20:57:37.779052 1332 raft_consensus.cc:2468] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.779400 996 leader_election.cc:304] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:37.779587 1819 raft_consensus.cc:2804] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.779784 1819 raft_consensus.cc:697] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:37.779951 1819 consensus_queue.cc:237] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.780371 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (DEFAULT_TABLE table=default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.780449 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (DEFAULT_TABLE table=default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.780671 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.780670 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.780761 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (DEFAULT_TABLE table=default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.781049 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.782991 1841 tablet_bootstrap.cc:492] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.782991 1842 tablet_bootstrap.cc:492] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.784140 1841 tablet_bootstrap.cc:654] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.784140 1842 tablet_bootstrap.cc:654] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.784425 1994 leader_election.cc:290] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.784891 1843 tablet_bootstrap.cc:492] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.786847 1843 tablet_bootstrap.cc:654] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
W20260317 20:57:37.789289 995 leader_election.cc:343] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: fd30c05f47bd41eebebbf27844cf4fc6
I20260317 20:57:37.790663 800 catalog_manager.cc:5671] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:37.791108 800 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]). Expected version 1 got 0
I20260317 20:57:37.791368 800 catalog_manager.cc:5671] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:37.791802 800 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]). Expected version 2 got 0
I20260317 20:57:37.792771 1843 tablet_bootstrap.cc:492] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.792870 1843 ts_tablet_manager.cc:1403] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260317 20:57:37.793350 1843 raft_consensus.cc:359] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.793463 1843 raft_consensus.cc:385] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.793490 1843 raft_consensus.cc:740] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.793633 1843 consensus_queue.cc:260] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.793900 1843 ts_tablet_manager.cc:1434] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:37.797672 1842 tablet_bootstrap.cc:492] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.797791 1842 ts_tablet_manager.cc:1403] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260317 20:57:37.798378 1842 raft_consensus.cc:359] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.798503 1842 raft_consensus.cc:385] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.798535 1842 raft_consensus.cc:740] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.798578 1841 tablet_bootstrap.cc:492] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.798663 1841 ts_tablet_manager.cc:1403] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260317 20:57:37.798666 1842 consensus_queue.cc:260] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.798962 1842 ts_tablet_manager.cc:1434] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:37.799186 1841 raft_consensus.cc:359] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.799302 1841 raft_consensus.cc:385] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.799333 1841 raft_consensus.cc:740] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.799453 1841 consensus_queue.cc:260] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.799722 1841 ts_tablet_manager.cc:1434] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.810146 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:37.810366 2050 tablet_replica.cc:333] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:37.810490 2050 raft_consensus.cc:2243] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:37.810591 2050 raft_consensus.cc:2272] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.811152 2050 ts_tablet_manager.cc:1916] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.811947 800 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]). Expected version 2 got 0
I20260317 20:57:37.813481 2050 ts_tablet_manager.cc:1929] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260317 20:57:37.813570 2050 log.cc:1199] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/fd30c05f47bd41eebebbf27844cf4fc6
I20260317 20:57:37.813798 2050 ts_tablet_manager.cc:1950] T fd30c05f47bd41eebebbf27844cf4fc6 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:37.814229 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.814440 2049 tablet_replica.cc:333] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:37.814575 2049 raft_consensus.cc:2243] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:37.814757 2049 pending_rounds.cc:70] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Trying to abort 1 pending ops.
I20260317 20:57:37.814795 2049 pending_rounds.cc:77] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7265407212668203008 op_type: NO_OP noop_request { }
I20260317 20:57:37.814873 2049 raft_consensus.cc:2889] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260317 20:57:37.814937 2049 raft_consensus.cc:2272] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:37.815614 2049 ts_tablet_manager.cc:1916] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:37.816454 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet fd30c05f47bd41eebebbf27844cf4fc6 (table default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]) successfully deleted
I20260317 20:57:37.817802 2049 ts_tablet_manager.cc:1929] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:37.817873 2049 log.cc:1199] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/fd30c05f47bd41eebebbf27844cf4fc6
I20260317 20:57:37.818168 2049 ts_tablet_manager.cc:1950] T fd30c05f47bd41eebebbf27844cf4fc6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:37.818542 800 catalog_manager.cc:5671] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:37.819010 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet fd30c05f47bd41eebebbf27844cf4fc6 (table default.table_8cc9c66b97034de7b01437aced6119ed [id=8fec849379024c37a2926b6f0f2dfe4b]) successfully deleted
I20260317 20:57:37.837625 800 catalog_manager.cc:5671] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:37.837990 800 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]). Expected version 2 got 0
I20260317 20:57:37.843185 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet fd30c05f47bd41eebebbf27844cf4fc6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-03-17 20:57:37 UTC) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:37.843948 1059 raft_consensus.cc:1275] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Refusing update from remote peer 630e777e97c141a69e35660f32b26f6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260317 20:57:37.843935 786 catalog_manager.cc:4969] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): delete failed for tablet fd30c05f47bd41eebebbf27844cf4fc6 because the tablet was not found. No further retry: Not found: Tablet not found: fd30c05f47bd41eebebbf27844cf4fc6
I20260317 20:57:37.844537 1196 raft_consensus.cc:1275] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Refusing update from remote peer 630e777e97c141a69e35660f32b26f6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:37.844408 800 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_df3d165713f44a8b87b980f60d112d34" } new_table_name: "default.Table_6dc3bfd2de6b485098bb35884f8287fb" modify_external_catalogs: true
I20260317 20:57:37.844964 1806 consensus_queue.cc:1048] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.845119 1462 consensus_queue.cc:1048] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.853750 2026 tablet.cc:1723] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:37.855521 2027 tablet.cc:1723] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:37.856186 793 catalog_manager.cc:2174] created HMS catalog entry for table [id=e25f1c4289634fb7a06fb011b555d9b4]
I20260317 20:57:37.860445 2091 raft_consensus.cc:493] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.860577 2091 raft_consensus.cc:515] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.861090 2091 leader_election.cc:290] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.862169 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9794f5cae264d1392074b3a3daf3f46" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:37.862308 1332 raft_consensus.cc:2468] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.863233 996 leader_election.cc:304] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.868333 793 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 97) took 1544 ms. Trace:
I20260317 20:57:37.868419 793 rpcz_store.cc:276] 0317 20:57:36.323947 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.370247 (+1046300us) service_pool.cc:225] Handling call
0317 20:57:37.596875 (+226628us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:37.597219 (+ 344us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:37.856178 (+258959us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:37.866033 (+ 9855us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:37.868233 (+ 2200us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:37.868315 (+ 82us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.856644 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.856751 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.856756 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:37.856757 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:37.856833 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.856843 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.856846 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.856899 (+ 53us) tablet.cc:700] Row locks acquired
0317 20:57:37.856901 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:37.856927 (+ 26us) write_op.cc:270] Start()
0317 20:57:37.856952 (+ 25us) write_op.cc:276] Timestamp: P: 1773781057856847 usec, L: 0
0317 20:57:37.856953 (+ 1us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.857087 (+ 134us) log.cc:844] Serialized 433 byte log entry
0317 20:57:37.860303 (+ 3216us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.861250 (+ 947us) write_op.cc:301] APPLY: starting
0317 20:57:37.861270 (+ 20us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.861306 (+ 36us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.861323 (+ 17us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.861415 (+ 92us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.861449 (+ 34us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:37.861453 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:37.861522 (+ 69us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.861585 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.861600 (+ 15us) write_op.cc:454] Released schema lock
0317 20:57:37.861605 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.861666 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.861669 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":153610,"Hive Metastore.run_cpu_time_us":204,"Hive Metastore.run_wall_time_us":105107,"child_traces":[["op",{"apply.queue_time_us":892,"apply.run_cpu_time_us":413,"apply.run_wall_time_us":413,"mutex_wait_us":2057,"num_ops":2,"prepare.queue_time_us":39,"prepare.run_cpu_time_us":541,"prepare.run_wall_time_us":542,"raft.queue_time_us":90,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":383,"replication_time_us":3324,"spinlock_wait_cycles":34944}]]}
I20260317 20:57:37.869508 793 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]). Expected version 1 got 0
I20260317 20:57:37.870565 793 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]). Expected version 1 got 0
I20260317 20:57:37.872409 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9794f5cae264d1392074b3a3daf3f46" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:37.872581 1196 raft_consensus.cc:2468] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.877135 793 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd]). Expected version 1 got 0
I20260317 20:57:37.878618 1994 raft_consensus.cc:2804] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.878706 1994 raft_consensus.cc:493] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.878746 1994 raft_consensus.cc:3060] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.879757 1994 raft_consensus.cc:515] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.880188 1994 leader_election.cc:290] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:37.880435 2091 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:37.880517 2091 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.880826 2091 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.880921 1198 raft_consensus.cc:1275] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Refusing update from remote peer 92d68c1a3a2642cca908f2c7e9d7e13a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:37.881114 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9794f5cae264d1392074b3a3daf3f46" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:37.881222 1196 raft_consensus.cc:3060] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.881628 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d152d8bcdb544bd80c998d9dd0a8cbd" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:37.881740 1198 raft_consensus.cc:2468] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.881934 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9794f5cae264d1392074b3a3daf3f46" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:37.882072 1333 raft_consensus.cc:1275] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Refusing update from remote peer 92d68c1a3a2642cca908f2c7e9d7e13a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:37.882318 1196 raft_consensus.cc:2468] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.882458 995 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.882521 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d152d8bcdb544bd80c998d9dd0a8cbd" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:37.882082 1332 raft_consensus.cc:3060] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.882628 1334 raft_consensus.cc:2468] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:37.882614 1819 consensus_queue.cc:1048] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.882901 1819 raft_consensus.cc:2804] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:37.882958 1819 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:37.883000 1819 raft_consensus.cc:3060] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.883585 1332 raft_consensus.cc:2468] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.883919 1819 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.883965 995 leader_election.cc:304] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.884183 2091 raft_consensus.cc:2804] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.884271 2091 raft_consensus.cc:697] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:37.884320 1819 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:37.884426 2091 consensus_queue.cc:237] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.884595 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d152d8bcdb544bd80c998d9dd0a8cbd" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:37.884693 1198 raft_consensus.cc:3060] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.885630 1198 raft_consensus.cc:2468] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.886195 995 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:37.888180 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d152d8bcdb544bd80c998d9dd0a8cbd" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:37.888350 1332 raft_consensus.cc:3060] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:37.889392 1332 raft_consensus.cc:2468] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:37.891475 1994 consensus_queue.cc:1048] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.891602 1041 tablet_service.cc:1511] Processing CreateTablet for tablet db67839dc0e7439e8ffa370019a88afd (DEFAULT_TABLE table=default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.891602 1313 tablet_service.cc:1511] Processing CreateTablet for tablet db67839dc0e7439e8ffa370019a88afd (DEFAULT_TABLE table=default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.891847 1994 raft_consensus.cc:2804] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:37.891875 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db67839dc0e7439e8ffa370019a88afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.891944 1994 raft_consensus.cc:697] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:37.892086 1994 consensus_queue.cc:237] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:37.892253 1176 tablet_service.cc:1511] Processing CreateTablet for tablet db67839dc0e7439e8ffa370019a88afd (DEFAULT_TABLE table=default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.892575 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db67839dc0e7439e8ffa370019a88afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.891873 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db67839dc0e7439e8ffa370019a88afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.894400 1842 tablet_bootstrap.cc:492] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.895098 1843 tablet_bootstrap.cc:492] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.895264 1841 tablet_bootstrap.cc:492] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.895377 1842 tablet_bootstrap.cc:654] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.896134 1843 tablet_bootstrap.cc:654] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.896245 1841 tablet_bootstrap.cc:654] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.902473 1842 tablet_bootstrap.cc:492] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.902611 1842 ts_tablet_manager.cc:1403] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:37.903131 1842 raft_consensus.cc:359] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.903249 1842 raft_consensus.cc:385] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.903281 1842 raft_consensus.cc:740] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.903405 1842 consensus_queue.cc:260] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.903692 1842 ts_tablet_manager.cc:1434] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.879961 798 catalog_manager.cc:2174] created HMS catalog entry for table [id=056ee1541039492b9cf64fc4ca835182]
I20260317 20:57:37.889544 795 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:57868 (request call id 91) took 1738 ms. Trace:
I20260317 20:57:37.908170 795 rpcz_store.cc:276] 0317 20:57:36.151442 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.254743 (+1103301us) service_pool.cc:225] Handling call
0317 20:57:37.457692 (+202949us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
0317 20:57:37.889529 (+431837us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":123842,"Hive Metastore.run_cpu_time_us":156,"Hive Metastore.run_wall_time_us":109100}
I20260317 20:57:37.909773 793 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57868:
name: "default.Table_6bacc979980f45f3bff68d78ea0c114d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:37.909969 795 catalog_manager.cc:5671] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:37.916738 798 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 99) took 1350 ms. Trace:
I20260317 20:57:37.916841 798 rpcz_store.cc:276] 0317 20:57:36.566595 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.422179 (+855584us) service_pool.cc:225] Handling call
0317 20:57:37.708616 (+286437us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:37.709014 (+ 398us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:37.879944 (+170930us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:37.916546 (+ 36602us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:37.916637 (+ 91us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:37.916716 (+ 79us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.910082 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.910189 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.910196 (+ 7us) write_op.cc:435] Acquired schema lock
0317 20:57:37.910197 (+ 1us) tablet.cc:661] Decoding operations
0317 20:57:37.910283 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.910294 (+ 11us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.910297 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.910348 (+ 51us) tablet.cc:700] Row locks acquired
0317 20:57:37.910350 (+ 2us) write_op.cc:260] PREPARE: finished
0317 20:57:37.910381 (+ 31us) write_op.cc:270] Start()
0317 20:57:37.910410 (+ 29us) write_op.cc:276] Timestamp: P: 1773781057910290 usec, L: 0
0317 20:57:37.910412 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.910549 (+ 137us) log.cc:844] Serialized 433 byte log entry
0317 20:57:37.914617 (+ 4068us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.914960 (+ 343us) write_op.cc:301] APPLY: starting
0317 20:57:37.914977 (+ 17us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.915008 (+ 31us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.915023 (+ 15us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.915108 (+ 85us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.915135 (+ 27us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:37.915139 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:37.915195 (+ 56us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.915254 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.915264 (+ 10us) write_op.cc:454] Released schema lock
0317 20:57:37.915269 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.915333 (+ 64us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.915335 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":149939,"Hive Metastore.run_cpu_time_us":197,"Hive Metastore.run_wall_time_us":20696,"child_traces":[["op",{"apply.queue_time_us":293,"apply.run_cpu_time_us":369,"apply.run_wall_time_us":369,"num_ops":2,"prepare.queue_time_us":1499,"prepare.run_cpu_time_us":563,"prepare.run_wall_time_us":562,"raft.queue_time_us":793,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":365,"replication_time_us":4180}]]}
I20260317 20:57:37.918181 798 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]). Expected version 2 got 0
I20260317 20:57:37.919445 798 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]). Expected version 2 got 0
I20260317 20:57:37.919889 798 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_143f9036b95c45388916784f134edd5d" } modify_external_catalogs: true
I20260317 20:57:37.920035 798 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_143f9036b95c45388916784f134edd5d" } modify_external_catalogs: true
I20260317 20:57:37.924425 1843 tablet_bootstrap.cc:492] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:37.924579 1843 ts_tablet_manager.cc:1403] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20260317 20:57:37.925123 1843 raft_consensus.cc:359] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.925244 1843 raft_consensus.cc:385] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.925277 1843 raft_consensus.cc:740] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.925401 1843 consensus_queue.cc:260] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.925729 1843 ts_tablet_manager.cc:1434] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.925982 1841 tablet_bootstrap.cc:492] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.926116 1841 ts_tablet_manager.cc:1403] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20260317 20:57:37.926682 1841 raft_consensus.cc:359] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.926795 1841 raft_consensus.cc:385] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.926832 1841 raft_consensus.cc:740] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.926945 1841 consensus_queue.cc:260] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.927227 1841 ts_tablet_manager.cc:1434] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.927357 2107 tablet.cc:1723] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:37.938721 794 catalog_manager.cc:2174] created HMS catalog entry for table [id=908584e6a5aa4ab7b658f151fc6a7c41]
I20260317 20:57:37.941208 1565 consensus_queue.cc:1048] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.948143 794 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 100) took 1277 ms. Trace:
I20260317 20:57:37.948249 794 rpcz_store.cc:276] 0317 20:57:36.671102 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.464111 (+793009us) service_pool.cc:225] Handling call
0317 20:57:37.709442 (+245331us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:37.709742 (+ 300us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:37.938708 (+228966us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:37.947942 (+ 9234us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:37.948047 (+ 105us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:37.948122 (+ 75us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:37.939406 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:37.939513 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:37.939518 (+ 5us) write_op.cc:435] Acquired schema lock
0317 20:57:37.939520 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:37.939591 (+ 71us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:37.939601 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:37.939604 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:37.939659 (+ 55us) tablet.cc:700] Row locks acquired
0317 20:57:37.939660 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:37.939687 (+ 27us) write_op.cc:270] Start()
0317 20:57:37.939714 (+ 27us) write_op.cc:276] Timestamp: P: 1773781057939591 usec, L: 0
0317 20:57:37.939717 (+ 3us) op_driver.cc:348] REPLICATION: starting
0317 20:57:37.939857 (+ 140us) log.cc:844] Serialized 433 byte log entry
0317 20:57:37.942615 (+ 2758us) op_driver.cc:464] REPLICATION: finished
0317 20:57:37.947412 (+ 4797us) write_op.cc:301] APPLY: starting
0317 20:57:37.947434 (+ 22us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:37.947474 (+ 40us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:37.947491 (+ 17us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:37.947586 (+ 95us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:37.947619 (+ 33us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:37.947623 (+ 4us) write_op.cc:312] APPLY: finished
0317 20:57:37.947696 (+ 73us) log.cc:844] Serialized 29 byte log entry
0317 20:57:37.947767 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.947783 (+ 16us) write_op.cc:454] Released schema lock
0317 20:57:37.947789 (+ 6us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:37.947870 (+ 81us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:37.947872 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":169958,"Hive Metastore.run_cpu_time_us":205,"Hive Metastore.run_wall_time_us":58743,"child_traces":[["op",{"apply.queue_time_us":4717,"apply.run_cpu_time_us":453,"apply.run_wall_time_us":453,"num_ops":2,"prepare.queue_time_us":46,"prepare.run_cpu_time_us":542,"prepare.run_wall_time_us":543,"raft.queue_time_us":948,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":326,"replication_time_us":2870}]]}
I20260317 20:57:37.949749 794 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" } modify_external_catalogs: true
I20260317 20:57:37.949906 794 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" } modify_external_catalogs: true
I20260317 20:57:37.950765 795 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_a9891e641d7144228ae4fa567a20f67d" } new_table_name: "default.Table_db0d09da77234c72a4649ad59de113e0" modify_external_catalogs: true
I20260317 20:57:37.955542 2107 tablet.cc:1723] T 4dbe1ef827b545dfa7a4aba06e254a03 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:37.957803 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 09b20a5babe8490dba78f9ac1296a58c (DEFAULT_TABLE table=default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.958474 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 09b20a5babe8490dba78f9ac1296a58c (DEFAULT_TABLE table=default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.958539 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b20a5babe8490dba78f9ac1296a58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.958753 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b20a5babe8490dba78f9ac1296a58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.960800 1841 tablet_bootstrap.cc:492] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:37.961874 1841 tablet_bootstrap.cc:654] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.962457 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 09b20a5babe8490dba78f9ac1296a58c (DEFAULT_TABLE table=default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:37.962734 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09b20a5babe8490dba78f9ac1296a58c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:37.964078 1565 consensus_queue.cc:1048] T b5739d6cb9a84de78767b471608f1671 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:37.965368 1842 tablet_bootstrap.cc:492] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:37.966274 1842 tablet_bootstrap.cc:654] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.966742 1843 tablet_bootstrap.cc:492] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:37.967104 1841 tablet_bootstrap.cc:492] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:37.967190 1841 ts_tablet_manager.cc:1403] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:37.968139 1841 raft_consensus.cc:359] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.968248 1841 raft_consensus.cc:385] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.968281 1841 raft_consensus.cc:740] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.968314 1843 tablet_bootstrap.cc:654] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:37.968417 1841 consensus_queue.cc:260] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.968737 1841 ts_tablet_manager.cc:1434] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:37.972335 2026 tablet.cc:1723] T 4dbe1ef827b545dfa7a4aba06e254a03 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:37.979089 1842 tablet_bootstrap.cc:492] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:37.979226 1842 ts_tablet_manager.cc:1403] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20260317 20:57:37.979712 1842 raft_consensus.cc:359] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.979830 1842 raft_consensus.cc:385] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:37.979869 1842 raft_consensus.cc:740] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:37.979997 1842 consensus_queue.cc:260] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:37.980295 1842 ts_tablet_manager.cc:1434] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:37.984823 799 catalog_manager.cc:2174] created HMS catalog entry for table [id=c406620a80784edcbc4741933c4dde1c]
I20260317 20:57:37.999878 799 catalog_manager.cc:5671] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:38.000726 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc0397641de4016baca65a655b38c30 (DEFAULT_TABLE table=default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.001049 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc0397641de4016baca65a655b38c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.004309 1841 tablet_bootstrap.cc:492] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:38.005442 1841 tablet_bootstrap.cc:654] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.006114 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc0397641de4016baca65a655b38c30 (DEFAULT_TABLE table=default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.006485 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc0397641de4016baca65a655b38c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.008078 799 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_4b318a4173584e1298cc874712d94e47" } modify_external_catalogs: true
I20260317 20:57:38.008224 799 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57868:
table { table_name: "default.Table_4b318a4173584e1298cc874712d94e47" } modify_external_catalogs: true
I20260317 20:57:38.015247 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 1bc0397641de4016baca65a655b38c30 (DEFAULT_TABLE table=default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.015638 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bc0397641de4016baca65a655b38c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.016321 1841 tablet_bootstrap.cc:492] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:38.016423 1841 ts_tablet_manager.cc:1403] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260317 20:57:38.017041 1841 raft_consensus.cc:359] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.017163 1841 raft_consensus.cc:385] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.017194 1841 raft_consensus.cc:740] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.017325 1841 consensus_queue.cc:260] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.017629 1841 ts_tablet_manager.cc:1434] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:38.018270 1842 tablet_bootstrap.cc:492] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:38.019583 1842 tablet_bootstrap.cc:654] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.031966 1842 tablet_bootstrap.cc:492] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:38.032123 1842 ts_tablet_manager.cc:1403] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20260317 20:57:38.032689 1842 raft_consensus.cc:359] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.032815 1842 raft_consensus.cc:385] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.032847 1842 raft_consensus.cc:740] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.032981 1842 consensus_queue.cc:260] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.033322 1842 ts_tablet_manager.cc:1434] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:38.043423 1041 tablet_service.cc:1511] Processing CreateTablet for tablet d41e07f06cdc44a7821b1dfab9135b23 (DEFAULT_TABLE table=default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.043530 1176 tablet_service.cc:1511] Processing CreateTablet for tablet d41e07f06cdc44a7821b1dfab9135b23 (DEFAULT_TABLE table=default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.043741 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41e07f06cdc44a7821b1dfab9135b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.043831 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41e07f06cdc44a7821b1dfab9135b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.047506 2027 tablet.cc:1723] T 4dbe1ef827b545dfa7a4aba06e254a03 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:38.050102 1313 tablet_service.cc:1511] Processing CreateTablet for tablet d41e07f06cdc44a7821b1dfab9135b23 (DEFAULT_TABLE table=default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.050472 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d41e07f06cdc44a7821b1dfab9135b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.051807 791 catalog_manager.cc:3502] renamed table default.table_d75875b48ed64da7a376b2b012ffe68c [id=d3ad9378b2884b7b8b856a82a8cd0ff7] in HMS: new name default.table_4ff5658252364bb1bf6fa149608be43f
I20260317 20:57:38.052206 1841 tablet_bootstrap.cc:492] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:38.053283 1842 tablet_bootstrap.cc:492] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:38.053452 1841 tablet_bootstrap.cc:654] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.054438 1842 tablet_bootstrap.cc:654] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.063148 1843 tablet_bootstrap.cc:492] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:38.063264 1843 ts_tablet_manager.cc:1403] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.001s
I20260317 20:57:38.063848 1843 raft_consensus.cc:359] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.063956 1843 raft_consensus.cc:385] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.064002 1843 raft_consensus.cc:740] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.064126 1843 consensus_queue.cc:260] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.064399 1843 ts_tablet_manager.cc:1434] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:38.064567 1843 tablet_bootstrap.cc:492] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:38.065725 1843 tablet_bootstrap.cc:654] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.070892 1841 tablet_bootstrap.cc:492] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:38.071062 1841 ts_tablet_manager.cc:1403] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20260317 20:57:38.071591 1841 raft_consensus.cc:359] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.071722 1841 raft_consensus.cc:385] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.071754 1841 raft_consensus.cc:740] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.071882 1841 consensus_queue.cc:260] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.072165 1841 ts_tablet_manager.cc:1434] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:38.076473 1843 tablet_bootstrap.cc:492] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:38.076931 1843 ts_tablet_manager.cc:1403] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s
I20260317 20:57:38.077525 1843 raft_consensus.cc:359] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.077641 1843 raft_consensus.cc:385] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.077670 1843 raft_consensus.cc:740] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.077955 1843 consensus_queue.cc:260] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.078336 1843 ts_tablet_manager.cc:1434] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:38.079361 1842 tablet_bootstrap.cc:492] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:38.079465 1842 ts_tablet_manager.cc:1403] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.000s
I20260317 20:57:38.079795 1843 tablet_bootstrap.cc:492] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:38.080015 1842 raft_consensus.cc:359] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.080122 1842 raft_consensus.cc:385] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.080153 1842 raft_consensus.cc:740] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.080287 1842 consensus_queue.cc:260] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.080627 1842 ts_tablet_manager.cc:1434] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:38.080984 1843 tablet_bootstrap.cc:654] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.090783 1462 consensus_queue.cc:1048] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.091037 1843 tablet_bootstrap.cc:492] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:38.091146 1843 ts_tablet_manager.cc:1403] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260317 20:57:38.091693 1843 raft_consensus.cc:359] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.091805 1843 raft_consensus.cc:385] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.091833 1843 raft_consensus.cc:740] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.091956 1843 consensus_queue.cc:260] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.092269 1843 ts_tablet_manager.cc:1434] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:38.092319 792 catalog_manager.cc:2174] created HMS catalog entry for table [id=06410da5fbbd4232956782060e2ccf0d]
I20260317 20:57:38.096701 2091 raft_consensus.cc:493] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:38.096872 2091 raft_consensus.cc:515] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.097333 2091 leader_election.cc:290] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:38.098336 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67839dc0e7439e8ffa370019a88afd" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:38.098520 1198 raft_consensus.cc:2468] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:38.098928 995 leader_election.cc:304] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:38.100723 792 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:57868 (request call id 103) took 1048 ms. Trace:
I20260317 20:57:38.100808 792 rpcz_store.cc:276] 0317 20:57:37.052245 (+ 0us) service_pool.cc:168] Inserting onto call queue
0317 20:57:37.469925 (+417680us) service_pool.cc:225] Handling call
0317 20:57:37.710996 (+241071us) catalog_manager.cc:2101] Acquired catalog manager lock
0317 20:57:37.711308 (+ 312us) catalog_manager.cc:2147] Created new table and tablet info
0317 20:57:38.092309 (+381001us) catalog_manager.cc:2173] Created new table in HMS catalog
0317 20:57:38.100532 (+ 8223us) catalog_manager.cc:2207] Wrote table and tablets to system table
0317 20:57:38.100625 (+ 93us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
0317 20:57:38.100704 (+ 79us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0317 20:57:38.092905 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0317 20:57:38.093026 (+ 121us) write_op.cc:432] Acquiring schema lock in shared mode
0317 20:57:38.093030 (+ 4us) write_op.cc:435] Acquired schema lock
0317 20:57:38.093032 (+ 2us) tablet.cc:661] Decoding operations
0317 20:57:38.093100 (+ 68us) write_op.cc:620] Acquiring the partition lock for write op
0317 20:57:38.093110 (+ 10us) write_op.cc:641] Partition lock acquired for write op
0317 20:57:38.093113 (+ 3us) tablet.cc:684] Acquiring locks for 2 operations
0317 20:57:38.093171 (+ 58us) tablet.cc:700] Row locks acquired
0317 20:57:38.093172 (+ 1us) write_op.cc:260] PREPARE: finished
0317 20:57:38.093205 (+ 33us) write_op.cc:270] Start()
0317 20:57:38.093235 (+ 30us) write_op.cc:276] Timestamp: P: 1773781058093178 usec, L: 0
0317 20:57:38.093237 (+ 2us) op_driver.cc:348] REPLICATION: starting
0317 20:57:38.093370 (+ 133us) log.cc:844] Serialized 433 byte log entry
0317 20:57:38.099799 (+ 6429us) op_driver.cc:464] REPLICATION: finished
0317 20:57:38.099997 (+ 198us) write_op.cc:301] APPLY: starting
0317 20:57:38.100017 (+ 20us) tablet.cc:1366] starting BulkCheckPresence
0317 20:57:38.100059 (+ 42us) tablet.cc:1369] finished BulkCheckPresence
0317 20:57:38.100075 (+ 16us) tablet.cc:1371] starting ApplyRowOperation cycle
0317 20:57:38.100160 (+ 85us) tablet.cc:1382] finished ApplyRowOperation cycle
0317 20:57:38.100206 (+ 46us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0317 20:57:38.100211 (+ 5us) write_op.cc:312] APPLY: finished
0317 20:57:38.100282 (+ 71us) log.cc:844] Serialized 29 byte log entry
0317 20:57:38.100344 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:38.100366 (+ 22us) write_op.cc:454] Released schema lock
0317 20:57:38.100371 (+ 5us) write_op.cc:341] FINISH: Updating metrics
0317 20:57:38.100437 (+ 66us) write_op.cc:489] Releasing partition, row and schema locks
0317 20:57:38.100438 (+ 1us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":340290,"Hive Metastore.run_cpu_time_us":195,"Hive Metastore.run_wall_time_us":40430,"child_traces":[["op",{"apply.queue_time_us":141,"apply.run_cpu_time_us":431,"apply.run_wall_time_us":431,"num_ops":2,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":569,"prepare.run_wall_time_us":568,"raft.queue_time_us":293,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":362,"replication_time_us":6524,"spinlock_wait_cycles":100608}]]}
I20260317 20:57:38.104831 2038 consensus_queue.cc:1048] T 1947a091d5c8450abb0b7ed7acc05136 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.107250 1819 raft_consensus.cc:2804] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:38.107347 1819 raft_consensus.cc:493] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:38.107384 1819 raft_consensus.cc:3060] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.108599 1819 raft_consensus.cc:515] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.109062 1819 leader_election.cc:290] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:38.111065 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67839dc0e7439e8ffa370019a88afd" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:38.111228 1196 raft_consensus.cc:3060] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.112525 1196 raft_consensus.cc:2468] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:38.113389 995 leader_election.cc:304] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:38.113652 2099 raft_consensus.cc:2804] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:38.113732 2099 raft_consensus.cc:697] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:38.113893 2099 consensus_queue.cc:237] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.114933 2038 consensus_queue.cc:1048] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.117679 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67839dc0e7439e8ffa370019a88afd" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:38.117846 1334 raft_consensus.cc:3060] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.119015 1334 raft_consensus.cc:2468] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:38.117679 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "db67839dc0e7439e8ffa370019a88afd" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:38.119583 1332 raft_consensus.cc:2376] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1. Re-sending same reply.
I20260317 20:57:38.128351 1462 consensus_queue.cc:1048] T 2919b2a953ef4d74955ca04b622b6c33 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.145313 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 3958625929884f3397edf4c3aee3260e (DEFAULT_TABLE table=default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.145313 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 3958625929884f3397edf4c3aee3260e (DEFAULT_TABLE table=default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.145689 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3958625929884f3397edf4c3aee3260e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.145689 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3958625929884f3397edf4c3aee3260e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.146726 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 3958625929884f3397edf4c3aee3260e (DEFAULT_TABLE table=default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.147059 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3958625929884f3397edf4c3aee3260e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.148689 1842 tablet_bootstrap.cc:492] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:38.148689 1841 tablet_bootstrap.cc:492] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:38.149752 1843 tablet_bootstrap.cc:492] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:38.149871 1842 tablet_bootstrap.cc:654] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.149871 1841 tablet_bootstrap.cc:654] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.150882 1843 tablet_bootstrap.cc:654] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.151136 1806 raft_consensus.cc:493] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:38.151227 1806 raft_consensus.cc:515] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.151582 1806 leader_election.cc:290] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:38.152046 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc0397641de4016baca65a655b38c30" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:38.152181 1061 raft_consensus.cc:2468] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:38.153039 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc0397641de4016baca65a655b38c30" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:38.153162 1198 raft_consensus.cc:2468] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:38.153595 1269 leader_election.cc:304] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:38.153793 1462 raft_consensus.cc:2804] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:38.153836 1462 raft_consensus.cc:493] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:38.153870 1462 raft_consensus.cc:3060] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.154989 1841 tablet_bootstrap.cc:492] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:38.155102 1841 ts_tablet_manager.cc:1403] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20260317 20:57:38.155097 1462 raft_consensus.cc:515] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.155534 1462 leader_election.cc:290] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:38.155664 1841 raft_consensus.cc:359] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.155772 1841 raft_consensus.cc:385] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.155803 1841 raft_consensus.cc:740] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.155958 1841 consensus_queue.cc:260] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.156463 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc0397641de4016baca65a655b38c30" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:38.156591 1198 raft_consensus.cc:3060] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.157714 1198 raft_consensus.cc:2468] T 1bc0397641de4016baca65a655b38c30 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:38.158288 1841 ts_tablet_manager.cc:1434] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260317 20:57:38.158748 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bc0397641de4016baca65a655b38c30" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:38.158865 1061 raft_consensus.cc:3060] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.159863 1061 raft_consensus.cc:2468] T 1bc0397641de4016baca65a655b38c30 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:38.160696 1269 leader_election.cc:304] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:38.160873 1842 tablet_bootstrap.cc:492] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:38.161008 1842 ts_tablet_manager.cc:1403] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260317 20:57:38.161127 1806 raft_consensus.cc:2804] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:38.161248 1806 raft_consensus.cc:697] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:38.161401 1806 consensus_queue.cc:237] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.162312 1842 raft_consensus.cc:359] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.162434 1842 raft_consensus.cc:385] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.162472 1842 raft_consensus.cc:740] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.162598 1842 consensus_queue.cc:260] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.162994 1842 ts_tablet_manager.cc:1434] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:38.179075 792 catalog_manager.cc:5671] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:38.183601 797 catalog_manager.cc:3502] renamed table default.table_70c346e7110644f2b3b5b4bec1789d4a [id=bc541149fbdd48ea9861ed3c108807cd] in HMS: new name default.table_fb41c97ca0a9409c963fbe195007a57f
I20260317 20:57:38.184798 1843 tablet_bootstrap.cc:492] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:38.184922 1843 ts_tablet_manager.cc:1403] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.000s
I20260317 20:57:38.185492 1843 raft_consensus.cc:359] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.185616 1843 raft_consensus.cc:385] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.185649 1843 raft_consensus.cc:740] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.185781 1843 consensus_queue.cc:260] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.186158 1843 ts_tablet_manager.cc:1434] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:38.196194 792 catalog_manager.cc:5671] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:38.197328 1449 raft_consensus.cc:493] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:38.197453 1449 raft_consensus.cc:515] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.197872 1449 leader_election.cc:290] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:38.199302 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41e07f06cdc44a7821b1dfab9135b23" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:38.199463 1059 raft_consensus.cc:2468] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:38.199709 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41e07f06cdc44a7821b1dfab9135b23" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:38.199842 1332 raft_consensus.cc:2468] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:38.200565 1133 leader_election.cc:304] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:38.201211 1715 raft_consensus.cc:2804] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:38.201306 1715 raft_consensus.cc:493] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:38.201386 1715 raft_consensus.cc:3060] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.202430 1715 raft_consensus.cc:515] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.202819 1715 leader_election.cc:290] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:38.203496 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41e07f06cdc44a7821b1dfab9135b23" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:38.203634 1334 raft_consensus.cc:3060] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.204741 1334 raft_consensus.cc:2468] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:38.205477 2027 tablet.cc:1723] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:38.205818 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d41e07f06cdc44a7821b1dfab9135b23" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:38.205973 1059 raft_consensus.cc:3060] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.206139 1133 leader_election.cc:304] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:38.206318 1449 raft_consensus.cc:2804] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:38.206408 1449 raft_consensus.cc:697] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:38.206475 2107 tablet.cc:1723] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:38.206547 1449 consensus_queue.cc:237] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.207105 1059 raft_consensus.cc:2468] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:38.207728 2026 tablet.cc:1723] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260317 20:57:38.213268 796 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_f3bf180436c74527a1909f1af367814e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:38.217414 2026 tablet.cc:1723] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:38.218011 2027 tablet.cc:1723] T fc76f8e8a4af47aba2a64bd60fc6941f P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:38.218959 2107 tablet.cc:1723] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260317 20:57:38.231956 792 master_service.cc:954] ReplaceTablet: received request to replace tablet c18f4a20ec004a0dae553e1a1a331947 from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:38.239655 792 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet c18f4a20ec004a0dae553e1a1a331947
I20260317 20:57:38.240420 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet c18f4a20ec004a0dae553e1a1a331947 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d60f1c4eba344a3bbf72ab296b68843) from {username='slave'} at 127.0.0.1:60100
I20260317 20:57:38.240458 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet c18f4a20ec004a0dae553e1a1a331947 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d60f1c4eba344a3bbf72ab296b68843) from {username='slave'} at 127.0.0.1:50668
I20260317 20:57:38.240535 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet c18f4a20ec004a0dae553e1a1a331947 with delete_type TABLET_DATA_DELETED (replaced by tablet 7d60f1c4eba344a3bbf72ab296b68843) from {username='slave'} at 127.0.0.1:59376
I20260317 20:57:38.240633 2050 tablet_replica.cc:333] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:38.240808 2050 raft_consensus.cc:2243] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:38.240845 2132 tablet_replica.cc:333] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:38.240936 2050 raft_consensus.cc:2272] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:38.240974 2132 raft_consensus.cc:2243] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:38.241119 2049 tablet_replica.cc:333] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:38.241186 2132 raft_consensus.cc:2272] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:38.241255 2049 raft_consensus.cc:2243] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:38.241355 2049 raft_consensus.cc:2272] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:38.241989 2132 ts_tablet_manager.cc:1916] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:38.242228 2049 ts_tablet_manager.cc:1916] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:38.244464 2049 ts_tablet_manager.cc:1929] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:38.244464 2132 ts_tablet_manager.cc:1929] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:38.244537 2049 log.cc:1199] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/c18f4a20ec004a0dae553e1a1a331947
I20260317 20:57:38.244537 2132 log.cc:1199] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/c18f4a20ec004a0dae553e1a1a331947
I20260317 20:57:38.244807 2132 ts_tablet_manager.cc:1950] T c18f4a20ec004a0dae553e1a1a331947 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:38.244807 2049 ts_tablet_manager.cc:1950] T c18f4a20ec004a0dae553e1a1a331947 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:38.245086 1449 raft_consensus.cc:493] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:38.245168 1449 raft_consensus.cc:515] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.245582 1449 leader_election.cc:290] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:38.245724 2050 ts_tablet_manager.cc:1916] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:38.246078 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b20a5babe8490dba78f9ac1296a58c" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:38.246206 1059 raft_consensus.cc:2468] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:38.246232 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b20a5babe8490dba78f9ac1296a58c" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:38.246344 1334 raft_consensus.cc:2468] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:38.246567 1133 leader_election.cc:304] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:38.247002 786 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet c18f4a20ec004a0dae553e1a1a331947 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]) successfully deleted
I20260317 20:57:38.247062 1449 raft_consensus.cc:2804] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:38.247112 1449 raft_consensus.cc:493] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:38.247146 1449 raft_consensus.cc:3060] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.247516 785 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet c18f4a20ec004a0dae553e1a1a331947 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]) successfully deleted
I20260317 20:57:38.248080 2050 ts_tablet_manager.cc:1929] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:38.248080 1449 raft_consensus.cc:515] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.248147 2050 log.cc:1199] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/c18f4a20ec004a0dae553e1a1a331947
I20260317 20:57:38.248402 2050 ts_tablet_manager.cc:1950] T c18f4a20ec004a0dae553e1a1a331947 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:38.248428 1449 leader_election.cc:290] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:38.248775 1334 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b20a5babe8490dba78f9ac1296a58c" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:38.248919 1334 raft_consensus.cc:3060] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.249061 792 catalog_manager.cc:6741] ReplaceTablet: tablet c18f4a20ec004a0dae553e1a1a331947 deleted and replaced by tablet 7d60f1c4eba344a3bbf72ab296b68843
I20260317 20:57:38.249933 1334 raft_consensus.cc:2468] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:38.250336 786 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet c18f4a20ec004a0dae553e1a1a331947 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]) successfully deleted
I20260317 20:57:38.250958 1133 leader_election.cc:304] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:38.252859 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09b20a5babe8490dba78f9ac1296a58c" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:38.253026 1059 raft_consensus.cc:3060] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.254231 1059 raft_consensus.cc:2468] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:38.258178 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 7d60f1c4eba344a3bbf72ab296b68843 (DEFAULT_TABLE table=default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.258347 1449 raft_consensus.cc:2804] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:38.258453 1449 raft_consensus.cc:697] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:38.258539 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d60f1c4eba344a3bbf72ab296b68843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.258592 1449 consensus_queue.cc:237] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.261034 1841 tablet_bootstrap.cc:492] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:38.262301 1841 tablet_bootstrap.cc:654] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.262938 411 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu with pid 766
I20260317 20:57:38.265736 1313 tablet_service.cc:1511] Processing CreateTablet for tablet 7d60f1c4eba344a3bbf72ab296b68843 (DEFAULT_TABLE table=default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.265972 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 7d60f1c4eba344a3bbf72ab296b68843 (DEFAULT_TABLE table=default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:38.266093 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d60f1c4eba344a3bbf72ab296b68843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.266264 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d60f1c4eba344a3bbf72ab296b68843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:38.268458 1843 tablet_bootstrap.cc:492] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:38.269178 1842 tablet_bootstrap.cc:492] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:38.269451 1843 tablet_bootstrap.cc:654] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.270380 1842 tablet_bootstrap.cc:654] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:38.273175 1842 tablet_bootstrap.cc:492] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:38.273272 1842 ts_tablet_manager.cc:1403] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:38.273787 1842 raft_consensus.cc:359] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.273905 1842 raft_consensus.cc:385] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.273941 1842 raft_consensus.cc:740] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.274132 1842 consensus_queue.cc:260] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.274500 1842 ts_tablet_manager.cc:1434] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:38.284226 1848 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: recv got EOF from 127.0.102.253:38969 (error 108),
I20260317 20:57:38.286559 1848 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:57:38.286859 1893 connection.cc:537] server connection from 127.0.0.1:54496 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:38.287261 1268 connection.cc:537] server connection from 127.0.0.1:60100 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:38.289462 857 connection.cc:537] server connection from 127.0.0.1:54000 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:38.290740 1389 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:38.290802 995 connection.cc:537] server connection from 127.0.0.1:59376 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:38.291098 1389 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:38.291126 1134 connection.cc:537] server connection from 127.0.0.1:50668 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:38.291366 1389 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:38.291522 1389 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.102.253:38969)
I20260317 20:57:38.293787 1841 tablet_bootstrap.cc:492] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:38.293905 1841 ts_tablet_manager.cc:1403] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20260317 20:57:38.294533 1841 raft_consensus.cc:359] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.294656 1841 raft_consensus.cc:385] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.294689 1841 raft_consensus.cc:740] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:38.294817 1841 consensus_queue.cc:260] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.295102 1841 ts_tablet_manager.cc:1434] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260317 20:57:38.302829 2137 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:38.288595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.102.195:36061)
0317 20:57:38.302245 (+ 13650us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:38.302328 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":13554,"thread_start_us":96,"threads_started":1}
I20260317 20:57:38.302858 1843 tablet_bootstrap.cc:492] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:38.302978 1843 ts_tablet_manager.cc:1403] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20260317 20:57:38.303531 1843 raft_consensus.cc:359] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.303661 1843 raft_consensus.cc:385] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:38.303695 1843 raft_consensus.cc:740] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
W20260317 20:57:38.303740 2138 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:38.289021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.102.194:39873)
0317 20:57:38.303171 (+ 14150us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:38.303237 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":14050,"thread_start_us":99,"threads_started":1}
I20260317 20:57:38.303831 1843 consensus_queue.cc:260] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.304150 1843 ts_tablet_manager.cc:1434] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
W20260317 20:57:38.306285 2139 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:38.290464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.102.193:33539)
0317 20:57:38.293250 (+ 2786us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:38.293316 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":2683,"thread_start_us":95,"threads_started":1}
W20260317 20:57:38.308480 2140 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:38.292379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.0.1:57888)
0317 20:57:38.307650 (+ 15271us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:38.307747 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":15158,"thread_start_us":76,"threads_started":1}
I20260317 20:57:38.317031 2038 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:38.317173 2038 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.317601 2038 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:38.318032 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958625929884f3397edf4c3aee3260e" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:38.318084 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958625929884f3397edf4c3aee3260e" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:38.318217 1059 raft_consensus.cc:2468] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:38.318194 1196 raft_consensus.cc:2468] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:38.318539 1268 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:38.318714 2038 raft_consensus.cc:2804] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:38.318763 2038 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:38.318795 2038 raft_consensus.cc:3060] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.319888 2038 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.320327 2038 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:38.320729 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958625929884f3397edf4c3aee3260e" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:38.320786 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3958625929884f3397edf4c3aee3260e" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:38.320852 1059 raft_consensus.cc:3060] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.320910 1196 raft_consensus.cc:3060] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.321906 1059 raft_consensus.cc:2468] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:38.321960 1196 raft_consensus.cc:2468] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:38.322474 1269 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:38.322796 2038 raft_consensus.cc:2804] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:38.322877 2038 raft_consensus.cc:697] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:38.323015 2038 consensus_queue.cc:237] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:38.422590 2091 consensus_queue.cc:1048] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.428581 2038 raft_consensus.cc:493] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:38.428733 2038 raft_consensus.cc:515] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.429198 2038 leader_election.cc:290] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:38.430310 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60f1c4eba344a3bbf72ab296b68843" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:38.430442 1059 raft_consensus.cc:2468] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:38.431038 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60f1c4eba344a3bbf72ab296b68843" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:38.431180 1196 raft_consensus.cc:2468] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:38.431694 1269 leader_election.cc:304] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:38.432986 1819 consensus_queue.cc:1048] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.434111 1462 raft_consensus.cc:2804] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:38.434183 1462 raft_consensus.cc:493] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:38.434237 1462 raft_consensus.cc:3060] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.435420 1462 raft_consensus.cc:515] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.435825 1462 leader_election.cc:290] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:38.437566 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60f1c4eba344a3bbf72ab296b68843" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:38.437695 1196 raft_consensus.cc:3060] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.438796 1196 raft_consensus.cc:2468] T 7d60f1c4eba344a3bbf72ab296b68843 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:38.440095 1059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d60f1c4eba344a3bbf72ab296b68843" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:38.440253 1059 raft_consensus.cc:3060] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:38.441351 1059 raft_consensus.cc:2468] T 7d60f1c4eba344a3bbf72ab296b68843 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:38.442198 1268 leader_election.cc:304] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:38.443074 2038 raft_consensus.cc:2804] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:38.443163 2038 raft_consensus.cc:697] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:38.443315 2038 consensus_queue.cc:237] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:38.465587 1819 consensus_queue.cc:1048] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.475720 2099 consensus_queue.cc:1048] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.587510 1449 consensus_queue.cc:1048] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.598474 1715 consensus_queue.cc:1048] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.608279 2038 consensus_queue.cc:1048] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.613682 2038 consensus_queue.cc:1048] T 1bc0397641de4016baca65a655b38c30 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.622967 1819 consensus_queue.cc:1048] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.637992 2099 consensus_queue.cc:1048] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.688877 1715 consensus_queue.cc:1048] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.701393 1715 consensus_queue.cc:1048] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.763903 2159 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:38.764065 2159 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:38.766700 2159 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:38.767338 857 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:38.772629 2160 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:38.772841 2160 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:38.774015 1917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 223 } } ignore_live_leader: false dest_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" is_pre_election: true
I20260317 20:57:38.774312 1917 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a5313a52eb40a3ab5d14d0d8be52f7 in term 1.
I20260317 20:57:38.774744 2160 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:38.775537 858 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, 5022d9ddb45c41faa9f114e2a0a31fc3; no voters:
I20260317 20:57:38.776094 2159 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260317 20:57:38.776180 2159 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:38.776230 2159 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 1 FOLLOWER]: Advancing to term 2
I20260317 20:57:38.777407 2159 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:38.778494 1917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 223 } } ignore_live_leader: false dest_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
I20260317 20:57:38.778647 1917 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 1 FOLLOWER]: Advancing to term 2
I20260317 20:57:38.780894 1917 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a5313a52eb40a3ab5d14d0d8be52f7 in term 2.
I20260317 20:57:38.783051 858 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, 5022d9ddb45c41faa9f114e2a0a31fc3; no voters:
I20260317 20:57:38.783536 2159 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 2 election: Requested vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
I20260317 20:57:38.783690 2159 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260317 20:57:38.783776 2159 raft_consensus.cc:697] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 2 LEADER]: Becoming Leader. State: Replica: 15a5313a52eb40a3ab5d14d0d8be52f7, State: Running, Role: LEADER
I20260317 20:57:38.784121 2159 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 222, Committed index: 222, Last appended: 1.223, Last appended by leader: 223, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
W20260317 20:57:38.784822 857 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:38.785569 857 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:38.785585 2159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15a5313a52eb40a3ab5d14d0d8be52f7. Latest consensus state: current_term: 2 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:38.786144 2159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: LEADER
W20260317 20:57:38.786494 1892 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:38.787683 1892 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:38.789784 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" candidate_term: 2 candidate_status { last_received { term: 1 index: 223 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" is_pre_election: true
I20260317 20:57:38.790354 1891 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:38.790618 2160 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:38.818259 2038 consensus_queue.cc:1048] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.826467 1462 consensus_queue.cc:1048] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.882653 1462 consensus_queue.cc:1048] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:38.888145 1462 consensus_queue.cc:1048] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:39.101500 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.253:38969
--webserver_interface=127.0.102.253
--webserver_port=45191
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260317 20:57:39.216917 2176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:39.217185 2176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:39.217268 2176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:39.221273 2176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:39.221356 2176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:39.221378 2176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:39.221424 2176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:39.226850 2176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.253:38969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.102.253
--webserver_port=45191
--never_fsync=true
--heap_profile_path=/tmp/kudu.2176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:39.228386 2176 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:39.229869 2176 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:39.237509 2184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:39.238010 2181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:39.238466 2176 server_base.cc:1060] running on GCE node
W20260317 20:57:39.239066 2182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:39.239873 2176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:39.241245 2176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:39.242436 2176 hybrid_clock.cc:648] HybridClock initialized: now 1773781059242406 us; error 39 us; skew 500 ppm
I20260317 20:57:39.244445 2176 webserver.cc:492] Webserver started at http://127.0.102.253:45191/ using document root <none> and password file <none>
I20260317 20:57:39.245064 2176 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:39.245174 2176 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:39.249207 2176 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:39.251953 2190 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:39.253175 2176 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260317 20:57:39.253355 2176 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
uuid: "db5e708fd6404c0daa842bfc7e8f4806"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:39.253856 2176 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260317 20:57:39.265172 857 consensus_peers.cc:597] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 -> Peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Couldn't send request to peer db5e708fd6404c0daa842bfc7e8f4806. Status: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260317 20:57:39.269137 2176 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:39.269862 2176 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:39.270134 2176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:39.279053 2176 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.253:38969
I20260317 20:57:39.279053 2242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.253:38969 every 8 connection(s)
I20260317 20:57:39.280550 2176 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
I20260317 20:57:39.287734 2243 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:39.288429 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 2176
I20260317 20:57:39.291620 2243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap starting.
I20260317 20:57:39.296705 2247 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:39.296824 2247 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:39.297322 2247 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:39.298151 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" candidate_term: 3 candidate_status { last_received { term: 1 index: 223 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" is_pre_election: true
I20260317 20:57:39.305001 1382 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:39.318883 2243 log.cc:826] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:39.384539 1382 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:39.399736 1917 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 2 FOLLOWER]: Refusing update from remote peer 15a5313a52eb40a3ab5d14d0d8be52f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 223. Preceding OpId from leader: term: 2 index: 224. (index mismatch)
I20260317 20:57:39.400573 2159 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 224, Last known committed idx: 222, Time since last communication: 0.000s
I20260317 20:57:39.402029 2247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15a5313a52eb40a3ab5d14d0d8be52f7. Latest consensus state: current_term: 2 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.402201 2247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:39.403473 2251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.403613 2251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:39.404012 2247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.404157 2247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:39.432144 2168 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260317 20:57:39.435273 2168 catalog_manager.cc:679] Loaded metadata for table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]
I20260317 20:57:39.435678 2168 catalog_manager.cc:679] Loaded metadata for table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]
I20260317 20:57:39.435994 2168 catalog_manager.cc:679] Loaded metadata for table default.table_df3d165713f44a8b87b980f60d112d34 [id=06a4801fbead41c6adfb06c624d3c9ad]
I20260317 20:57:39.436251 2168 catalog_manager.cc:679] Loaded metadata for table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299]
I20260317 20:57:39.436522 2168 catalog_manager.cc:679] Loaded metadata for table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]
I20260317 20:57:39.437152 2168 catalog_manager.cc:679] Loaded metadata for table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]
I20260317 20:57:39.437531 2168 catalog_manager.cc:679] Loaded metadata for table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]
I20260317 20:57:39.438023 2168 catalog_manager.cc:679] Loaded metadata for table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]
I20260317 20:57:39.438319 2168 catalog_manager.cc:679] Loaded metadata for table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]
I20260317 20:57:39.438582 2168 catalog_manager.cc:679] Loaded metadata for table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]
I20260317 20:57:39.439183 2168 catalog_manager.cc:679] Loaded metadata for table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]
I20260317 20:57:39.439575 2168 catalog_manager.cc:679] Loaded metadata for table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]
I20260317 20:57:39.439822 2168 catalog_manager.cc:679] Loaded metadata for table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]
I20260317 20:57:39.440063 2168 catalog_manager.cc:679] Loaded metadata for table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]
I20260317 20:57:39.440310 2168 catalog_manager.cc:679] Loaded metadata for table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]
I20260317 20:57:39.440574 2168 catalog_manager.cc:679] Loaded metadata for table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]
I20260317 20:57:39.441038 2168 catalog_manager.cc:679] Loaded metadata for table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]
I20260317 20:57:39.441291 2168 catalog_manager.cc:679] Loaded metadata for table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]
I20260317 20:57:39.441570 2168 catalog_manager.cc:679] Loaded metadata for table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951]
I20260317 20:57:39.441931 2168 catalog_manager.cc:679] Loaded metadata for table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]
I20260317 20:57:39.442210 2168 catalog_manager.cc:679] Loaded metadata for table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd]
I20260317 20:57:39.442474 2168 catalog_manager.cc:679] Loaded metadata for table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]
I20260317 20:57:39.442734 2168 catalog_manager.cc:679] Loaded metadata for table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]
I20260317 20:57:39.443102 2168 catalog_manager.cc:679] Loaded metadata for table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]
I20260317 20:57:39.443367 2168 catalog_manager.cc:679] Loaded metadata for table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]
I20260317 20:57:39.443619 2168 catalog_manager.cc:679] Loaded metadata for table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]
I20260317 20:57:39.443864 2168 catalog_manager.cc:679] Loaded metadata for table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]
I20260317 20:57:39.444235 2168 catalog_manager.cc:679] Loaded metadata for table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]
I20260317 20:57:39.447235 2168 tablet_loader.cc:96] loaded metadata for tablet 09b20a5babe8490dba78f9ac1296a58c (table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182])
I20260317 20:57:39.447593 2168 tablet_loader.cc:96] loaded metadata for tablet 0d7946629e25418c9c23d09363e305b8 (table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4])
I20260317 20:57:39.447883 2168 tablet_loader.cc:96] loaded metadata for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62])
I20260317 20:57:39.448217 2168 tablet_loader.cc:96] loaded metadata for tablet 1947a091d5c8450abb0b7ed7acc05136 (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e])
I20260317 20:57:39.448549 2168 tablet_loader.cc:96] loaded metadata for tablet 1bc0397641de4016baca65a655b38c30 (table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41])
I20260317 20:57:39.448738 2168 tablet_loader.cc:96] loaded metadata for tablet 1e084fc67777419fb5af7936ab89e8bf (table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502])
I20260317 20:57:39.448964 2168 tablet_loader.cc:96] loaded metadata for tablet 2919b2a953ef4d74955ca04b622b6c33 (table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd])
I20260317 20:57:39.449311 2168 tablet_loader.cc:96] loaded metadata for tablet 3958625929884f3397edf4c3aee3260e (table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d])
I20260317 20:57:39.449632 2168 tablet_loader.cc:96] loaded metadata for tablet 46e5d823d53c465b8751f8c3cd8c09cf (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69])
I20260317 20:57:39.449968 2168 tablet_loader.cc:96] loaded metadata for tablet 492e0f23d6b74854bc68f51c8136d495 (table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543])
I20260317 20:57:39.450208 2168 tablet_loader.cc:96] loaded metadata for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93])
I20260317 20:57:39.450548 2168 tablet_loader.cc:96] loaded metadata for tablet 53bd2006d8e24f418a17e55cfec8fd21 (table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1])
I20260317 20:57:39.450906 2168 tablet_loader.cc:96] loaded metadata for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_df3d165713f44a8b87b980f60d112d34 [id=06a4801fbead41c6adfb06c624d3c9ad])
I20260317 20:57:39.451505 2168 tablet_loader.cc:96] loaded metadata for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d])
I20260317 20:57:39.452194 2168 tablet_loader.cc:96] loaded metadata for tablet 7d60f1c4eba344a3bbf72ab296b68843 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06])
I20260317 20:57:39.452409 2168 tablet_loader.cc:96] loaded metadata for tablet a78fdc83a3d54554a08f01915f102f6e (table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5])
I20260317 20:57:39.453083 2168 tablet_loader.cc:96] loaded metadata for tablet b5739d6cb9a84de78767b471608f1671 (table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2])
I20260317 20:57:39.453307 2168 tablet_loader.cc:96] loaded metadata for tablet b9794f5cae264d1392074b3a3daf3f46 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113])
I20260317 20:57:39.453512 2168 tablet_loader.cc:96] loaded metadata for tablet bf781fd3f8a941628cbe910fdbd7fab0 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3])
I20260317 20:57:39.453950 2168 tablet_loader.cc:96] loaded metadata for tablet d41e07f06cdc44a7821b1dfab9135b23 (table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c])
I20260317 20:57:39.454218 2168 tablet_loader.cc:96] loaded metadata for tablet d498b1efdbca451087928cdb42d06485 (table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498])
I20260317 20:57:39.454418 2168 tablet_loader.cc:96] loaded metadata for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951])
I20260317 20:57:39.454631 2168 tablet_loader.cc:96] loaded metadata for tablet d9a43741bfda4ccdb070e74b9f638766 (table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438])
I20260317 20:57:39.454696 2243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap replayed 1/1 log segments. Stats: ops{read=222 overwritten=0 applied=222 ignored=0} inserts{seen=152 ignored=0} mutations{seen=188 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:39.454843 2168 tablet_loader.cc:96] loaded metadata for tablet db67839dc0e7439e8ffa370019a88afd (table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4])
I20260317 20:57:39.455060 2168 tablet_loader.cc:96] loaded metadata for tablet dcc244fe79aa45e18427da2be335636a (table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427])
I20260317 20:57:39.455302 2243 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap complete.
I20260317 20:57:39.455415 2168 tablet_loader.cc:96] loaded metadata for tablet e4124783269f438c803d4fb68f223d20 (table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299])
I20260317 20:57:39.455855 2168 tablet_loader.cc:96] loaded metadata for tablet e69ac6bd9aca4af5aa72d76b4764b14c (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7])
I20260317 20:57:39.457531 2168 tablet_loader.cc:96] loaded metadata for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd])
I20260317 20:57:39.457842 2168 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260317 20:57:39.460094 2168 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:39.460166 2168 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260317 20:57:39.460013 2243 raft_consensus.cc:359] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:39.460506 2243 raft_consensus.cc:740] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: db5e708fd6404c0daa842bfc7e8f4806, State: Initialized, Role: FOLLOWER
I20260317 20:57:39.461047 2243 consensus_queue.cc:260] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 222, Last appended: 1.222, Last appended by leader: 222, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:39.462019 2168 catalog_manager.cc:1514] Loading token signing keys...
I20260317 20:57:39.462471 2243 sys_catalog.cc:565] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:39.462535 2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" candidate_term: 3 candidate_status { last_received { term: 1 index: 223 } } ignore_live_leader: false dest_uuid: "db5e708fd6404c0daa842bfc7e8f4806" is_pre_election: true
I20260317 20:57:39.462899 2217 raft_consensus.cc:2468] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5022d9ddb45c41faa9f114e2a0a31fc3 in term 1.
I20260317 20:57:39.463352 1892 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7
I20260317 20:57:39.463572 2247 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260317 20:57:39.463626 2247 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:57:39.463678 2247 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 2 FOLLOWER]: Advancing to term 3
I20260317 20:57:39.463887 2168 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Loaded TSK: 0
I20260317 20:57:39.464761 2247 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:39.464875 2168 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260317 20:57:39.465150 2247 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 3 election: Requested vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:39.465497 2217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" candidate_term: 3 candidate_status { last_received { term: 2 index: 224 } } ignore_live_leader: false dest_uuid: "db5e708fd6404c0daa842bfc7e8f4806"
I20260317 20:57:39.465634 2217 raft_consensus.cc:3060] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 1 FOLLOWER]: Advancing to term 3
I20260317 20:57:39.465744 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" candidate_term: 3 candidate_status { last_received { term: 2 index: 224 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
I20260317 20:57:39.467163 2168 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260317 20:57:39.467963 2217 raft_consensus.cc:2468] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5022d9ddb45c41faa9f114e2a0a31fc3 in term 3.
I20260317 20:57:39.468439 1892 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7
I20260317 20:57:39.468505 2168 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 74
I20260317 20:57:39.468473 2256 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.468596 2256 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:39.468613 2247 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 FOLLOWER]: Leader election won for term 3
I20260317 20:57:39.468879 2247 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 LEADER]: Becoming Leader. State: Replica: 5022d9ddb45c41faa9f114e2a0a31fc3, State: Running, Role: LEADER
I20260317 20:57:39.469182 2247 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 224, Committed index: 224, Last appended: 2.224, Last appended by leader: 224, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:39.470316 2273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5022d9ddb45c41faa9f114e2a0a31fc3. Latest consensus state: current_term: 3 leader_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.470413 2273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:39.471396 2276 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260317 20:57:39.473848 2270 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:39.473958 2270 catalog_manager.cc:1562] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: loading cluster ID for follower catalog manager: success
I20260317 20:57:39.477869 2270 catalog_manager.cc:1584] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: acquiring CA information for follower catalog manager: success
I20260317 20:57:39.477944 2276 catalog_manager.cc:679] Loaded metadata for table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]
I20260317 20:57:39.478473 2276 catalog_manager.cc:679] Loaded metadata for table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]
I20260317 20:57:39.478821 2276 catalog_manager.cc:679] Loaded metadata for table default.table_df3d165713f44a8b87b980f60d112d34 [id=06a4801fbead41c6adfb06c624d3c9ad]
I20260317 20:57:39.479153 2276 catalog_manager.cc:679] Loaded metadata for table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299]
I20260317 20:57:39.479457 2276 catalog_manager.cc:679] Loaded metadata for table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]
I20260317 20:57:39.479486 868 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42476:
table { table_name: "default.Table_e0a1ab3af8974191818e51a5608c5724" } modify_external_catalogs: true
I20260317 20:57:39.479547 867 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42476:
name: "default.Table_9c0299624ff84be09887bc390f45fffa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:39.479697 868 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42476:
table { table_name: "default.Table_e0a1ab3af8974191818e51a5608c5724" } modify_external_catalogs: true
I20260317 20:57:39.479944 864 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42476:
name: "default.Table_2bb25afec8d34b60a23f812af93043f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:39.479990 865 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42476:
table { table_name: "default.Table_ffa8292a8cda469787b621281ed2203c" } new_table_name: "default.Table_15d4ddf21b5d49f7bf9245c9e7e07e0e" modify_external_catalogs: true
I20260317 20:57:39.480170 862 master_service.cc:954] ReplaceTablet: received request to replace tablet e69ac6bd9aca4af5aa72d76b4764b14c from {username='slave'} at 127.0.0.1:42476
I20260317 20:57:39.480551 869 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42476:
name: "default.Table_20e6210c7a18419c901e9ae16b5560a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:39.480818 871 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42476:
name: "default.Table_2c85af89e0d2498184e2a12f5708ef6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:39.481055 870 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42476:
name: "default.Table_3d8df4ce76d747a38a984e386c6d96bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:39.481269 2276 catalog_manager.cc:679] Loaded metadata for table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]
I20260317 20:57:39.481303 866 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42476:
table { table_name: "default.Table_cde2029a6fbb404892afd070c4de7abd" } modify_external_catalogs: true
I20260317 20:57:39.481415 866 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42476:
table { table_name: "default.Table_cde2029a6fbb404892afd070c4de7abd" } modify_external_catalogs: true
I20260317 20:57:39.481604 863 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42476:
name: "default.Table_6215ae4e2f8745489185062d37f72f06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:39.483247 2276 catalog_manager.cc:679] Loaded metadata for table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]
I20260317 20:57:39.483845 2276 catalog_manager.cc:679] Loaded metadata for table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]
I20260317 20:57:39.484170 2276 catalog_manager.cc:679] Loaded metadata for table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]
I20260317 20:57:39.484460 2276 catalog_manager.cc:679] Loaded metadata for table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]
I20260317 20:57:39.484870 2270 catalog_manager.cc:1612] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:57:39.485155 2276 catalog_manager.cc:679] Loaded metadata for table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]
I20260317 20:57:39.485579 2276 catalog_manager.cc:679] Loaded metadata for table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]
I20260317 20:57:39.485850 2276 catalog_manager.cc:679] Loaded metadata for table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]
I20260317 20:57:39.486127 2276 catalog_manager.cc:679] Loaded metadata for table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]
I20260317 20:57:39.486413 2276 catalog_manager.cc:679] Loaded metadata for table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]
I20260317 20:57:39.486709 2276 catalog_manager.cc:679] Loaded metadata for table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]
I20260317 20:57:39.487274 2276 catalog_manager.cc:679] Loaded metadata for table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]
I20260317 20:57:39.487571 2276 catalog_manager.cc:679] Loaded metadata for table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]
I20260317 20:57:39.487861 2276 catalog_manager.cc:679] Loaded metadata for table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951]
I20260317 20:57:39.488272 2276 catalog_manager.cc:679] Loaded metadata for table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]
I20260317 20:57:39.488561 2276 catalog_manager.cc:679] Loaded metadata for table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd]
I20260317 20:57:39.488854 2276 catalog_manager.cc:679] Loaded metadata for table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]
I20260317 20:57:39.489163 2276 catalog_manager.cc:679] Loaded metadata for table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]
I20260317 20:57:39.489605 2276 catalog_manager.cc:679] Loaded metadata for table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]
I20260317 20:57:39.490025 2276 catalog_manager.cc:679] Loaded metadata for table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]
I20260317 20:57:39.490365 2276 catalog_manager.cc:679] Loaded metadata for table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]
I20260317 20:57:39.490645 2276 catalog_manager.cc:679] Loaded metadata for table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]
I20260317 20:57:39.491011 2276 catalog_manager.cc:679] Loaded metadata for table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]
I20260317 20:57:39.493813 2276 tablet_loader.cc:96] loaded metadata for tablet 09b20a5babe8490dba78f9ac1296a58c (table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182])
I20260317 20:57:39.494277 2276 tablet_loader.cc:96] loaded metadata for tablet 0d7946629e25418c9c23d09363e305b8 (table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4])
I20260317 20:57:39.494517 2276 tablet_loader.cc:96] loaded metadata for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62])
I20260317 20:57:39.494841 2276 tablet_loader.cc:96] loaded metadata for tablet 1947a091d5c8450abb0b7ed7acc05136 (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e])
I20260317 20:57:39.495299 2276 tablet_loader.cc:96] loaded metadata for tablet 1bc0397641de4016baca65a655b38c30 (table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41])
I20260317 20:57:39.495540 2276 tablet_loader.cc:96] loaded metadata for tablet 1e084fc67777419fb5af7936ab89e8bf (table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502])
I20260317 20:57:39.495800 2276 tablet_loader.cc:96] loaded metadata for tablet 2919b2a953ef4d74955ca04b622b6c33 (table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd])
I20260317 20:57:39.496160 2276 tablet_loader.cc:96] loaded metadata for tablet 3958625929884f3397edf4c3aee3260e (table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d])
I20260317 20:57:39.496536 2276 tablet_loader.cc:96] loaded metadata for tablet 46e5d823d53c465b8751f8c3cd8c09cf (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69])
I20260317 20:57:39.496984 2276 tablet_loader.cc:96] loaded metadata for tablet 492e0f23d6b74854bc68f51c8136d495 (table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543])
I20260317 20:57:39.497200 2276 tablet_loader.cc:96] loaded metadata for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93])
I20260317 20:57:39.497522 2276 tablet_loader.cc:96] loaded metadata for tablet 53bd2006d8e24f418a17e55cfec8fd21 (table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1])
I20260317 20:57:39.497843 2276 tablet_loader.cc:96] loaded metadata for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_df3d165713f44a8b87b980f60d112d34 [id=06a4801fbead41c6adfb06c624d3c9ad])
I20260317 20:57:39.498508 2276 tablet_loader.cc:96] loaded metadata for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d])
I20260317 20:57:39.499401 2276 tablet_loader.cc:96] loaded metadata for tablet 7d60f1c4eba344a3bbf72ab296b68843 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06])
I20260317 20:57:39.499667 2276 tablet_loader.cc:96] loaded metadata for tablet a78fdc83a3d54554a08f01915f102f6e (table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5])
I20260317 20:57:39.500415 2276 tablet_loader.cc:96] loaded metadata for tablet b5739d6cb9a84de78767b471608f1671 (table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2])
I20260317 20:57:39.500677 2276 tablet_loader.cc:96] loaded metadata for tablet b9794f5cae264d1392074b3a3daf3f46 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113])
I20260317 20:57:39.500926 2276 tablet_loader.cc:96] loaded metadata for tablet bf781fd3f8a941628cbe910fdbd7fab0 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3])
I20260317 20:57:39.501562 2276 tablet_loader.cc:96] loaded metadata for tablet d41e07f06cdc44a7821b1dfab9135b23 (table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c])
I20260317 20:57:39.501818 2276 tablet_loader.cc:96] loaded metadata for tablet d498b1efdbca451087928cdb42d06485 (table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498])
I20260317 20:57:39.502091 2276 tablet_loader.cc:96] loaded metadata for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951])
I20260317 20:57:39.502367 2276 tablet_loader.cc:96] loaded metadata for tablet d9a43741bfda4ccdb070e74b9f638766 (table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438])
I20260317 20:57:39.502624 2276 tablet_loader.cc:96] loaded metadata for tablet db67839dc0e7439e8ffa370019a88afd (table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4])
I20260317 20:57:39.502843 2276 tablet_loader.cc:96] loaded metadata for tablet dcc244fe79aa45e18427da2be335636a (table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427])
I20260317 20:57:39.503233 2276 tablet_loader.cc:96] loaded metadata for tablet e4124783269f438c803d4fb68f223d20 (table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299])
I20260317 20:57:39.503722 2276 tablet_loader.cc:96] loaded metadata for tablet e69ac6bd9aca4af5aa72d76b4764b14c (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7])
I20260317 20:57:39.504573 2276 tablet_loader.cc:96] loaded metadata for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd])
I20260317 20:57:39.504920 2276 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260317 20:57:39.506527 1918 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 LEADER]: Rejecting Update request from peer 15a5313a52eb40a3ab5d14d0d8be52f7 for earlier term 2. Current term is 3. Ops: [2.225-2.225]
I20260317 20:57:39.506815 2276 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:39.506860 2276 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260317 20:57:39.508718 2276 catalog_manager.cc:1514] Loading token signing keys...
I20260317 20:57:39.510385 2276 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Loaded TSK: 0
I20260317 20:57:39.511018 2159 consensus_queue.cc:1059] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 }, Status: INVALID_TERM, Last received: 2.224, Next index: 225, Last known committed idx: 224, Time since last communication: 0.000s
I20260317 20:57:39.511240 2159 consensus_queue.cc:1243] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [LEADER]: Peer 5022d9ddb45c41faa9f114e2a0a31fc3 log is divergent from this leader: its last log entry 3.225 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 224
I20260317 20:57:39.511318 2159 raft_consensus.cc:3055] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 2 LEADER]: Stepping down as leader of term 2
I20260317 20:57:39.511356 2159 raft_consensus.cc:740] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 15a5313a52eb40a3ab5d14d0d8be52f7, State: Running, Role: LEADER
I20260317 20:57:39.511415 2276 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260317 20:57:39.511536 2159 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 224, Committed index: 224, Last appended: 2.226, Last appended by leader: 226, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:39.511831 2159 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 2 FOLLOWER]: Advancing to term 3
I20260317 20:57:39.512615 2276 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260317 20:57:39.513849 2276 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 74
I20260317 20:57:39.657791 1246 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:39.660171 2206 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:56931; Asking this server to re-register.
I20260317 20:57:39.660791 1246 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:39.662801 2206 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:39.735088 1109 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:39.736832 2206 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:44773; Asking this server to re-register.
I20260317 20:57:39.737455 1109 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:39.738811 2206 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:39.863643 2217 raft_consensus.cc:1275] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 3 FOLLOWER]: Refusing update from remote peer 5022d9ddb45c41faa9f114e2a0a31fc3: Log matching property violated. Preceding OpId in replica: term: 1 index: 222. Preceding OpId from leader: term: 3 index: 225. (index mismatch)
I20260317 20:57:39.864454 2273 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 225, Last known committed idx: 222, Time since last communication: 0.000s
I20260317 20:57:39.868335 2283 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.869230 2283 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:39.869762 2247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.869928 2247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:39.868496 2256 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5022d9ddb45c41faa9f114e2a0a31fc3. Latest consensus state: current_term: 3 leader_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.870210 2256 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:39.870206 881 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 3 FOLLOWER]: Refusing update from remote peer 5022d9ddb45c41faa9f114e2a0a31fc3: Log matching property violated. Preceding OpId in replica: term: 2 index: 226. Preceding OpId from leader: term: 3 index: 225. (term mismatch)
I20260317 20:57:39.870270 881 pending_rounds.cc:85] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Aborting all ops after (but not including) 224
I20260317 20:57:39.870325 881 pending_rounds.cc:107] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Aborting uncommitted WRITE_OP operation due to leader change: 2.225
W20260317 20:57:39.870649 862 catalog_manager.cc:6706] Aborted: an error occurred while writing to the sys-catalog: Op aborted by new leader
I20260317 20:57:39.870649 881 pending_rounds.cc:107] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Aborting uncommitted WRITE_OP operation due to leader change: 2.226
I20260317 20:57:39.870779 2256 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.870882 2256 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: FOLLOWER
W20260317 20:57:39.871090 928 catalog_manager.cc:3939] Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
W20260317 20:57:39.871430 928 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 75 ALTER_TABLE default.table_6dc3bfd2de6b485098bb35884f8287fb: Aborted: an error occurred while updating the sys-catalog: Op aborted by new leader
W20260317 20:57:39.871516 928 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: Op aborted by new leader
I20260317 20:57:39.871470 2273 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 225, Last known committed idx: 224, Time since last communication: 0.000s
W20260317 20:57:39.871624 1388 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.102.252:34639)
I20260317 20:57:39.872097 868 master_service.cc:954] ReplaceTablet: received request to replace tablet 46e5d823d53c465b8751f8c3cd8c09cf from {username='slave'} at 127.0.0.1:42476
I20260317 20:57:39.872320 868 master_service.cc:954] ReplaceTablet: received request to replace tablet bf781fd3f8a941628cbe910fdbd7fab0 from {username='slave'} at 127.0.0.1:42476
I20260317 20:57:39.872439 862 master_service.cc:954] ReplaceTablet: received request to replace tablet 0d9f29b8296b4ea5aa599f4414efb6c9 from {username='slave'} at 127.0.0.1:42476
W20260317 20:57:39.872490 1388 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.102.252:34639)
W20260317 20:57:39.872675 1388 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.102.252:34639)
I20260317 20:57:39.873147 868 master_service.cc:954] ReplaceTablet: received request to replace tablet e69ac6bd9aca4af5aa72d76b4764b14c from {username='slave'} at 127.0.0.1:42476
I20260317 20:57:39.873818 1913 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_e0a1ab3af8974191818e51a5608c5724" } modify_external_catalogs: true
I20260317 20:57:39.873986 1913 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_e0a1ab3af8974191818e51a5608c5724" } modify_external_catalogs: true
W20260317 20:57:39.874078 1388 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.102.254:45865)
I20260317 20:57:39.874428 1912 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54510:
name: "default.Table_0544e71a0de540529c2f7865976f74f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260317 20:57:39.874701 867 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9c0299624ff84be09887bc390f45fffa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:39.875543 1916 master_service.cc:954] ReplaceTablet: received request to replace tablet e69ac6bd9aca4af5aa72d76b4764b14c from {username='slave'} at 127.0.0.1:54510
I20260317 20:57:39.877518 2251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5022d9ddb45c41faa9f114e2a0a31fc3. Latest consensus state: current_term: 3 leader_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.877652 2251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:39.877746 2251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.877806 2251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:39.881562 2273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:39.881719 2273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:39.885457 1910 master_service.cc:954] ReplaceTablet: received request to replace tablet bf781fd3f8a941628cbe910fdbd7fab0 from {username='slave'} at 127.0.0.1:54510
I20260317 20:57:39.886451 1908 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_4b318a4173584e1298cc874712d94e47" } modify_external_catalogs: true
I20260317 20:57:39.886608 1908 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_4b318a4173584e1298cc874712d94e47" } modify_external_catalogs: true
I20260317 20:57:39.886766 1909 master_service.cc:954] ReplaceTablet: received request to replace tablet 0d9f29b8296b4ea5aa599f4414efb6c9 from {username='slave'} at 127.0.0.1:54510
I20260317 20:57:39.887535 1914 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" } modify_external_catalogs: true
I20260317 20:57:39.887648 1914 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" } modify_external_catalogs: true
I20260317 20:57:39.887881 1911 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_a9891e641d7144228ae4fa567a20f67d" } new_table_name: "default.Table_db0d09da77234c72a4649ad59de113e0" modify_external_catalogs: true
I20260317 20:57:39.888098 1907 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_143f9036b95c45388916784f134edd5d" } modify_external_catalogs: true
I20260317 20:57:39.888180 1907 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_143f9036b95c45388916784f134edd5d" } modify_external_catalogs: true
I20260317 20:57:39.888279 1915 master_service.cc:954] ReplaceTablet: received request to replace tablet 46e5d823d53c465b8751f8c3cd8c09cf from {username='slave'} at 127.0.0.1:54510
I20260317 20:57:39.889065 2206 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:52067; Asking this server to re-register.
I20260317 20:57:39.889621 1382 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:39.890163 1916 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Sending DeleteTablet for 3 replicas of tablet e69ac6bd9aca4af5aa72d76b4764b14c
I20260317 20:57:39.892915 2206 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:39.896013 1916 catalog_manager.cc:6741] ReplaceTablet: tablet e69ac6bd9aca4af5aa72d76b4764b14c deleted and replaced by tablet 44eb25147f54448997a7147be3de6518
W20260317 20:57:39.896878 1912 catalog_manager.cc:7033] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0544e71a0de540529c2f7865976f74f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260317 20:57:39.898959 1916 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54510:
name: "default.Table_6bacc979980f45f3bff68d78ea0c114d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:39.899968 1910 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Sending DeleteTablet for 3 replicas of tablet bf781fd3f8a941628cbe910fdbd7fab0
I20260317 20:57:39.901222 1910 catalog_manager.cc:6741] ReplaceTablet: tablet bf781fd3f8a941628cbe910fdbd7fab0 deleted and replaced by tablet c1aabdbda61848958c6a5dd40f8795d8
I20260317 20:57:39.901474 1910 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_df3d165713f44a8b87b980f60d112d34" } new_table_name: "default.Table_6dc3bfd2de6b485098bb35884f8287fb" modify_external_catalogs: true
I20260317 20:57:39.900133 1909 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Sending DeleteTablet for 3 replicas of tablet 0d9f29b8296b4ea5aa599f4414efb6c9
I20260317 20:57:39.901830 1909 catalog_manager.cc:6741] ReplaceTablet: tablet 0d9f29b8296b4ea5aa599f4414efb6c9 deleted and replaced by tablet a4a60c7b22b5475eb2c9d6b40ed1a89b
I20260317 20:57:39.902020 1909 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54510:
name: "default.Table_f3bf180436c74527a1909f1af367814e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:39.900259 1915 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Sending DeleteTablet for 3 replicas of tablet 46e5d823d53c465b8751f8c3cd8c09cf
I20260317 20:57:39.902464 1915 catalog_manager.cc:6741] ReplaceTablet: tablet 46e5d823d53c465b8751f8c3cd8c09cf deleted and replaced by tablet aa23ce23d4b0465baf378859e9ad018c
I20260317 20:57:39.902663 1915 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_70c346e7110644f2b3b5b4bec1789d4a" } new_table_name: "default.Table_fb41c97ca0a9409c963fbe195007a57f" modify_external_catalogs: true
I20260317 20:57:39.909221 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a60c7b22b5475eb2c9d6b40ed1a89b) from {username='slave'} at 127.0.0.1:50676
I20260317 20:57:39.909317 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet e69ac6bd9aca4af5aa72d76b4764b14c with delete_type TABLET_DATA_DELETED (replaced by tablet 44eb25147f54448997a7147be3de6518) from {username='slave'} at 127.0.0.1:50676
I20260317 20:57:39.909529 1175 tablet_service.cc:1558] Processing DeleteTablet for tablet 46e5d823d53c465b8751f8c3cd8c09cf with delete_type TABLET_DATA_DELETED (replaced by tablet aa23ce23d4b0465baf378859e9ad018c) from {username='slave'} at 127.0.0.1:50676
I20260317 20:57:39.909807 2296 tablet_replica.cc:333] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:39.909988 2296 raft_consensus.cc:2243] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:39.909212 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet bf781fd3f8a941628cbe910fdbd7fab0 with delete_type TABLET_DATA_DELETED (replaced by tablet c1aabdbda61848958c6a5dd40f8795d8) from {username='slave'} at 127.0.0.1:50676
I20260317 20:57:39.912135 2296 raft_consensus.cc:2272] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.912755 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a60c7b22b5475eb2c9d6b40ed1a89b) from {username='slave'} at 127.0.0.1:59384
I20260317 20:57:39.913157 2296 ts_tablet_manager.cc:1916] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.913162 2298 tablet_replica.cc:333] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:39.913322 2298 raft_consensus.cc:2243] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:39.913488 2298 raft_consensus.cc:2272] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.913944 2298 ts_tablet_manager.cc:1916] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.915437 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet e69ac6bd9aca4af5aa72d76b4764b14c with delete_type TABLET_DATA_DELETED (replaced by tablet 44eb25147f54448997a7147be3de6518) from {username='slave'} at 127.0.0.1:59384
I20260317 20:57:39.915617 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet bf781fd3f8a941628cbe910fdbd7fab0 with delete_type TABLET_DATA_DELETED (replaced by tablet c1aabdbda61848958c6a5dd40f8795d8) from {username='slave'} at 127.0.0.1:59384
I20260317 20:57:39.915750 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 46e5d823d53c465b8751f8c3cd8c09cf with delete_type TABLET_DATA_DELETED (replaced by tablet aa23ce23d4b0465baf378859e9ad018c) from {username='slave'} at 127.0.0.1:59384
I20260317 20:57:39.916182 2296 ts_tablet_manager.cc:1929] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:39.916303 2296 log.cc:1199] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/0d9f29b8296b4ea5aa599f4414efb6c9
I20260317 20:57:39.916620 2296 ts_tablet_manager.cc:1950] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:39.917507 2296 tablet_replica.cc:333] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:39.917701 2296 raft_consensus.cc:2243] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:39.917922 2296 raft_consensus.cc:2272] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.918382 2298 ts_tablet_manager.cc:1929] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:39.918423 2296 ts_tablet_manager.cc:1916] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.918516 2298 log.cc:1199] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/0d9f29b8296b4ea5aa599f4414efb6c9
I20260317 20:57:39.918574 1038 tablet_service.cc:1511] Processing CreateTablet for tablet 44eb25147f54448997a7147be3de6518 (DEFAULT_TABLE table=default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.918857 2298 ts_tablet_manager.cc:1950] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:39.918891 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44eb25147f54448997a7147be3de6518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.919508 1891 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 0d9f29b8296b4ea5aa599f4414efb6c9 (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]) successfully deleted
I20260317 20:57:39.920240 1178 tablet_service.cc:1511] Processing CreateTablet for tablet 44eb25147f54448997a7147be3de6518 (DEFAULT_TABLE table=default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.920507 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44eb25147f54448997a7147be3de6518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.920758 2296 ts_tablet_manager.cc:1929] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:39.920827 2296 log.cc:1199] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/e69ac6bd9aca4af5aa72d76b4764b14c
I20260317 20:57:39.921084 2296 ts_tablet_manager.cc:1950] T e69ac6bd9aca4af5aa72d76b4764b14c P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:39.921777 2296 tablet_replica.cc:333] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:39.921932 2296 raft_consensus.cc:2243] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:39.922189 2296 raft_consensus.cc:2272] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.922513 2298 tablet_replica.cc:333] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:39.922657 2296 ts_tablet_manager.cc:1916] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.922693 2298 raft_consensus.cc:2243] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:39.922834 2298 raft_consensus.cc:2272] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.923164 1892 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 0d9f29b8296b4ea5aa599f4414efb6c9 (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]) successfully deleted
I20260317 20:57:39.923413 1891 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet e69ac6bd9aca4af5aa72d76b4764b14c (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]) successfully deleted
I20260317 20:57:39.923441 2298 ts_tablet_manager.cc:1916] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.924959 2296 ts_tablet_manager.cc:1929] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:39.925086 2296 log.cc:1199] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/46e5d823d53c465b8751f8c3cd8c09cf
I20260317 20:57:39.925386 2296 ts_tablet_manager.cc:1950] T 46e5d823d53c465b8751f8c3cd8c09cf P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:39.926124 2296 tablet_replica.cc:333] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:39.926296 2296 raft_consensus.cc:2243] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:39.927055 2296 raft_consensus.cc:2272] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.927217 1891 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 46e5d823d53c465b8751f8c3cd8c09cf (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]) successfully deleted
I20260317 20:57:39.927551 2296 ts_tablet_manager.cc:1916] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.927925 1175 tablet_service.cc:1511] Processing CreateTablet for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.927987 1178 tablet_service.cc:1511] Processing CreateTablet for tablet c1aabdbda61848958c6a5dd40f8795d8 (DEFAULT_TABLE table=default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.928233 1175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.928408 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1aabdbda61848958c6a5dd40f8795d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.928961 1038 tablet_service.cc:1511] Processing CreateTablet for tablet c1aabdbda61848958c6a5dd40f8795d8 (DEFAULT_TABLE table=default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.929126 1041 tablet_service.cc:1511] Processing CreateTablet for tablet aa23ce23d4b0465baf378859e9ad018c (DEFAULT_TABLE table=default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.929260 1038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1aabdbda61848958c6a5dd40f8795d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.929401 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa23ce23d4b0465baf378859e9ad018c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.928977 1040 tablet_service.cc:1511] Processing CreateTablet for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.932437 1175 tablet_service.cc:1511] Processing CreateTablet for tablet aa23ce23d4b0465baf378859e9ad018c (DEFAULT_TABLE table=default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.932574 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.932745 1175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa23ce23d4b0465baf378859e9ad018c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.935986 2299 tablet_bootstrap.cc:492] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:39.936113 2296 ts_tablet_manager.cc:1929] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:39.936214 2296 log.cc:1199] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/bf781fd3f8a941628cbe910fdbd7fab0
I20260317 20:57:39.936504 2296 ts_tablet_manager.cc:1950] T bf781fd3f8a941628cbe910fdbd7fab0 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:39.937368 2300 tablet_bootstrap.cc:492] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:39.938450 2299 tablet_bootstrap.cc:654] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:39.938659 1891 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet bf781fd3f8a941628cbe910fdbd7fab0 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]) successfully deleted
I20260317 20:57:39.939141 2300 tablet_bootstrap.cc:654] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:39.940138 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet e69ac6bd9aca4af5aa72d76b4764b14c with delete_type TABLET_DATA_DELETED (replaced by tablet 44eb25147f54448997a7147be3de6518) from {username='slave'} at 127.0.0.1:60114
I20260317 20:57:39.940341 1310 tablet_service.cc:1558] Processing DeleteTablet for tablet 46e5d823d53c465b8751f8c3cd8c09cf with delete_type TABLET_DATA_DELETED (replaced by tablet aa23ce23d4b0465baf378859e9ad018c) from {username='slave'} at 127.0.0.1:60114
I20260317 20:57:39.940501 1314 tablet_service.cc:1558] Processing DeleteTablet for tablet bf781fd3f8a941628cbe910fdbd7fab0 with delete_type TABLET_DATA_DELETED (replaced by tablet c1aabdbda61848958c6a5dd40f8795d8) from {username='slave'} at 127.0.0.1:60114
I20260317 20:57:39.940627 1311 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a60c7b22b5475eb2c9d6b40ed1a89b) from {username='slave'} at 127.0.0.1:60114
I20260317 20:57:39.940634 1308 tablet_service.cc:1511] Processing CreateTablet for tablet c1aabdbda61848958c6a5dd40f8795d8 (DEFAULT_TABLE table=default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.940801 1313 tablet_service.cc:1511] Processing CreateTablet for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.940841 1312 tablet_service.cc:1511] Processing CreateTablet for tablet aa23ce23d4b0465baf378859e9ad018c (DEFAULT_TABLE table=default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.941000 1308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1aabdbda61848958c6a5dd40f8795d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.941188 1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa23ce23d4b0465baf378859e9ad018c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.940639 1309 tablet_service.cc:1511] Processing CreateTablet for tablet 44eb25147f54448997a7147be3de6518 (DEFAULT_TABLE table=default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:39.941584 1309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44eb25147f54448997a7147be3de6518. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.942137 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:39.950088 2311 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260317 20:57:39.951481 2298 ts_tablet_manager.cc:1929] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:39.951594 2298 log.cc:1199] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/e69ac6bd9aca4af5aa72d76b4764b14c
I20260317 20:57:39.951990 2298 ts_tablet_manager.cc:1950] T e69ac6bd9aca4af5aa72d76b4764b14c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:39.952646 2298 tablet_replica.cc:333] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:39.952817 1892 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet e69ac6bd9aca4af5aa72d76b4764b14c (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]) successfully deleted
I20260317 20:57:39.954934 2303 tablet_replica.cc:333] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:39.955142 2303 raft_consensus.cc:2243] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:39.955314 2303 raft_consensus.cc:2272] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.955804 2303 ts_tablet_manager.cc:1916] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.956048 2298 raft_consensus.cc:2243] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:39.956728 1381 heartbeater.cc:499] Master 127.0.102.254:45865 was elected leader, sending a full tablet report...
I20260317 20:57:39.956879 2305 tablet_bootstrap.cc:492] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:39.957585 2298 raft_consensus.cc:2272] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.958139 2305 tablet_bootstrap.cc:654] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:39.960676 2298 ts_tablet_manager.cc:1916] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.962433 2303 ts_tablet_manager.cc:1929] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:39.962596 2303 log.cc:1199] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/e69ac6bd9aca4af5aa72d76b4764b14c
I20260317 20:57:39.962932 2303 ts_tablet_manager.cc:1950] T e69ac6bd9aca4af5aa72d76b4764b14c P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:39.963845 2303 tablet_replica.cc:333] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:39.962359 2312 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260317 20:57:39.963963 1892 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet e69ac6bd9aca4af5aa72d76b4764b14c (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]) successfully deleted
I20260317 20:57:39.964116 2303 raft_consensus.cc:2243] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:39.964324 2300 tablet_bootstrap.cc:492] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:39.964329 2303 raft_consensus.cc:2272] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.964452 2300 ts_tablet_manager.cc:1403] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20260317 20:57:39.964586 2299 tablet_bootstrap.cc:492] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:39.964687 2299 ts_tablet_manager.cc:1403] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20260317 20:57:39.964780 2303 ts_tablet_manager.cc:1916] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.965197 2299 raft_consensus.cc:359] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:39.965198 2300 raft_consensus.cc:359] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:39.965314 2299 raft_consensus.cc:385] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:39.965314 2300 raft_consensus.cc:385] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:39.965348 2299 raft_consensus.cc:740] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:39.965348 2300 raft_consensus.cc:740] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:39.965494 2299 consensus_queue.cc:260] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:39.965494 2300 consensus_queue.cc:260] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:39.965813 2300 ts_tablet_manager.cc:1434] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:39.966356 2299 ts_tablet_manager.cc:1434] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:39.966725 1108 heartbeater.cc:499] Master 127.0.102.254:45865 was elected leader, sending a full tablet report...
I20260317 20:57:39.966759 1245 heartbeater.cc:499] Master 127.0.102.254:45865 was elected leader, sending a full tablet report...
I20260317 20:57:39.969986 2300 tablet_bootstrap.cc:492] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:39.971314 2300 tablet_bootstrap.cc:654] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:39.972081 2305 tablet_bootstrap.cc:492] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:39.972251 2305 ts_tablet_manager.cc:1403] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20260317 20:57:39.972975 2299 tablet_bootstrap.cc:492] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:39.973016 2305 raft_consensus.cc:359] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:39.973206 2305 raft_consensus.cc:385] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:39.973268 2305 raft_consensus.cc:740] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:39.973464 2305 consensus_queue.cc:260] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:39.974956 2305 ts_tablet_manager.cc:1434] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260317 20:57:39.975212 2305 tablet_bootstrap.cc:492] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:39.976572 2299 tablet_bootstrap.cc:654] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:39.977954 2305 tablet_bootstrap.cc:654] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:39.981279 2303 ts_tablet_manager.cc:1929] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:39.981452 2303 log.cc:1199] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/46e5d823d53c465b8751f8c3cd8c09cf
I20260317 20:57:39.981799 2303 ts_tablet_manager.cc:1950] T 46e5d823d53c465b8751f8c3cd8c09cf P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:39.982735 2303 tablet_replica.cc:333] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:39.982785 1892 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 46e5d823d53c465b8751f8c3cd8c09cf (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]) successfully deleted
I20260317 20:57:39.982970 2303 raft_consensus.cc:2243] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:39.983155 2303 raft_consensus.cc:2272] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.983654 2303 ts_tablet_manager.cc:1916] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.985306 2298 ts_tablet_manager.cc:1929] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:39.986253 2303 ts_tablet_manager.cc:1929] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:39.986378 2303 log.cc:1199] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/bf781fd3f8a941628cbe910fdbd7fab0
I20260317 20:57:39.986718 2303 ts_tablet_manager.cc:1950] T bf781fd3f8a941628cbe910fdbd7fab0 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:39.987555 2303 tablet_replica.cc:333] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:39.987799 2303 raft_consensus.cc:2243] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:39.987922 1892 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet bf781fd3f8a941628cbe910fdbd7fab0 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]) successfully deleted
I20260317 20:57:39.988235 2303 raft_consensus.cc:2272] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.988772 2303 ts_tablet_manager.cc:1916] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:39.990736 2299 tablet_bootstrap.cc:492] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:39.990836 2299 ts_tablet_manager.cc:1403] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.000s
I20260317 20:57:39.991132 2303 ts_tablet_manager.cc:1929] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:39.991223 2303 log.cc:1199] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/0d9f29b8296b4ea5aa599f4414efb6c9
I20260317 20:57:39.991477 2303 ts_tablet_manager.cc:1950] T 0d9f29b8296b4ea5aa599f4414efb6c9 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:39.991289 1913 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]
I20260317 20:57:39.992070 2298 log.cc:1199] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/bf781fd3f8a941628cbe910fdbd7fab0
I20260317 20:57:39.992192 2299 raft_consensus.cc:359] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:39.992347 2299 raft_consensus.cc:385] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:39.992316 1892 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 0d9f29b8296b4ea5aa599f4414efb6c9 (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]) successfully deleted
I20260317 20:57:39.992396 2299 raft_consensus.cc:740] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:39.992535 2299 consensus_queue.cc:260] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:39.992808 2298 ts_tablet_manager.cc:1950] T bf781fd3f8a941628cbe910fdbd7fab0 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:39.992889 2299 ts_tablet_manager.cc:1434] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:39.993352 2300 tablet_bootstrap.cc:492] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:39.993471 2300 ts_tablet_manager.cc:1403] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.000s
I20260317 20:57:39.994163 2299 tablet_bootstrap.cc:492] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:39.994235 2300 raft_consensus.cc:359] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:39.994357 2300 raft_consensus.cc:385] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:39.994390 2300 raft_consensus.cc:740] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:39.994527 2300 consensus_queue.cc:260] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:39.994877 2300 ts_tablet_manager.cc:1434] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:39.995086 2300 tablet_bootstrap.cc:492] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:39.995478 2299 tablet_bootstrap.cc:654] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:39.996140 2300 tablet_bootstrap.cc:654] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:39.998145 2099 raft_consensus.cc:493] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:39.998270 2099 raft_consensus.cc:515] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:39.998379 2314 tablet.cc:1723] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260317 20:57:39.998720 2099 leader_election.cc:290] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:39.999300 2298 tablet_replica.cc:333] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:39.999439 2298 raft_consensus.cc:2243] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:39.999549 2298 raft_consensus.cc:2272] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:39.999142 2300 tablet_bootstrap.cc:492] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:39.999960 2298 ts_tablet_manager.cc:1916] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.000059 2300 ts_tablet_manager.cc:1403] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260317 20:57:40.000056 1892 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet bf781fd3f8a941628cbe910fdbd7fab0 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]) successfully deleted
I20260317 20:57:40.000667 2300 raft_consensus.cc:359] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.000792 2300 raft_consensus.cc:385] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.000828 2300 raft_consensus.cc:740] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.000983 2300 consensus_queue.cc:260] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.001308 2300 ts_tablet_manager.cc:1434] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:40.001361 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eb25147f54448997a7147be3de6518" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:40.001506 1332 raft_consensus.cc:2468] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:40.001543 2300 tablet_bootstrap.cc:492] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:40.002440 996 leader_election.cc:304] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.000829 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eb25147f54448997a7147be3de6518" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:40.002791 1198 raft_consensus.cc:2468] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:40.002976 2099 raft_consensus.cc:2804] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:40.003044 2099 raft_consensus.cc:493] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:40.003083 2099 raft_consensus.cc:3060] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.004233 2099 raft_consensus.cc:515] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:40.004323 2305 tablet_bootstrap.cc:492] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:40.004422 2305 ts_tablet_manager.cc:1403] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.002s
I20260317 20:57:40.004638 2099 leader_election.cc:290] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:40.005019 2298 ts_tablet_manager.cc:1929] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:40.005074 2305 raft_consensus.cc:359] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.005199 2305 raft_consensus.cc:385] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.005232 2305 raft_consensus.cc:740] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.005388 2305 consensus_queue.cc:260] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.005719 2305 ts_tablet_manager.cc:1434] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260317 20:57:40.005685 2299 tablet_bootstrap.cc:492] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:40.005820 2299 ts_tablet_manager.cc:1403] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20260317 20:57:40.005964 2305 tablet_bootstrap.cc:492] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:40.006383 2299 raft_consensus.cc:359] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.006492 2299 raft_consensus.cc:385] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.006526 2299 raft_consensus.cc:740] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.006649 2299 consensus_queue.cc:260] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.006724 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eb25147f54448997a7147be3de6518" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:40.006826 1332 raft_consensus.cc:3060] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.006945 2299 ts_tablet_manager.cc:1434] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:40.007102 2305 tablet_bootstrap.cc:654] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.007144 2299 tablet_bootstrap.cc:492] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:40.007917 1332 raft_consensus.cc:2468] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:40.008256 2299 tablet_bootstrap.cc:654] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.008602 996 leader_election.cc:304] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.010134 1912 catalog_manager.cc:2174] created HMS catalog entry for table [id=4c1e17a5a7714446bfd8dbc5d5abb95b]
I20260317 20:57:40.010787 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eb25147f54448997a7147be3de6518" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:40.010941 1198 raft_consensus.cc:3060] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.011147 2298 log.cc:1199] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/46e5d823d53c465b8751f8c3cd8c09cf
I20260317 20:57:40.011493 2298 ts_tablet_manager.cc:1950] T 46e5d823d53c465b8751f8c3cd8c09cf P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:40.012140 1198 raft_consensus.cc:2468] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:40.014780 1892 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 46e5d823d53c465b8751f8c3cd8c09cf (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]) successfully deleted
I20260317 20:57:40.017163 2300 tablet_bootstrap.cc:654] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.019191 2305 tablet_bootstrap.cc:492] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:40.019320 2305 ts_tablet_manager.cc:1403] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260317 20:57:40.020484 2305 raft_consensus.cc:359] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.020653 2305 raft_consensus.cc:385] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.020699 2305 raft_consensus.cc:740] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.021227 2305 consensus_queue.cc:260] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.021595 2305 ts_tablet_manager.cc:1434] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:40.021893 2305 tablet_bootstrap.cc:492] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:40.023097 2305 tablet_bootstrap.cc:654] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.021657 1912 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]). Expected version 1 got 0
I20260317 20:57:40.026166 2300 tablet_bootstrap.cc:492] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:40.026278 2300 ts_tablet_manager.cc:1403] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.003s
I20260317 20:57:40.026770 2300 raft_consensus.cc:359] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.026862 2300 raft_consensus.cc:385] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.026889 2300 raft_consensus.cc:740] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.027000 2300 consensus_queue.cc:260] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.025146 1912 catalog_manager.cc:5671] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } }
I20260317 20:57:40.027251 2300 ts_tablet_manager.cc:1434] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:40.027347 1912 catalog_manager.cc:5671] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } }
I20260317 20:57:40.027586 1912 catalog_manager.cc:5671] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:40.027777 1912 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]). Expected version 1 got 0
I20260317 20:57:40.027904 1912 catalog_manager.cc:5671] T 7d60f1c4eba344a3bbf72ab296b68843 P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:40.028301 2099 raft_consensus.cc:2804] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:40.028403 2099 raft_consensus.cc:697] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:40.028550 2099 consensus_queue.cc:237] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:40.033171 2305 tablet_bootstrap.cc:492] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:40.033313 2305 ts_tablet_manager.cc:1403] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260317 20:57:40.033888 2305 raft_consensus.cc:359] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.033994 2305 raft_consensus.cc:385] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.034029 2305 raft_consensus.cc:740] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.034497 2305 consensus_queue.cc:260] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.034795 2305 ts_tablet_manager.cc:1434] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:40.042116 2299 tablet_bootstrap.cc:492] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:40.042246 2299 ts_tablet_manager.cc:1403] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
I20260317 20:57:40.042827 2299 raft_consensus.cc:359] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.042951 2299 raft_consensus.cc:385] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.042984 2299 raft_consensus.cc:740] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.043104 2299 consensus_queue.cc:260] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.043460 2299 ts_tablet_manager.cc:1434] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:40.054170 1308 tablet_service.cc:1511] Processing CreateTablet for tablet fd5cc18aee45453aa02797da17b5554f (DEFAULT_TABLE table=default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.054191 1040 tablet_service.cc:1511] Processing CreateTablet for tablet fd5cc18aee45453aa02797da17b5554f (DEFAULT_TABLE table=default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.054484 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5cc18aee45453aa02797da17b5554f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.054484 1308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5cc18aee45453aa02797da17b5554f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.056782 2305 tablet_bootstrap.cc:492] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:40.057011 1175 tablet_service.cc:1511] Processing CreateTablet for tablet fd5cc18aee45453aa02797da17b5554f (DEFAULT_TABLE table=default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.057206 2299 tablet_bootstrap.cc:492] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:40.057330 1175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5cc18aee45453aa02797da17b5554f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.057941 2305 tablet_bootstrap.cc:654] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.058306 2299 tablet_bootstrap.cc:654] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.059911 2300 tablet_bootstrap.cc:492] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:40.060998 2300 tablet_bootstrap.cc:654] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.062203 2305 tablet_bootstrap.cc:492] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:40.062309 2305 ts_tablet_manager.cc:1403] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260317 20:57:40.062924 2305 raft_consensus.cc:359] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.063058 2305 raft_consensus.cc:385] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.063092 2305 raft_consensus.cc:740] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.063320 2305 consensus_queue.cc:260] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.065251 2305 ts_tablet_manager.cc:1434] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260317 20:57:40.065779 1912 catalog_manager.cc:6216] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad] alter complete (version 3)
I20260317 20:57:40.066254 2300 tablet_bootstrap.cc:492] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:40.066345 2300 ts_tablet_manager.cc:1403] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260317 20:57:40.066843 2300 raft_consensus.cc:359] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.066946 2300 raft_consensus.cc:385] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.066974 2300 raft_consensus.cc:740] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.067091 2300 consensus_queue.cc:260] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.067348 2300 ts_tablet_manager.cc:1434] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:40.068306 1308 tablet_service.cc:1558] Processing DeleteTablet for tablet 46e5d823d53c465b8751f8c3cd8c09cf with delete_type TABLET_DATA_DELETED (replaced by tablet aa23ce23d4b0465baf378859e9ad018c) from {username='slave'} at 127.0.0.1:60114
W20260317 20:57:40.071048 1892 catalog_manager.cc:4969] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet 46e5d823d53c465b8751f8c3cd8c09cf because the tablet was not found. No further retry: Not found: Tablet not found: 46e5d823d53c465b8751f8c3cd8c09cf
W20260317 20:57:40.076723 1912 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 44eb25147f54448997a7147be3de6518 consensus state has no leader
I20260317 20:57:40.077030 2299 tablet_bootstrap.cc:492] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:40.077085 1308 tablet_service.cc:1558] Processing DeleteTablet for tablet bf781fd3f8a941628cbe910fdbd7fab0 with delete_type TABLET_DATA_DELETED (replaced by tablet c1aabdbda61848958c6a5dd40f8795d8) from {username='slave'} at 127.0.0.1:60114
W20260317 20:57:40.077076 1912 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c1aabdbda61848958c6a5dd40f8795d8 consensus state has no leader
I20260317 20:57:40.077291 2299 ts_tablet_manager.cc:1403] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20260317 20:57:40.077921 2299 raft_consensus.cc:359] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.078560 1308 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 with delete_type TABLET_DATA_DELETED (replaced by tablet a4a60c7b22b5475eb2c9d6b40ed1a89b) from {username='slave'} at 127.0.0.1:60114
I20260317 20:57:40.078585 1312 tablet_service.cc:1558] Processing DeleteTablet for tablet e69ac6bd9aca4af5aa72d76b4764b14c with delete_type TABLET_DATA_DELETED (replaced by tablet 44eb25147f54448997a7147be3de6518) from {username='slave'} at 127.0.0.1:60114
I20260317 20:57:40.079097 2299 raft_consensus.cc:385] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.079162 2299 raft_consensus.cc:740] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
W20260317 20:57:40.079156 1892 catalog_manager.cc:4969] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet bf781fd3f8a941628cbe910fdbd7fab0 because the tablet was not found. No further retry: Not found: Tablet not found: bf781fd3f8a941628cbe910fdbd7fab0
I20260317 20:57:40.079365 2299 consensus_queue.cc:260] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.079715 2299 ts_tablet_manager.cc:1434] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
W20260317 20:57:40.079993 1892 catalog_manager.cc:4969] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet 0d9f29b8296b4ea5aa599f4414efb6c9 because the tablet was not found. No further retry: Not found: Tablet not found: 0d9f29b8296b4ea5aa599f4414efb6c9
W20260317 20:57:40.080147 1892 catalog_manager.cc:4969] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): delete failed for tablet e69ac6bd9aca4af5aa72d76b4764b14c because the tablet was not found. No further retry: Not found: Tablet not found: e69ac6bd9aca4af5aa72d76b4764b14c
I20260317 20:57:40.084578 2038 raft_consensus.cc:493] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:40.084709 2038 raft_consensus.cc:515] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.085124 2038 leader_election.cc:290] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:40.085779 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa23ce23d4b0465baf378859e9ad018c" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:40.085942 1198 raft_consensus.cc:2468] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:40.086372 1268 leader_election.cc:304] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:40.086617 2038 raft_consensus.cc:2804] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:40.086679 2038 raft_consensus.cc:493] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:40.086719 2038 raft_consensus.cc:3060] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.087908 2038 raft_consensus.cc:515] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.088323 2038 leader_election.cc:290] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:40.089121 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa23ce23d4b0465baf378859e9ad018c" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:40.089269 1198 raft_consensus.cc:3060] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.090548 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa23ce23d4b0465baf378859e9ad018c" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:40.090709 1061 raft_consensus.cc:3060] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.091086 1912 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]). Expected version 1 got 0
I20260317 20:57:40.091581 1912 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]). Expected version 3 got 2
I20260317 20:57:40.091990 1061 raft_consensus.cc:2468] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:40.092223 1912 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]). Expected version 1 got 0
I20260317 20:57:40.092269 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa23ce23d4b0465baf378859e9ad018c" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:40.092370 1060 raft_consensus.cc:2376] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1. Re-sending same reply.
I20260317 20:57:40.093492 1198 raft_consensus.cc:2468] T aa23ce23d4b0465baf378859e9ad018c P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:40.094156 1268 leader_election.cc:304] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:40.097080 2038 raft_consensus.cc:2804] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:40.097209 2038 raft_consensus.cc:697] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:40.097361 2038 consensus_queue.cc:237] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.110245 1912 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]). Expected version 1 got 0
I20260317 20:57:40.110735 1912 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]). Expected version 1 got 0
I20260317 20:57:40.113835 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 46e5d823d53c465b8751f8c3cd8c09cf with delete_type TABLET_DATA_DELETED (replaced by tablet aa23ce23d4b0465baf378859e9ad018c) from {username='slave'} at 127.0.0.1:59384
I20260317 20:57:40.114583 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet bf781fd3f8a941628cbe910fdbd7fab0 with delete_type TABLET_DATA_DELETED (replaced by tablet c1aabdbda61848958c6a5dd40f8795d8) from {username='slave'} at 127.0.0.1:59384
W20260317 20:57:40.114629 1892 catalog_manager.cc:4969] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): delete failed for tablet 46e5d823d53c465b8751f8c3cd8c09cf because the tablet was not found. No further retry: Not found: Tablet not found: 46e5d823d53c465b8751f8c3cd8c09cf
W20260317 20:57:40.115063 1892 catalog_manager.cc:4969] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): delete failed for tablet bf781fd3f8a941628cbe910fdbd7fab0 because the tablet was not found. No further retry: Not found: Tablet not found: bf781fd3f8a941628cbe910fdbd7fab0
I20260317 20:57:40.117043 1912 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]). Expected version 1 got 0
I20260317 20:57:40.117581 1912 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]). Expected version 1 got 0
I20260317 20:57:40.120114 1912 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]). Expected version 1 got 0
I20260317 20:57:40.122416 1912 catalog_manager.cc:5671] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:40.123159 865 catalog_manager.cc:3502] renamed table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62] in HMS: new name default.table_15d4ddf21b5d49f7bf9245c9e7e07e0e
I20260317 20:57:40.122748 1912 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]). Expected version 1 got 0
I20260317 20:57:40.124586 1912 catalog_manager.cc:5763] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743) does not have the latest schema for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]). Expected version 1 got 0
W20260317 20:57:40.129429 1890 catalog_manager.cc:4784] Async tablet task AlterTable RPC for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c1aabdbda61848958c6a5dd40f8795d8 consensus state has no leader
I20260317 20:57:40.138899 1912 catalog_manager.cc:5671] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:40.141461 1908 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299]
I20260317 20:57:40.151799 1912 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54510:
table { table_name: "default.Table_d75875b48ed64da7a376b2b012ffe68c" } new_table_name: "default.Table_4ff5658252364bb1bf6fa149608be43f" modify_external_catalogs: true
I20260317 20:57:40.154474 867 catalog_manager.cc:2174] created HMS catalog entry for table [id=c93ebc62702e4b9bac97b238a6159d2b]
W20260317 20:57:40.155159 867 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica 15a5313a52eb40a3ab5d14d0d8be52f7 is not leader of this config: current role FOLLOWER
I20260317 20:57:40.188825 867 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=c93ebc62702e4b9bac97b238a6159d2b]
I20260317 20:57:40.190635 1914 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951]
I20260317 20:57:40.192907 1198 raft_consensus.cc:1275] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Refusing update from remote peer 92d68c1a3a2642cca908f2c7e9d7e13a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:40.192914 1332 raft_consensus.cc:1275] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Refusing update from remote peer 92d68c1a3a2642cca908f2c7e9d7e13a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260317 20:57:40.193418 2099 consensus_queue.cc:1048] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.193956 2322 consensus_queue.cc:1048] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.196036 2322 raft_consensus.cc:493] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:40.196142 2322 raft_consensus.cc:515] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.196573 2322 leader_election.cc:290] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:40.199172 2312 tablet.cc:1723] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:40.201994 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5cc18aee45453aa02797da17b5554f" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:40.202215 1196 raft_consensus.cc:2468] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:40.203099 995 leader_election.cc:304] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.203347 2099 raft_consensus.cc:2804] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:40.203403 2099 raft_consensus.cc:493] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:40.203444 2099 raft_consensus.cc:3060] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.204685 2099 raft_consensus.cc:515] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.205183 2099 leader_election.cc:290] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:40.208837 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5cc18aee45453aa02797da17b5554f" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:40.209033 1196 raft_consensus.cc:3060] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.210289 1196 raft_consensus.cc:2468] T fd5cc18aee45453aa02797da17b5554f P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:40.211130 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5cc18aee45453aa02797da17b5554f" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:40.211210 995 leader_election.cc:304] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.211302 1333 raft_consensus.cc:3060] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.211580 2311 tablet.cc:1723] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:40.212502 1333 raft_consensus.cc:2468] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:40.217581 2322 raft_consensus.cc:2804] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:40.217720 2322 raft_consensus.cc:697] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:40.217869 2322 consensus_queue.cc:237] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.218990 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5cc18aee45453aa02797da17b5554f" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:40.219153 1332 raft_consensus.cc:2376] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1. Re-sending same reply.
I20260317 20:57:40.232215 2314 tablet.cc:1723] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260317 20:57:40.259846 1911 catalog_manager.cc:3502] renamed table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06] in HMS: new name default.table_db0d09da77234c72a4649ad59de113e0
I20260317 20:57:40.299574 1715 raft_consensus.cc:493] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:40.299754 1715 raft_consensus.cc:515] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.300282 1715 leader_election.cc:290] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:40.302322 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1aabdbda61848958c6a5dd40f8795d8" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:40.302500 1332 raft_consensus.cc:2468] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:40.302975 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1aabdbda61848958c6a5dd40f8795d8" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:40.303123 1060 raft_consensus.cc:2468] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:40.303886 1133 leader_election.cc:304] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:40.304711 1715 raft_consensus.cc:2804] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:40.304775 1715 raft_consensus.cc:493] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:40.304811 1715 raft_consensus.cc:3060] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.306007 1715 raft_consensus.cc:515] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.306471 1715 leader_election.cc:290] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:40.307544 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1aabdbda61848958c6a5dd40f8795d8" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:40.307679 1332 raft_consensus.cc:3060] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.308789 1332 raft_consensus.cc:2468] T c1aabdbda61848958c6a5dd40f8795d8 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:40.309409 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1aabdbda61848958c6a5dd40f8795d8" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:40.309544 1060 raft_consensus.cc:3060] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.311657 1133 leader_election.cc:304] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:40.312674 1060 raft_consensus.cc:2468] T c1aabdbda61848958c6a5dd40f8795d8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:40.312726 1715 raft_consensus.cc:2804] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:40.312805 1715 raft_consensus.cc:697] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:40.313493 1715 consensus_queue.cc:237] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.313674 2038 raft_consensus.cc:493] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:40.313781 2038 raft_consensus.cc:515] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.314623 2038 leader_election.cc:290] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:40.316879 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a60c7b22b5475eb2c9d6b40ed1a89b" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:40.317023 1198 raft_consensus.cc:2468] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:40.317724 1268 leader_election.cc:304] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:40.317967 2038 raft_consensus.cc:2804] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:40.318069 2038 raft_consensus.cc:493] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:40.318118 2038 raft_consensus.cc:3060] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.318295 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a60c7b22b5475eb2c9d6b40ed1a89b" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:40.318466 1060 raft_consensus.cc:2468] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:40.319383 2038 raft_consensus.cc:515] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.319818 2038 leader_election.cc:290] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:40.320204 1198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a60c7b22b5475eb2c9d6b40ed1a89b" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:40.320358 1198 raft_consensus.cc:3060] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.320487 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a60c7b22b5475eb2c9d6b40ed1a89b" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:40.320618 1060 raft_consensus.cc:3060] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.321516 1198 raft_consensus.cc:2468] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:40.321628 1060 raft_consensus.cc:2468] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:40.322067 1269 leader_election.cc:304] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.322319 2038 raft_consensus.cc:2804] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:40.322410 2038 raft_consensus.cc:697] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:40.322561 2038 consensus_queue.cc:237] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.322722 1907 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]
F20260317 20:57:40.330467 1975 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 7 out of 9 received events: NotificationEvent(eventId=76, eventTime=1773781059, eventType=DROP_TABLE, dbName=default, tableName=table_e0a1ab3af8974191818e51a5608c5724, message={"server":"","servicePrincipal":"","db":"default","table":"table_e0a1ab3af8974191818e51a5608c5724","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_e0a1ab3af8974191818e51a5608c5724\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781056},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_e0a1ab3af8974191818e51a5608c5724\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_e0a1ab3af8974191818e51a5608c5724\",\"kudu.table_id\":\"110ed734bb04495784d1d8ca1a7a8498\",\"transient_lastDdlTime\":\"1773781056\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781059}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=77, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_0544e71a0de540529c2f7865976f74f3, message={"server":"","servicePrincipal":"","db":"default","table":"table_0544e71a0de540529c2f7865976f74f3","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0544e71a0de540529c2f7865976f74f3\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781059},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_0544e71a0de540529c2f7865976f74f3\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0544e71a0de540529c2f7865976f74f3\",\"kudu.table_id\":\"4c1e17a5a7714446bfd8dbc5d5abb95b\",\"transient_lastDdlTime\":\"1773781059\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1773781060, eventType=ALTER_TABLE, dbName=default, tableName=table_15d4ddf21b5d49f7bf9245c9e7e07e0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_ffa8292a8cda469787b621281ed2203c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_ffa8292a8cda469787b621281ed2203c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_ffa8292a8cda469787b621281ed2203c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ffa8292a8cda469787b621281ed2203c\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_15d4ddf21b5d49f7bf9245c9e7e07e0e\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_4b318a4173584e1298cc874712d94e47, message={"server":"","servicePrincipal":"","db":"default","table":"table_4b318a4173584e1298cc874712d94e47","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4b318a4173584e1298cc874712d94e47\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781053},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_4b318a4173584e1298cc874712d94e47\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4b318a4173584e1298cc874712d94e47\",\"kudu.table_id\":\"0e789a2f9f64400eb7e38a789e0ec299\",\"transient_lastDdlTime\":\"1773781053\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"transient_lastDdlTime\":\"1773781060\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_a5ab9704ed704e619e80ab8d4d623a68, message={"server":"","servicePrincipal":"","db":"default","table":"table_a5ab9704ed704e619e80ab8d4d623a68","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a5ab9704ed704e619e80ab8d4d623a68\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781051},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_a5ab9704ed704e619e80ab8d4d623a68\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a5ab9704ed704e619e80ab8d4d623a68\",\"transient_lastDdlTime\":\"1773781051\",\"kudu.table_id\":\"a4ba9bce277146cc8c2a1cfcbf90f951\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"transient_lastDdlTime\":\"1773781060\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f02551a4dcd google::LogMessage::Fail() at ??:0
@ 0x7f02551a8b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f02551a47cc google::LogMessage::Flush() at ??:0
@ 0x7f02551a4a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f025a377847 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
@ 0x7f025a37675e kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
@ 0x7f025a375ec1 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
@ 0x7f025a37b5c8 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x5566de8b318a std::function<>::operator()() at ??:0
@ 0x7f02566a4214 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f0256e8c6db start_thread at ??:0
@ 0x7f025435b61f clone at ??:0
I20260317 20:57:40.572363 1806 consensus_queue.cc:1048] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.579286 2351 consensus_queue.cc:1048] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260317 20:57:40.597656 2353 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:40.596749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.254:45865 (local address 127.0.102.194:43521)
0317 20:57:40.597465 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:40.597528 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":81,"threads_started":1}
W20260317 20:57:40.597959 2354 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:40.596749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.254:45865 (local address 127.0.102.193:37581)
0317 20:57:40.597125 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:40.597141 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0317 20:57:40.597251 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0317 20:57:40.597837 (+ 586us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":87,"threads_started":1}
I20260317 20:57:40.648417 2357 raft_consensus.cc:493] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5022d9ddb45c41faa9f114e2a0a31fc3)
I20260317 20:57:40.648554 2357 raft_consensus.cc:515] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:40.649893 2357 leader_election.cc:290] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:40.650672 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 4 candidate_status { last_received { term: 3 index: 238 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" is_pre_election: true
W20260317 20:57:40.650738 2194 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:40.650835 881 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 3.
I20260317 20:57:40.650931 2359 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5022d9ddb45c41faa9f114e2a0a31fc3)
I20260317 20:57:40.651005 2359 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:40.651419 2359 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
I20260317 20:57:40.651422 2192 leader_election.cc:304] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806; no voters:
I20260317 20:57:40.651760 2357 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260317 20:57:40.651835 2357 raft_consensus.cc:493] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5022d9ddb45c41faa9f114e2a0a31fc3)
I20260317 20:57:40.651887 2357 raft_consensus.cc:3060] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 3 FOLLOWER]: Advancing to term 4
I20260317 20:57:40.651857 2216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 238 } } ignore_live_leader: false dest_uuid: "db5e708fd6404c0daa842bfc7e8f4806" is_pre_election: true
W20260317 20:57:40.652043 2194 leader_election.cc:336] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:40.653017 2357 raft_consensus.cc:515] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:40.653359 2216 raft_consensus.cc:2393] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 15a5313a52eb40a3ab5d14d0d8be52f7 in current term 4: Already voted for candidate db5e708fd6404c0daa842bfc7e8f4806 in this term.
I20260317 20:57:40.654270 2357 leader_election.cc:290] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 4 election: Requested vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:57:40.654325 2194 leader_election.cc:336] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:40.654363 858 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:40.654450 858 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:40.654650 2359 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 3 FOLLOWER]: Advancing to term 4
I20260317 20:57:40.654839 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 4 candidate_status { last_received { term: 3 index: 238 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
I20260317 20:57:40.655764 2359 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260317 20:57:40.656857 881 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 4.
I20260317 20:57:40.657692 2192 leader_election.cc:304] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3
I20260317 20:57:40.657929 2357 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Leader election won for term 4
I20260317 20:57:40.658140 2357 raft_consensus.cc:697] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 LEADER]: Becoming Leader. State: Replica: db5e708fd6404c0daa842bfc7e8f4806, State: Running, Role: LEADER
I20260317 20:57:40.658526 2357 consensus_queue.cc:237] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 238, Committed index: 238, Last appended: 3.238, Last appended by leader: 238, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:40.659838 2363 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 4 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:40.659970 2363 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:40.660327 2364 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260317 20:57:40.663436 2364 catalog_manager.cc:679] Loaded metadata for table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]
I20260317 20:57:40.663782 2364 catalog_manager.cc:679] Loaded metadata for table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]
I20260317 20:57:40.664016 2364 catalog_manager.cc:679] Loaded metadata for table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]
I20260317 20:57:40.664250 2364 catalog_manager.cc:679] Loaded metadata for table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299]
I20260317 20:57:40.664458 2364 catalog_manager.cc:679] Loaded metadata for table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]
I20260317 20:57:40.664970 2364 catalog_manager.cc:679] Loaded metadata for table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]
I20260317 20:57:40.665290 2364 catalog_manager.cc:679] Loaded metadata for table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]
I20260317 20:57:40.665701 2364 catalog_manager.cc:679] Loaded metadata for table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]
I20260317 20:57:40.665901 2364 catalog_manager.cc:679] Loaded metadata for table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]
I20260317 20:57:40.666150 2364 catalog_manager.cc:679] Loaded metadata for table default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b]
I20260317 20:57:40.666383 2364 catalog_manager.cc:679] Loaded metadata for table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]
I20260317 20:57:40.666985 2364 catalog_manager.cc:679] Loaded metadata for table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]
I20260317 20:57:40.667363 2364 catalog_manager.cc:679] Loaded metadata for table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]
I20260317 20:57:40.667569 2364 catalog_manager.cc:679] Loaded metadata for table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]
I20260317 20:57:40.667773 2364 catalog_manager.cc:679] Loaded metadata for table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]
I20260317 20:57:40.667966 2364 catalog_manager.cc:679] Loaded metadata for table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]
I20260317 20:57:40.668176 2364 catalog_manager.cc:679] Loaded metadata for table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]
I20260317 20:57:40.668582 2364 catalog_manager.cc:679] Loaded metadata for table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]
I20260317 20:57:40.668792 2364 catalog_manager.cc:679] Loaded metadata for table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]
I20260317 20:57:40.668992 2364 catalog_manager.cc:679] Loaded metadata for table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951]
I20260317 20:57:40.669322 2364 catalog_manager.cc:679] Loaded metadata for table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]
I20260317 20:57:40.669521 2364 catalog_manager.cc:679] Loaded metadata for table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd]
I20260317 20:57:40.669718 2364 catalog_manager.cc:679] Loaded metadata for table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]
I20260317 20:57:40.669924 2364 catalog_manager.cc:679] Loaded metadata for table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]
I20260317 20:57:40.670281 2364 catalog_manager.cc:679] Loaded metadata for table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]
I20260317 20:57:40.670500 2364 catalog_manager.cc:679] Loaded metadata for table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]
I20260317 20:57:40.670702 2364 catalog_manager.cc:679] Loaded metadata for table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]
I20260317 20:57:40.670904 2364 catalog_manager.cc:679] Loaded metadata for table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]
I20260317 20:57:40.671201 2364 catalog_manager.cc:679] Loaded metadata for table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]
I20260317 20:57:40.673905 2364 tablet_loader.cc:96] loaded metadata for tablet 09b20a5babe8490dba78f9ac1296a58c (table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182])
I20260317 20:57:40.674307 2364 tablet_loader.cc:96] loaded metadata for tablet 0d7946629e25418c9c23d09363e305b8 (table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4])
I20260317 20:57:40.674736 2364 tablet_loader.cc:96] loaded metadata for tablet 1947a091d5c8450abb0b7ed7acc05136 (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e])
I20260317 20:57:40.675020 2364 tablet_loader.cc:96] loaded metadata for tablet 1bc0397641de4016baca65a655b38c30 (table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41])
I20260317 20:57:40.675158 2364 tablet_loader.cc:96] loaded metadata for tablet 1e084fc67777419fb5af7936ab89e8bf (table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502])
I20260317 20:57:40.675292 2364 tablet_loader.cc:96] loaded metadata for tablet 2919b2a953ef4d74955ca04b622b6c33 (table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd])
I20260317 20:57:40.675603 2364 tablet_loader.cc:96] loaded metadata for tablet 3958625929884f3397edf4c3aee3260e (table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d])
I20260317 20:57:40.675820 2364 tablet_loader.cc:96] loaded metadata for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7])
I20260317 20:57:40.676203 2364 tablet_loader.cc:96] loaded metadata for tablet 492e0f23d6b74854bc68f51c8136d495 (table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543])
I20260317 20:57:40.676445 2364 tablet_loader.cc:96] loaded metadata for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93])
I20260317 20:57:40.676754 2364 tablet_loader.cc:96] loaded metadata for tablet 53bd2006d8e24f418a17e55cfec8fd21 (table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1])
I20260317 20:57:40.677052 2364 tablet_loader.cc:96] loaded metadata for tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad])
I20260317 20:57:40.677597 2364 tablet_loader.cc:96] loaded metadata for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d])
I20260317 20:57:40.678267 2364 tablet_loader.cc:96] loaded metadata for tablet 7d60f1c4eba344a3bbf72ab296b68843 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06])
I20260317 20:57:40.678454 2364 tablet_loader.cc:96] loaded metadata for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62])
I20260317 20:57:40.678642 2364 tablet_loader.cc:96] loaded metadata for tablet a78fdc83a3d54554a08f01915f102f6e (table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5])
I20260317 20:57:40.678939 2364 tablet_loader.cc:96] loaded metadata for tablet aa23ce23d4b0465baf378859e9ad018c (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69])
I20260317 20:57:40.679461 2364 tablet_loader.cc:96] loaded metadata for tablet b5739d6cb9a84de78767b471608f1671 (table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2])
I20260317 20:57:40.679643 2364 tablet_loader.cc:96] loaded metadata for tablet b9794f5cae264d1392074b3a3daf3f46 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113])
I20260317 20:57:40.680104 2364 tablet_loader.cc:96] loaded metadata for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3])
I20260317 20:57:40.680435 2364 tablet_loader.cc:96] loaded metadata for tablet d41e07f06cdc44a7821b1dfab9135b23 (table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c])
I20260317 20:57:40.680671 2364 tablet_loader.cc:96] loaded metadata for tablet d498b1efdbca451087928cdb42d06485 (table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498])
I20260317 20:57:40.680862 2364 tablet_loader.cc:96] loaded metadata for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951])
I20260317 20:57:40.681049 2364 tablet_loader.cc:96] loaded metadata for tablet d9a43741bfda4ccdb070e74b9f638766 (table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438])
I20260317 20:57:40.681248 2364 tablet_loader.cc:96] loaded metadata for tablet db67839dc0e7439e8ffa370019a88afd (table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4])
I20260317 20:57:40.681556 2364 tablet_loader.cc:96] loaded metadata for tablet dcc244fe79aa45e18427da2be335636a (table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427])
I20260317 20:57:40.681877 2364 tablet_loader.cc:96] loaded metadata for tablet e4124783269f438c803d4fb68f223d20 (table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299])
I20260317 20:57:40.682688 2364 tablet_loader.cc:96] loaded metadata for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd])
I20260317 20:57:40.682902 2364 tablet_loader.cc:96] loaded metadata for tablet fd5cc18aee45453aa02797da17b5554f (table default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b])
I20260317 20:57:40.683039 2364 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260317 20:57:40.684333 2364 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:40.684424 2364 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260317 20:57:40.685696 2364 catalog_manager.cc:1514] Loading token signing keys...
I20260317 20:57:40.686836 2364 catalog_manager.cc:6055] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Loaded TSK: 0
I20260317 20:57:40.687693 2364 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260317 20:57:40.688822 2364 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260317 20:57:40.690016 2364 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 75
I20260317 20:57:40.699704 2204 master_service.cc:954] ReplaceTablet: received request to replace tablet 53bd2006d8e24f418a17e55cfec8fd21 from {username='slave'} at 127.0.0.1:58310
I20260317 20:57:40.699826 2201 master_service.cc:954] ReplaceTablet: received request to replace tablet 5ed1b9bbdeb04e44a548aca0800d9198 from {username='slave'} at 127.0.0.1:58310
I20260317 20:57:40.700039 2203 master_service.cc:954] ReplaceTablet: received request to replace tablet 09b20a5babe8490dba78f9ac1296a58c from {username='slave'} at 127.0.0.1:58310
I20260317 20:57:40.700836 2200 master_service.cc:954] ReplaceTablet: received request to replace tablet b9794f5cae264d1392074b3a3daf3f46 from {username='slave'} at 127.0.0.1:58310
I20260317 20:57:40.699716 2206 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58310:
table { table_name: "default.Table_0544e71a0de540529c2f7865976f74f3" } new_table_name: "default.Table_7d2b916f34184334960bf278e6737669" modify_external_catalogs: true
I20260317 20:57:40.700213 2207 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58310:
name: "default.Table_234c371e883449c4ab6fc105a42b24fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:40.700476 2198 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58310:
name: "default.Table_3d8df4ce76d747a38a984e386c6d96bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:40.700727 2202 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58310:
name: "default.Table_6215ae4e2f8745489185062d37f72f06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:40.700628 2199 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58310:
table { table_name: "default.Table_cde2029a6fbb404892afd070c4de7abd" } modify_external_catalogs: true
I20260317 20:57:40.702162 2199 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58310:
table { table_name: "default.Table_cde2029a6fbb404892afd070c4de7abd" } modify_external_catalogs: true
I20260317 20:57:40.703423 2333 consensus_queue.cc:1048] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.701206 2205 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58310:
name: "default.Table_9c0299624ff84be09887bc390f45fffa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:40.704578 881 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Refusing update from remote peer db5e708fd6404c0daa842bfc7e8f4806: Log matching property violated. Preceding OpId in replica: term: 3 index: 238. Preceding OpId from leader: term: 4 index: 240. (index mismatch)
I20260317 20:57:40.705962 2363 consensus_queue.cc:1048] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 239, Last known committed idx: 238, Time since last communication: 0.000s
I20260317 20:57:40.706547 2322 consensus_queue.cc:1048] T fd5cc18aee45453aa02797da17b5554f P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.707487 2359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 4 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:40.707633 2359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
W20260317 20:57:40.709182 2194 consensus_peers.cc:597] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 -> Peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Couldn't send request to peer 5022d9ddb45c41faa9f114e2a0a31fc3. Status: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260317 20:57:40.710258 2357 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:40.710387 2357 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:40.712183 2359 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:40.712294 2359 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:40.716467 2365 mvcc.cc:204] Tried to move back new op lower bound from 7265407224664219648 to 7265407224459849728. Current Snapshot: MvccSnapshot[applied={T|T < 7265407224641069056}]
I20260317 20:57:40.717784 2201 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 5ed1b9bbdeb04e44a548aca0800d9198
I20260317 20:57:40.718106 2203 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 09b20a5babe8490dba78f9ac1296a58c
I20260317 20:57:40.718657 2204 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 53bd2006d8e24f418a17e55cfec8fd21
I20260317 20:57:40.719038 2201 catalog_manager.cc:6741] ReplaceTablet: tablet 5ed1b9bbdeb04e44a548aca0800d9198 deleted and replaced by tablet 56fc6787771c43bba68a082d1010d0d9
I20260317 20:57:40.719100 2204 catalog_manager.cc:6741] ReplaceTablet: tablet 53bd2006d8e24f418a17e55cfec8fd21 deleted and replaced by tablet fef79942fe3440baa17a42f660b80be6
I20260317 20:57:40.719257 2200 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet b9794f5cae264d1392074b3a3daf3f46
I20260317 20:57:40.719480 2200 catalog_manager.cc:6741] ReplaceTablet: tablet b9794f5cae264d1392074b3a3daf3f46 deleted and replaced by tablet f435bb41bb6e411cb6bfb471312b6085
I20260317 20:57:40.720463 2200 catalog_manager.cc:5671] T fd5cc18aee45453aa02797da17b5554f P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193). New cstate: current_term: 1 leader_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } }
I20260317 20:57:40.721159 2203 catalog_manager.cc:6741] ReplaceTablet: tablet 09b20a5babe8490dba78f9ac1296a58c deleted and replaced by tablet dffa580b372540689e21e4f2a9de8661
I20260317 20:57:40.721397 2203 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58310:
name: "default.Table_2c85af89e0d2498184e2a12f5708ef6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
F20260317 20:57:40.725656 2269 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 7 out of 9 received events: NotificationEvent(eventId=76, eventTime=1773781059, eventType=DROP_TABLE, dbName=default, tableName=table_e0a1ab3af8974191818e51a5608c5724, message={"server":"","servicePrincipal":"","db":"default","table":"table_e0a1ab3af8974191818e51a5608c5724","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_e0a1ab3af8974191818e51a5608c5724\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781056},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_e0a1ab3af8974191818e51a5608c5724\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_e0a1ab3af8974191818e51a5608c5724\",\"kudu.table_id\":\"110ed734bb04495784d1d8ca1a7a8498\",\"transient_lastDdlTime\":\"1773781056\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781059}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=77, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_0544e71a0de540529c2f7865976f74f3, message={"server":"","servicePrincipal":"","db":"default","table":"table_0544e71a0de540529c2f7865976f74f3","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0544e71a0de540529c2f7865976f74f3\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781059},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_0544e71a0de540529c2f7865976f74f3\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0544e71a0de540529c2f7865976f74f3\",\"kudu.table_id\":\"4c1e17a5a7714446bfd8dbc5d5abb95b\",\"transient_lastDdlTime\":\"1773781059\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1773781060, eventType=ALTER_TABLE, dbName=default, tableName=table_15d4ddf21b5d49f7bf9245c9e7e07e0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_ffa8292a8cda469787b621281ed2203c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_ffa8292a8cda469787b621281ed2203c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_ffa8292a8cda469787b621281ed2203c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ffa8292a8cda469787b621281ed2203c\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_15d4ddf21b5d49f7bf9245c9e7e07e0e\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_4b318a4173584e1298cc874712d94e47, message={"server":"","servicePrincipal":"","db":"default","table":"table_4b318a4173584e1298cc874712d94e47","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4b318a4173584e1298cc874712d94e47\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781053},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_4b318a4173584e1298cc874712d94e47\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4b318a4173584e1298cc874712d94e47\",\"kudu.table_id\":\"0e789a2f9f64400eb7e38a789e0ec299\",\"transient_lastDdlTime\":\"1773781053\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"transient_lastDdlTime\":\"1773781060\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_a5ab9704ed704e619e80ab8d4d623a68, message={"server":"","servicePrincipal":"","db":"default","table":"table_a5ab9704ed704e619e80ab8d4d623a68","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a5ab9704ed704e619e80ab8d4d623a68\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781051},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_a5ab9704ed704e619e80ab8d4d623a68\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a5ab9704ed704e619e80ab8d4d623a68\",\"transient_lastDdlTime\":\"1773781051\",\"kudu.table_id\":\"a4ba9bce277146cc8c2a1cfcbf90f951\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"transient_lastDdlTime\":\"1773781060\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260317 20:57:40.729928 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet b9794f5cae264d1392074b3a3daf3f46 with delete_type TABLET_DATA_DELETED (replaced by tablet f435bb41bb6e411cb6bfb471312b6085) from {username='slave'} at 127.0.0.1:34052
I20260317 20:57:40.729987 1175 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ed1b9bbdeb04e44a548aca0800d9198 with delete_type TABLET_DATA_DELETED (replaced by tablet 56fc6787771c43bba68a082d1010d0d9) from {username='slave'} at 127.0.0.1:34052
I20260317 20:57:40.730105 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet 53bd2006d8e24f418a17e55cfec8fd21 with delete_type TABLET_DATA_DELETED (replaced by tablet fef79942fe3440baa17a42f660b80be6) from {username='slave'} at 127.0.0.1:34052
I20260317 20:57:40.730226 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b20a5babe8490dba78f9ac1296a58c with delete_type TABLET_DATA_DELETED (replaced by tablet dffa580b372540689e21e4f2a9de8661) from {username='slave'} at 127.0.0.1:34052
I20260317 20:57:40.731419 2335 consensus_queue.cc:1048] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.732554 1308 tablet_service.cc:1558] Processing DeleteTablet for tablet 53bd2006d8e24f418a17e55cfec8fd21 with delete_type TABLET_DATA_DELETED (replaced by tablet fef79942fe3440baa17a42f660b80be6) from {username='slave'} at 127.0.0.1:53672
I20260317 20:57:40.732666 1312 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ed1b9bbdeb04e44a548aca0800d9198 with delete_type TABLET_DATA_DELETED (replaced by tablet 56fc6787771c43bba68a082d1010d0d9) from {username='slave'} at 127.0.0.1:53672
I20260317 20:57:40.732998 2383 tablet_replica.cc:333] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:40.733153 2383 raft_consensus.cc:2243] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:40.733284 2383 raft_consensus.cc:2272] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.733566 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet b9794f5cae264d1392074b3a3daf3f46 with delete_type TABLET_DATA_DELETED (replaced by tablet f435bb41bb6e411cb6bfb471312b6085) from {username='slave'} at 127.0.0.1:53672
I20260317 20:57:40.733685 1312 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b20a5babe8490dba78f9ac1296a58c with delete_type TABLET_DATA_DELETED (replaced by tablet dffa580b372540689e21e4f2a9de8661) from {username='slave'} at 127.0.0.1:53672
I20260317 20:57:40.733752 2383 ts_tablet_manager.cc:1916] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f9ea8d44dcd google::LogMessage::Fail() at ??:0
I20260317 20:57:40.736482 2383 ts_tablet_manager.cc:1929] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:40.736572 2383 log.cc:1199] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/b9794f5cae264d1392074b3a3daf3f46
I20260317 20:57:40.736865 2383 ts_tablet_manager.cc:1950] T b9794f5cae264d1392074b3a3daf3f46 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:40.737783 2192 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet b9794f5cae264d1392074b3a3daf3f46 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]) successfully deleted
@ 0x7f9ea8d48b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f9ea8d447cc google::LogMessage::Flush() at ??:0
@ 0x7f9ea8d44a11 google::LogMessage::~LogMessage() at ??:0
I20260317 20:57:40.746780 2200 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58310:
name: "default.Table_2bb25afec8d34b60a23f812af93043f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:40.747541 1382 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:40.748248 2385 tablet_replica.cc:333] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:40.748414 2385 raft_consensus.cc:2243] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:40.748533 2385 raft_consensus.cc:2272] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.748934 2385 ts_tablet_manager.cc:1916] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.750102 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b20a5babe8490dba78f9ac1296a58c with delete_type TABLET_DATA_DELETED (replaced by tablet dffa580b372540689e21e4f2a9de8661) from {username='slave'} at 127.0.0.1:37386
I20260317 20:57:40.750182 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet b9794f5cae264d1392074b3a3daf3f46 with delete_type TABLET_DATA_DELETED (replaced by tablet f435bb41bb6e411cb6bfb471312b6085) from {username='slave'} at 127.0.0.1:37386
I20260317 20:57:40.750236 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ed1b9bbdeb04e44a548aca0800d9198 with delete_type TABLET_DATA_DELETED (replaced by tablet 56fc6787771c43bba68a082d1010d0d9) from {username='slave'} at 127.0.0.1:37386
I20260317 20:57:40.750182 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 53bd2006d8e24f418a17e55cfec8fd21 with delete_type TABLET_DATA_DELETED (replaced by tablet fef79942fe3440baa17a42f660b80be6) from {username='slave'} at 127.0.0.1:37386
I20260317 20:57:40.752699 1246 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:40.755025 2204 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58310:
name: "default.Table_20e6210c7a18419c901e9ae16b5560a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:40.756330 2383 tablet_replica.cc:333] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:40.756512 2383 raft_consensus.cc:2243] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:40.756733 2383 raft_consensus.cc:2272] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.757155 2383 ts_tablet_manager.cc:1916] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.758498 1715 consensus_queue.cc:1048] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.762188 1041 tablet_service.cc:1511] Processing CreateTablet for tablet f435bb41bb6e411cb6bfb471312b6085 (DEFAULT_TABLE table=default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.762540 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f435bb41bb6e411cb6bfb471312b6085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.764602 2383 ts_tablet_manager.cc:1929] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:40.764673 2383 log.cc:1199] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/53bd2006d8e24f418a17e55cfec8fd21
I20260317 20:57:40.766253 2383 ts_tablet_manager.cc:1950] T 53bd2006d8e24f418a17e55cfec8fd21 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:40.766348 1312 tablet_service.cc:1511] Processing CreateTablet for tablet f435bb41bb6e411cb6bfb471312b6085 (DEFAULT_TABLE table=default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.766625 1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f435bb41bb6e411cb6bfb471312b6085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.766937 2383 tablet_replica.cc:333] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:40.767066 2383 raft_consensus.cc:2243] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:40.767242 2383 raft_consensus.cc:2272] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.767644 2383 ts_tablet_manager.cc:1916] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.769646 1040 tablet_service.cc:1511] Processing CreateTablet for tablet dffa580b372540689e21e4f2a9de8661 (DEFAULT_TABLE table=default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.769743 1041 tablet_service.cc:1511] Processing CreateTablet for tablet 56fc6787771c43bba68a082d1010d0d9 (DEFAULT_TABLE table=default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.769956 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffa580b372540689e21e4f2a9de8661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.770092 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fc6787771c43bba68a082d1010d0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.770155 1313 tablet_service.cc:1511] Processing CreateTablet for tablet dffa580b372540689e21e4f2a9de8661 (DEFAULT_TABLE table=default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.770416 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffa580b372540689e21e4f2a9de8661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.772302 1175 tablet_service.cc:1511] Processing CreateTablet for tablet f435bb41bb6e411cb6bfb471312b6085 (DEFAULT_TABLE table=default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.772567 1175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f435bb41bb6e411cb6bfb471312b6085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.772610 1177 tablet_service.cc:1511] Processing CreateTablet for tablet dffa580b372540689e21e4f2a9de8661 (DEFAULT_TABLE table=default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.772974 2192 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 53bd2006d8e24f418a17e55cfec8fd21 (table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]) successfully deleted
I20260317 20:57:40.773298 1177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dffa580b372540689e21e4f2a9de8661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.773509 1109 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:40.774988 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 56fc6787771c43bba68a082d1010d0d9 (DEFAULT_TABLE table=default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.775233 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fc6787771c43bba68a082d1010d0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.775841 2389 tablet_bootstrap.cc:492] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:40.776795 1040 tablet_service.cc:1511] Processing CreateTablet for tablet fef79942fe3440baa17a42f660b80be6 (DEFAULT_TABLE table=default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.777055 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef79942fe3440baa17a42f660b80be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.777331 1178 tablet_service.cc:1511] Processing CreateTablet for tablet fef79942fe3440baa17a42f660b80be6 (DEFAULT_TABLE table=default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.777554 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef79942fe3440baa17a42f660b80be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.778182 1313 tablet_service.cc:1511] Processing CreateTablet for tablet fef79942fe3440baa17a42f660b80be6 (DEFAULT_TABLE table=default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.778465 1313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fef79942fe3440baa17a42f660b80be6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.780565 1312 tablet_service.cc:1511] Processing CreateTablet for tablet 56fc6787771c43bba68a082d1010d0d9 (DEFAULT_TABLE table=default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:40.780789 1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56fc6787771c43bba68a082d1010d0d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:40.782311 2391 tablet_bootstrap.cc:492] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:40.783289 2390 tablet_bootstrap.cc:492] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:40.784330 2201 catalog_manager.cc:5671] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 630e777e97c141a69e35660f32b26f6d (127.0.102.195). New cstate: current_term: 1 leader_uuid: "630e777e97c141a69e35660f32b26f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: UNKNOWN } } }
I20260317 20:57:40.784688 2390 tablet_bootstrap.cc:654] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.784691 2389 tablet_bootstrap.cc:654] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.784925 2201 catalog_manager.cc:5763] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847) does not have the latest schema for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]). Expected version 1 got 0
I20260317 20:57:40.786674 2391 tablet_bootstrap.cc:654] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.787133 2389 tablet_bootstrap.cc:492] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:40.787236 2389 ts_tablet_manager.cc:1403] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260317 20:57:40.787359 2383 ts_tablet_manager.cc:1929] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:40.787441 2383 log.cc:1199] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/09b20a5babe8490dba78f9ac1296a58c
I20260317 20:57:40.787719 2383 ts_tablet_manager.cc:1950] T 09b20a5babe8490dba78f9ac1296a58c P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:40.787744 2389 raft_consensus.cc:359] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.787861 2389 raft_consensus.cc:385] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.787892 2389 raft_consensus.cc:740] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.788350 2389 consensus_queue.cc:260] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.788475 2192 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 09b20a5babe8490dba78f9ac1296a58c (table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]) successfully deleted
I20260317 20:57:40.789499 2389 ts_tablet_manager.cc:1434] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:40.790299 2389 tablet_bootstrap.cc:492] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:40.788740 2383 tablet_replica.cc:333] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:40.790912 2383 raft_consensus.cc:2243] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:40.791036 2383 raft_consensus.cc:2272] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.791417 2389 tablet_bootstrap.cc:654] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.792250 2383 ts_tablet_manager.cc:1916] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.792737 2389 tablet_bootstrap.cc:492] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:40.792809 2389 ts_tablet_manager.cc:1403] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:40.793273 2389 raft_consensus.cc:359] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.793385 2389 raft_consensus.cc:385] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.793412 2389 raft_consensus.cc:740] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.793529 2389 consensus_queue.cc:260] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.793787 2389 ts_tablet_manager.cc:1434] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:40.793959 2389 tablet_bootstrap.cc:492] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:40.795035 2389 tablet_bootstrap.cc:654] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.795106 2383 ts_tablet_manager.cc:1929] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260317 20:57:40.795183 2383 log.cc:1199] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/5ed1b9bbdeb04e44a548aca0800d9198
I20260317 20:57:40.797430 2389 tablet_bootstrap.cc:492] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:40.797528 2389 ts_tablet_manager.cc:1403] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:40.798116 2383 ts_tablet_manager.cc:1950] T 5ed1b9bbdeb04e44a548aca0800d9198 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:40.798280 2389 raft_consensus.cc:359] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.798403 2389 raft_consensus.cc:385] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.798431 2389 raft_consensus.cc:740] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.798547 2389 consensus_queue.cc:260] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.798820 2389 ts_tablet_manager.cc:1434] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:40.798990 2389 tablet_bootstrap.cc:492] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:40.798956 2192 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:40.799894 2391 tablet_bootstrap.cc:492] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:40.799999 2391 ts_tablet_manager.cc:1403] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20260317 20:57:40.800072 2389 tablet_bootstrap.cc:654] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.800566 2391 raft_consensus.cc:359] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.800683 2391 raft_consensus.cc:385] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.800720 2391 raft_consensus.cc:740] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.800938 2391 consensus_queue.cc:260] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.801465 2322 raft_consensus.cc:493] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:40.801553 2322 raft_consensus.cc:515] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.801924 2322 leader_election.cc:290] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:40.802311 2391 ts_tablet_manager.cc:1434] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:40.803226 2391 tablet_bootstrap.cc:492] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:40.803180 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f435bb41bb6e411cb6bfb471312b6085" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
W20260317 20:57:40.803607 996 leader_election.cc:343] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:40.804141 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f435bb41bb6e411cb6bfb471312b6085" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:40.804256 1196 raft_consensus.cc:2468] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:40.804548 2389 tablet_bootstrap.cc:492] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:40.804586 2391 tablet_bootstrap.cc:654] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.804646 2389 ts_tablet_manager.cc:1403] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:40.804555 995 leader_election.cc:304] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 630e777e97c141a69e35660f32b26f6d
I20260317 20:57:40.804991 2322 raft_consensus.cc:2804] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:40.805042 2322 raft_consensus.cc:493] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:40.805085 2322 raft_consensus.cc:3060] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.805105 2389 raft_consensus.cc:359] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.805195 2389 raft_consensus.cc:385] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.805222 2389 raft_consensus.cc:740] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.805354 2389 consensus_queue.cc:260] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.805608 2389 ts_tablet_manager.cc:1434] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:40.805663 2391 tablet_bootstrap.cc:492] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:40.805742 2391 ts_tablet_manager.cc:1403] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:40.806208 2322 raft_consensus.cc:515] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.806329 2391 raft_consensus.cc:359] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.806422 2391 raft_consensus.cc:385] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.806452 2391 raft_consensus.cc:740] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.806612 2322 leader_election.cc:290] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:40.806571 2391 consensus_queue.cc:260] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.806903 2391 ts_tablet_manager.cc:1434] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:40.807088 2391 tablet_bootstrap.cc:492] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:40.807098 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f435bb41bb6e411cb6bfb471312b6085" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
W20260317 20:57:40.807461 996 leader_election.cc:343] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Illegal state: must be running to vote when last-logged opid is not known
I20260317 20:57:40.807812 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f435bb41bb6e411cb6bfb471312b6085" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:40.807909 1196 raft_consensus.cc:3060] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.808962 1196 raft_consensus.cc:2468] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:40.809140 2391 tablet_bootstrap.cc:654] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.809314 995 leader_election.cc:304] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 630e777e97c141a69e35660f32b26f6d
I20260317 20:57:40.809535 2333 raft_consensus.cc:2804] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:40.809607 2333 raft_consensus.cc:697] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:40.809755 2333 consensus_queue.cc:237] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.810936 2385 ts_tablet_manager.cc:1929] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:40.811026 2385 log.cc:1199] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/53bd2006d8e24f418a17e55cfec8fd21
@ 0x7f9eadf17847 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260317 20:57:40.813014 2385 ts_tablet_manager.cc:1950] T 53bd2006d8e24f418a17e55cfec8fd21 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:40.813716 2385 tablet_replica.cc:333] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:40.813866 2385 raft_consensus.cc:2243] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:40.813934 2193 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 53bd2006d8e24f418a17e55cfec8fd21 (table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]) successfully deleted
I20260317 20:57:40.814091 2385 raft_consensus.cc:2272] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.814172 2387 tablet_replica.cc:333] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:40.814347 2387 raft_consensus.cc:2243] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:40.814479 2387 raft_consensus.cc:2272] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.814991 2387 ts_tablet_manager.cc:1916] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.815007 2201 catalog_manager.cc:6216] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7] alter complete (version 1)
I20260317 20:57:40.815119 2385 ts_tablet_manager.cc:1916] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.815315 2391 tablet_bootstrap.cc:492] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:40.815501 2391 ts_tablet_manager.cc:1403] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:40.816174 2391 raft_consensus.cc:359] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.816334 2391 raft_consensus.cc:385] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.816372 2391 raft_consensus.cc:740] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.816576 2391 consensus_queue.cc:260] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.817034 2391 ts_tablet_manager.cc:1434] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:40.817421 2385 ts_tablet_manager.cc:1929] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260317 20:57:40.818369 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet 53bd2006d8e24f418a17e55cfec8fd21 with delete_type TABLET_DATA_DELETED (replaced by tablet fef79942fe3440baa17a42f660b80be6) from {username='slave'} at 127.0.0.1:53672
W20260317 20:57:40.818488 2201 catalog_manager.cc:5863] Failed to send AlterTable RPC for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c1aabdbda61848958c6a5dd40f8795d8 consensus state has no leader
I20260317 20:57:40.818768 2387 ts_tablet_manager.cc:1929] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:40.819062 2391 tablet_bootstrap.cc:492] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:40.818850 2387 log.cc:1199] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/09b20a5babe8490dba78f9ac1296a58c
I20260317 20:57:40.820473 2387 ts_tablet_manager.cc:1950] T 09b20a5babe8490dba78f9ac1296a58c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
@ 0x7f9eadf1675e kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260317 20:57:40.821419 2193 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 09b20a5babe8490dba78f9ac1296a58c (table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]) successfully deleted
I20260317 20:57:40.821530 2387 tablet_replica.cc:333] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:40.821733 2391 tablet_bootstrap.cc:654] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.821717 2387 raft_consensus.cc:2243] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:40.821964 2387 raft_consensus.cc:2272] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.822499 2387 ts_tablet_manager.cc:1916] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.823376 2391 tablet_bootstrap.cc:492] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:40.823494 2391 ts_tablet_manager.cc:1403] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:40.824148 2391 raft_consensus.cc:359] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.824271 2391 raft_consensus.cc:385] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.824353 2391 raft_consensus.cc:740] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
@ 0x7f9eadf15ec1 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260317 20:57:40.824499 2391 consensus_queue.cc:260] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.824836 2391 ts_tablet_manager.cc:1434] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:40.824728 2201 catalog_manager.cc:5671] T c1aabdbda61848958c6a5dd40f8795d8 P 35518b51259b46d1b9b5e82b6841057b reported cstate change: term changed from 0 to 1, leader changed from <none> to 35518b51259b46d1b9b5e82b6841057b (127.0.102.194). New cstate: current_term: 1 leader_uuid: "35518b51259b46d1b9b5e82b6841057b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } health_report { overall_health: HEALTHY } } }
I20260317 20:57:40.825446 2201 catalog_manager.cc:5763] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679) does not have the latest schema for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]). Expected version 1 got 0
I20260317 20:57:40.827689 2387 ts_tablet_manager.cc:1929] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:40.827783 2387 log.cc:1199] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/b9794f5cae264d1392074b3a3daf3f46
I20260317 20:57:40.828056 2387 ts_tablet_manager.cc:1950] T b9794f5cae264d1392074b3a3daf3f46 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:40.828810 2385 log.cc:1199] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/5ed1b9bbdeb04e44a548aca0800d9198
I20260317 20:57:40.829152 2385 ts_tablet_manager.cc:1950] T 5ed1b9bbdeb04e44a548aca0800d9198 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
@ 0x7f9eadf1b5c8 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260317 20:57:40.830138 2387 tablet_replica.cc:333] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:40.830252 2193 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet b9794f5cae264d1392074b3a3daf3f46 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]) successfully deleted
I20260317 20:57:40.830309 2387 raft_consensus.cc:2243] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:40.830431 2387 raft_consensus.cc:2272] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.830447 2390 tablet_bootstrap.cc:492] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:40.830581 2390 ts_tablet_manager.cc:1403] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.047s user 0.003s sys 0.000s
@ 0x5600441df18a std::function<>::operator()() at ??:0
I20260317 20:57:40.831198 2387 ts_tablet_manager.cc:1916] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.831313 2390 raft_consensus.cc:359] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.831461 2390 raft_consensus.cc:385] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.831501 2390 raft_consensus.cc:740] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.831683 2390 consensus_queue.cc:260] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.832082 2390 ts_tablet_manager.cc:1434] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:40.832336 2390 tablet_bootstrap.cc:492] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:40.833843 2390 tablet_bootstrap.cc:654] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.834340 2385 tablet_replica.cc:333] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:40.834429 2193 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:40.834491 2385 raft_consensus.cc:2243] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:40.834614 2385 raft_consensus.cc:2272] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7f9eaa244214 kudu::Thread::SuperviseThread() at ??:0
I20260317 20:57:40.836526 2390 tablet_bootstrap.cc:492] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:40.836637 2390 ts_tablet_manager.cc:1403] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260317 20:57:40.837174 2390 raft_consensus.cc:359] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.837301 2390 raft_consensus.cc:385] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.837340 2390 raft_consensus.cc:740] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.837502 2390 consensus_queue.cc:260] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.837711 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 53bd2006d8e24f418a17e55cfec8fd21 with delete_type TABLET_DATA_DELETED (replaced by tablet fef79942fe3440baa17a42f660b80be6) from {username='slave'} at 127.0.0.1:34052
I20260317 20:57:40.837910 2390 ts_tablet_manager.cc:1434] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:40.838310 2385 ts_tablet_manager.cc:1916] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.838619 2351 raft_consensus.cc:493] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:40.838697 2351 raft_consensus.cc:515] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:40.839046 2351 leader_election.cc:290] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
W20260317 20:57:40.839309 2192 catalog_manager.cc:4969] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): delete failed for tablet 53bd2006d8e24f418a17e55cfec8fd21 because the tablet was not found. No further retry: Not found: Tablet not found: 53bd2006d8e24f418a17e55cfec8fd21
I20260317 20:57:40.839434 2390 tablet_bootstrap.cc:492] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:40.839679 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f435bb41bb6e411cb6bfb471312b6085" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:40.840095 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f435bb41bb6e411cb6bfb471312b6085" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:40.840242 1196 raft_consensus.cc:2393] T f435bb41bb6e411cb6bfb471312b6085 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 630e777e97c141a69e35660f32b26f6d in current term 1: Already voted for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in this term.
I20260317 20:57:40.840693 2385 ts_tablet_manager.cc:1929] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:40.840725 2390 tablet_bootstrap.cc:654] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.840761 2385 log.cc:1199] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/b9794f5cae264d1392074b3a3daf3f46
I20260317 20:57:40.841025 2385 ts_tablet_manager.cc:1950] T b9794f5cae264d1392074b3a3daf3f46 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
@ 0x7f9eaaa2c6db start_thread at ??:0
I20260317 20:57:40.841610 1806 consensus_queue.cc:1048] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.840760 1268 leader_election.cc:304] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d; no voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:40.841889 2387 ts_tablet_manager.cc:1929] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260317 20:57:40.841986 2387 log.cc:1199] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/5ed1b9bbdeb04e44a548aca0800d9198
I20260317 20:57:40.841982 1806 raft_consensus.cc:3060] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.842214 2193 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet b9794f5cae264d1392074b3a3daf3f46 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]) successfully deleted
I20260317 20:57:40.842283 2387 ts_tablet_manager.cc:1950] T 5ed1b9bbdeb04e44a548aca0800d9198 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:40.842841 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ed1b9bbdeb04e44a548aca0800d9198 with delete_type TABLET_DATA_DELETED (replaced by tablet 56fc6787771c43bba68a082d1010d0d9) from {username='slave'} at 127.0.0.1:34052
I20260317 20:57:40.842888 2387 tablet_replica.cc:333] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:40.843034 2387 raft_consensus.cc:2243] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:40.843027 1806 raft_consensus.cc:2749] T f435bb41bb6e411cb6bfb471312b6085 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260317 20:57:40.843140 2387 raft_consensus.cc:2272] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260317 20:57:40.843357 2192 catalog_manager.cc:4969] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): delete failed for tablet 5ed1b9bbdeb04e44a548aca0800d9198 because the tablet was not found. No further retry: Not found: Tablet not found: 5ed1b9bbdeb04e44a548aca0800d9198
I20260317 20:57:40.843570 2387 ts_tablet_manager.cc:1916] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.844074 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet 09b20a5babe8490dba78f9ac1296a58c with delete_type TABLET_DATA_DELETED (replaced by tablet dffa580b372540689e21e4f2a9de8661) from {username='slave'} at 127.0.0.1:34052
I20260317 20:57:40.844116 2193 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 5ed1b9bbdeb04e44a548aca0800d9198 (table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]) successfully deleted
I20260317 20:57:40.841629 2385 tablet_replica.cc:333] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
W20260317 20:57:40.844450 2192 catalog_manager.cc:4969] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): delete failed for tablet 09b20a5babe8490dba78f9ac1296a58c because the tablet was not found. No further retry: Not found: Tablet not found: 09b20a5babe8490dba78f9ac1296a58c
@ 0x7f9ea7efb61f clone at ??:0
I20260317 20:57:40.845858 2387 ts_tablet_manager.cc:1929] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:57:40.861150 2387 log.cc:1199] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/53bd2006d8e24f418a17e55cfec8fd21
I20260317 20:57:40.861554 2387 ts_tablet_manager.cc:1950] T 53bd2006d8e24f418a17e55cfec8fd21 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:40.844481 2385 raft_consensus.cc:2243] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:40.845130 2390 tablet_bootstrap.cc:492] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:40.850404 2038 consensus_queue.cc:1048] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:40.861864 2390 ts_tablet_manager.cc:1403] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20260317 20:57:40.863046 2390 raft_consensus.cc:359] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.863207 2390 raft_consensus.cc:385] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.863245 2390 raft_consensus.cc:740] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.863528 2390 consensus_queue.cc:260] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.863924 2390 ts_tablet_manager.cc:1434] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260317 20:57:40.864167 2390 tablet_bootstrap.cc:492] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:40.865413 2390 tablet_bootstrap.cc:654] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:40.866711 2390 tablet_bootstrap.cc:492] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:40.866813 2390 ts_tablet_manager.cc:1403] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260317 20:57:40.867395 2390 raft_consensus.cc:359] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.867514 2390 raft_consensus.cc:385] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:40.867542 2390 raft_consensus.cc:740] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:40.867666 2390 consensus_queue.cc:260] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.867965 2390 ts_tablet_manager.cc:1434] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260317 20:57:40.868448 2385 raft_consensus.cc:2272] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:40.869205 2385 ts_tablet_manager.cc:1916] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:40.871893 2385 ts_tablet_manager.cc:1929] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:40.871977 2385 log.cc:1199] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/09b20a5babe8490dba78f9ac1296a58c
I20260317 20:57:40.872269 2385 ts_tablet_manager.cc:1950] T 09b20a5babe8490dba78f9ac1296a58c P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:40.888559 2333 raft_consensus.cc:493] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:40.888692 2333 raft_consensus.cc:515] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.889252 2333 leader_election.cc:290] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:40.890008 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef79942fe3440baa17a42f660b80be6" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:40.890197 1332 raft_consensus.cc:2468] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:40.890617 996 leader_election.cc:304] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.890739 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef79942fe3440baa17a42f660b80be6" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:40.890815 2333 raft_consensus.cc:2804] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:40.890861 2333 raft_consensus.cc:493] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:40.890877 1196 raft_consensus.cc:2468] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:40.890900 2333 raft_consensus.cc:3060] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.892187 2333 raft_consensus.cc:515] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.892647 2333 leader_election.cc:290] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:40.893163 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef79942fe3440baa17a42f660b80be6" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:40.893285 1333 raft_consensus.cc:3060] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.893461 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fef79942fe3440baa17a42f660b80be6" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:40.893561 1196 raft_consensus.cc:3060] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.894632 1333 raft_consensus.cc:2468] T fef79942fe3440baa17a42f660b80be6 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:40.894672 1196 raft_consensus.cc:2468] T fef79942fe3440baa17a42f660b80be6 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:40.894994 996 leader_election.cc:304] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.895166 2333 raft_consensus.cc:2804] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:40.895601 2333 raft_consensus.cc:697] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:40.895787 2333 consensus_queue.cc:237] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.964555 2335 raft_consensus.cc:493] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:40.964720 2335 raft_consensus.cc:515] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.965198 2335 leader_election.cc:290] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:40.965698 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa580b372540689e21e4f2a9de8661" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:40.965894 1060 raft_consensus.cc:2468] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:40.965880 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa580b372540689e21e4f2a9de8661" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:40.966005 1333 raft_consensus.cc:2468] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:40.966300 1133 leader_election.cc:304] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.966532 2335 raft_consensus.cc:2804] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:40.966598 2335 raft_consensus.cc:493] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:40.966663 2335 raft_consensus.cc:3060] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.967581 2335 raft_consensus.cc:515] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:40.968003 2335 leader_election.cc:290] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:40.968430 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa580b372540689e21e4f2a9de8661" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:40.968459 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dffa580b372540689e21e4f2a9de8661" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:40.968573 1333 raft_consensus.cc:3060] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.968583 1060 raft_consensus.cc:3060] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:40.969647 1333 raft_consensus.cc:2468] T dffa580b372540689e21e4f2a9de8661 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:40.969647 1060 raft_consensus.cc:2468] T dffa580b372540689e21e4f2a9de8661 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:40.970012 1133 leader_election.cc:304] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:40.970302 2335 raft_consensus.cc:2804] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:40.970525 2335 raft_consensus.cc:697] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:40.970698 2335 consensus_queue.cc:237] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:41.005316 2335 raft_consensus.cc:493] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:41.005527 2335 raft_consensus.cc:515] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:41.006095 2335 leader_election.cc:290] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:41.006769 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc6787771c43bba68a082d1010d0d9" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:41.006804 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc6787771c43bba68a082d1010d0d9" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:41.006954 1333 raft_consensus.cc:2468] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:41.006954 1060 raft_consensus.cc:2468] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:41.007350 1133 leader_election.cc:304] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:41.007725 2335 raft_consensus.cc:2804] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:41.007802 2335 raft_consensus.cc:493] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:41.007899 2335 raft_consensus.cc:3060] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:41.009099 2335 raft_consensus.cc:515] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:41.009591 2335 leader_election.cc:290] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:41.010114 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc6787771c43bba68a082d1010d0d9" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:41.010176 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56fc6787771c43bba68a082d1010d0d9" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:41.010257 1060 raft_consensus.cc:3060] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:41.010375 1333 raft_consensus.cc:3060] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:41.011418 1333 raft_consensus.cc:2468] T 56fc6787771c43bba68a082d1010d0d9 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:41.011413 1060 raft_consensus.cc:2468] T 56fc6787771c43bba68a082d1010d0d9 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:41.011915 1133 leader_election.cc:304] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:41.012202 2335 raft_consensus.cc:2804] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:41.012322 2335 raft_consensus.cc:697] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:41.012492 2335 consensus_queue.cc:237] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
W20260317 20:57:41.051491 1268 connection.cc:537] server connection from 127.0.0.1:53672 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:41.051723 995 connection.cc:537] server connection from 127.0.0.1:37386 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:41.052744 2354 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:41.052349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.102.193:54389)
0317 20:57:41.052574 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:41.052651 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":130}
W20260317 20:57:41.052780 1389 connection.cc:537] client connection to 127.0.102.253:38969 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:41.053194 1389 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.102.253:38969)
W20260317 20:57:41.053519 1389 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:41.053658 1389 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:41.053843 1389 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.102.253:38969)
I20260317 20:57:41.223212 2333 consensus_queue.cc:1048] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:41.229628 2423 consensus_queue.cc:1048] T f435bb41bb6e411cb6bfb471312b6085 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:41.291162 2423 consensus_queue.cc:1048] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:41.295636 2322 consensus_queue.cc:1048] T fef79942fe3440baa17a42f660b80be6 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:41.332803 2432 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:41.332928 2432 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:41.333314 2432 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:41.334877 858 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:41.334985 857 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:41.335055 857 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:41.335192 2432 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260317 20:57:41.402436 1715 consensus_queue.cc:1048] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:41.406757 2427 consensus_queue.cc:1048] T 56fc6787771c43bba68a082d1010d0d9 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:41.421579 2427 consensus_queue.cc:1048] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:41.426684 2440 consensus_queue.cc:1048] T dffa580b372540689e21e4f2a9de8661 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:42.048280 2445 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:42.048413 2445 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:42.048952 2445 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:42.050266 858 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:42.050372 857 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:42.050436 857 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:42.050613 2445 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260317 20:57:42.757638 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.253:38969
--webserver_interface=127.0.102.253
--webserver_port=45191
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260317 20:57:42.874866 2457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:42.875103 2457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:42.875146 2457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:42.879134 2457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:42.879208 2457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:42.879228 2457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:42.879246 2457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:42.883598 2457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.253:38969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.102.253
--webserver_port=45191
--never_fsync=true
--heap_profile_path=/tmp/kudu.2457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:42.884750 2457 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:42.885994 2457 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:42.892170 2463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:42.892154 2462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:42.892158 2465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:42.892434 2457 server_base.cc:1060] running on GCE node
I20260317 20:57:42.893451 2457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:42.894620 2457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:42.895820 2457 hybrid_clock.cc:648] HybridClock initialized: now 1773781062895799 us; error 49 us; skew 500 ppm
I20260317 20:57:42.898123 2457 webserver.cc:492] Webserver started at http://127.0.102.253:45191/ using document root <none> and password file <none>
I20260317 20:57:42.899178 2457 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:42.899287 2457 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:42.903394 2457 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260317 20:57:42.905784 2471 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:42.907153 2457 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260317 20:57:42.907351 2457 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
uuid: "db5e708fd6404c0daa842bfc7e8f4806"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:42.907866 2457 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:42.924183 2478 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:42.924360 2478 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:42.924933 2478 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:42.926363 857 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:42.926468 858 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:42.926566 858 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:42.926721 2478 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260317 20:57:42.937579 2457 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:42.938450 2457 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:42.938652 2457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:42.947048 2457 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.253:38969
I20260317 20:57:42.947057 2532 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.253:38969 every 8 connection(s)
I20260317 20:57:42.948402 2457 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
I20260317 20:57:42.952627 2533 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:42.954638 2533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap starting.
I20260317 20:57:42.955034 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 2457
I20260317 20:57:42.976755 2533 log.cc:826] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:43.099763 2533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap replayed 1/1 log segments. Stats: ops{read=248 overwritten=0 applied=248 ignored=0} inserts{seen=163 ignored=0} mutations{seen=218 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:43.100270 2533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap complete.
I20260317 20:57:43.103303 2533 raft_consensus.cc:359] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:43.103816 2533 raft_consensus.cc:740] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: db5e708fd6404c0daa842bfc7e8f4806, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.104403 2533 consensus_queue.cc:260] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 248, Last appended: 4.248, Last appended by leader: 248, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:43.105065 2537 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:43.105243 2537 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:43.106329 2533 sys_catalog.cc:565] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:43.111894 2457 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111),
I20260317 20:57:43.114558 2457 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:43.116219 2551 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:43.116314 2551 catalog_manager.cc:1562] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: loading cluster ID for follower catalog manager: success
I20260317 20:57:43.120939 2551 catalog_manager.cc:1584] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: acquiring CA information for follower catalog manager: success
I20260317 20:57:43.124619 2551 catalog_manager.cc:1612] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:57:43.209089 1109 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:43.209264 1109 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:43.212169 2497 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:53105; Asking this server to re-register.
I20260317 20:57:43.212977 1109 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:43.214776 2497 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:43.413780 1246 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:43.415364 2497 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:53371; Asking this server to re-register.
I20260317 20:57:43.415863 1246 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:43.416996 2497 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:43.436584 1382 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:43.438239 2496 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:53231; Asking this server to re-register.
I20260317 20:57:43.438802 1382 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:43.440155 2496 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:43.652107 2561 raft_consensus.cc:493] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:43.652415 2561 raft_consensus.cc:515] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:43.653764 2561 leader_election.cc:290] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:57:43.654523 2477 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:43.656329 2477 leader_election.cc:336] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:43.659641 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 5 candidate_status { last_received { term: 4 index: 248 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" is_pre_election: true
I20260317 20:57:43.659806 881 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 4.
I20260317 20:57:43.660295 2475 leader_election.cc:304] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3
I20260317 20:57:43.660596 2561 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260317 20:57:43.660673 2561 raft_consensus.cc:493] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:43.660760 2561 raft_consensus.cc:3060] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 4 FOLLOWER]: Advancing to term 5
I20260317 20:57:43.662667 2561 raft_consensus.cc:515] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:43.663182 2561 leader_election.cc:290] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 5 election: Requested vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:43.663707 881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 5 candidate_status { last_received { term: 4 index: 248 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
I20260317 20:57:43.663859 881 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 4 FOLLOWER]: Advancing to term 5
W20260317 20:57:43.664363 2477 leader_election.cc:336] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:43.665004 881 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 5.
I20260317 20:57:43.665333 2475 leader_election.cc:304] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3
I20260317 20:57:43.665530 2561 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Leader election won for term 5
I20260317 20:57:43.665745 2561 raft_consensus.cc:697] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 LEADER]: Becoming Leader. State: Replica: db5e708fd6404c0daa842bfc7e8f4806, State: Running, Role: LEADER
I20260317 20:57:43.666121 2561 consensus_queue.cc:237] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 248, Committed index: 248, Last appended: 4.248, Last appended by leader: 248, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:43.667822 2566 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 5 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:43.667935 2566 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:43.668254 2568 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260317 20:57:43.670676 2568 catalog_manager.cc:679] Loaded metadata for table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]
I20260317 20:57:43.671051 2568 catalog_manager.cc:679] Loaded metadata for table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]
I20260317 20:57:43.671304 2568 catalog_manager.cc:679] Loaded metadata for table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]
I20260317 20:57:43.671530 2568 catalog_manager.cc:679] Loaded metadata for table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299]
I20260317 20:57:43.671775 2568 catalog_manager.cc:679] Loaded metadata for table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]
I20260317 20:57:43.672259 2568 catalog_manager.cc:679] Loaded metadata for table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]
I20260317 20:57:43.672575 2568 catalog_manager.cc:679] Loaded metadata for table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]
I20260317 20:57:43.672968 2568 catalog_manager.cc:679] Loaded metadata for table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]
I20260317 20:57:43.673193 2568 catalog_manager.cc:679] Loaded metadata for table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]
I20260317 20:57:43.673413 2568 catalog_manager.cc:679] Loaded metadata for table default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b]
I20260317 20:57:43.673640 2568 catalog_manager.cc:679] Loaded metadata for table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]
I20260317 20:57:43.674173 2568 catalog_manager.cc:679] Loaded metadata for table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]
I20260317 20:57:43.674484 2568 catalog_manager.cc:679] Loaded metadata for table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]
I20260317 20:57:43.674703 2568 catalog_manager.cc:679] Loaded metadata for table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]
I20260317 20:57:43.674929 2568 catalog_manager.cc:679] Loaded metadata for table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]
I20260317 20:57:43.675169 2568 catalog_manager.cc:679] Loaded metadata for table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]
I20260317 20:57:43.675411 2568 catalog_manager.cc:679] Loaded metadata for table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]
I20260317 20:57:43.675839 2568 catalog_manager.cc:679] Loaded metadata for table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]
I20260317 20:57:43.676265 2568 catalog_manager.cc:679] Loaded metadata for table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]
I20260317 20:57:43.676560 2568 catalog_manager.cc:679] Loaded metadata for table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951]
I20260317 20:57:43.676895 2568 catalog_manager.cc:679] Loaded metadata for table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]
I20260317 20:57:43.677134 2568 catalog_manager.cc:679] Loaded metadata for table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd]
I20260317 20:57:43.677359 2568 catalog_manager.cc:679] Loaded metadata for table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]
I20260317 20:57:43.677615 2568 catalog_manager.cc:679] Loaded metadata for table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]
I20260317 20:57:43.677922 2568 catalog_manager.cc:679] Loaded metadata for table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]
I20260317 20:57:43.678210 2568 catalog_manager.cc:679] Loaded metadata for table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]
I20260317 20:57:43.678493 2568 catalog_manager.cc:679] Loaded metadata for table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]
I20260317 20:57:43.678746 2568 catalog_manager.cc:679] Loaded metadata for table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]
I20260317 20:57:43.679064 2568 catalog_manager.cc:679] Loaded metadata for table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]
I20260317 20:57:43.681370 2568 tablet_loader.cc:96] loaded metadata for tablet 0d7946629e25418c9c23d09363e305b8 (table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4])
I20260317 20:57:43.681831 2568 tablet_loader.cc:96] loaded metadata for tablet 1947a091d5c8450abb0b7ed7acc05136 (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e])
I20260317 20:57:43.682195 2568 tablet_loader.cc:96] loaded metadata for tablet 1bc0397641de4016baca65a655b38c30 (table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41])
I20260317 20:57:43.682394 2568 tablet_loader.cc:96] loaded metadata for tablet 1e084fc67777419fb5af7936ab89e8bf (table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502])
I20260317 20:57:43.682588 2568 tablet_loader.cc:96] loaded metadata for tablet 2919b2a953ef4d74955ca04b622b6c33 (table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd])
I20260317 20:57:43.682860 2568 tablet_loader.cc:96] loaded metadata for tablet 3958625929884f3397edf4c3aee3260e (table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d])
I20260317 20:57:43.683202 2568 tablet_loader.cc:96] loaded metadata for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7])
I20260317 20:57:43.683561 2568 tablet_loader.cc:96] loaded metadata for tablet 492e0f23d6b74854bc68f51c8136d495 (table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543])
I20260317 20:57:43.683749 2568 tablet_loader.cc:96] loaded metadata for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93])
I20260317 20:57:43.684104 2568 tablet_loader.cc:96] loaded metadata for tablet 56fc6787771c43bba68a082d1010d0d9 (table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad])
I20260317 20:57:43.684686 2568 tablet_loader.cc:96] loaded metadata for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d])
I20260317 20:57:43.685204 2568 tablet_loader.cc:96] loaded metadata for tablet 7d60f1c4eba344a3bbf72ab296b68843 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06])
I20260317 20:57:43.685400 2568 tablet_loader.cc:96] loaded metadata for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62])
I20260317 20:57:43.685583 2568 tablet_loader.cc:96] loaded metadata for tablet a78fdc83a3d54554a08f01915f102f6e (table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5])
I20260317 20:57:43.685854 2568 tablet_loader.cc:96] loaded metadata for tablet aa23ce23d4b0465baf378859e9ad018c (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69])
I20260317 20:57:43.686379 2568 tablet_loader.cc:96] loaded metadata for tablet b5739d6cb9a84de78767b471608f1671 (table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2])
I20260317 20:57:43.686827 2568 tablet_loader.cc:96] loaded metadata for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3])
I20260317 20:57:43.687098 2568 tablet_loader.cc:96] loaded metadata for tablet d41e07f06cdc44a7821b1dfab9135b23 (table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c])
I20260317 20:57:43.687300 2568 tablet_loader.cc:96] loaded metadata for tablet d498b1efdbca451087928cdb42d06485 (table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498])
I20260317 20:57:43.687562 2568 tablet_loader.cc:96] loaded metadata for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951])
I20260317 20:57:43.687769 2568 tablet_loader.cc:96] loaded metadata for tablet d9a43741bfda4ccdb070e74b9f638766 (table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438])
I20260317 20:57:43.687970 2568 tablet_loader.cc:96] loaded metadata for tablet db67839dc0e7439e8ffa370019a88afd (table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4])
I20260317 20:57:43.688177 2568 tablet_loader.cc:96] loaded metadata for tablet dcc244fe79aa45e18427da2be335636a (table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427])
I20260317 20:57:43.688443 2568 tablet_loader.cc:96] loaded metadata for tablet dffa580b372540689e21e4f2a9de8661 (table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182])
I20260317 20:57:43.688624 2568 tablet_loader.cc:96] loaded metadata for tablet e4124783269f438c803d4fb68f223d20 (table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299])
I20260317 20:57:43.689293 2568 tablet_loader.cc:96] loaded metadata for tablet f435bb41bb6e411cb6bfb471312b6085 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113])
I20260317 20:57:43.689702 2568 tablet_loader.cc:96] loaded metadata for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd])
I20260317 20:57:43.689977 2568 tablet_loader.cc:96] loaded metadata for tablet fd5cc18aee45453aa02797da17b5554f (table default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b])
I20260317 20:57:43.690198 2568 tablet_loader.cc:96] loaded metadata for tablet fef79942fe3440baa17a42f660b80be6 (table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1])
I20260317 20:57:43.690429 2568 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260317 20:57:43.691675 2568 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:43.691748 2568 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260317 20:57:43.693207 2568 catalog_manager.cc:1514] Loading token signing keys...
I20260317 20:57:43.694439 2568 catalog_manager.cc:6055] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Loaded TSK: 0
I20260317 20:57:43.695209 2568 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260317 20:57:43.696321 2568 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260317 20:57:43.697413 2568 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 75
I20260317 20:57:43.729285 2496 master_service.cc:954] ReplaceTablet: received request to replace tablet db67839dc0e7439e8ffa370019a88afd from {username='slave'} at 127.0.0.1:59982
I20260317 20:57:43.729462 2495 master_service.cc:954] ReplaceTablet: received request to replace tablet d498b1efdbca451087928cdb42d06485 from {username='slave'} at 127.0.0.1:59982
I20260317 20:57:43.729980 2497 master_service.cc:954] ReplaceTablet: received request to replace tablet d41e07f06cdc44a7821b1dfab9135b23 from {username='slave'} at 127.0.0.1:59982
I20260317 20:57:43.730268 2488 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_143f9036b95c45388916784f134edd5d" } modify_external_catalogs: true
I20260317 20:57:43.730425 2488 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_143f9036b95c45388916784f134edd5d" } modify_external_catalogs: true
I20260317 20:57:43.730808 2489 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_6bacc979980f45f3bff68d78ea0c114d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:43.731292 2490 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_df3d165713f44a8b87b980f60d112d34" } new_table_name: "default.Table_6dc3bfd2de6b485098bb35884f8287fb" modify_external_catalogs: true
I20260317 20:57:43.731520 2491 master_service.cc:954] ReplaceTablet: received request to replace tablet a4a60c7b22b5475eb2c9d6b40ed1a89b from {username='slave'} at 127.0.0.1:59982
I20260317 20:57:43.732450 2494 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_d75875b48ed64da7a376b2b012ffe68c" } new_table_name: "default.Table_4ff5658252364bb1bf6fa149608be43f" modify_external_catalogs: true
I20260317 20:57:43.732515 2492 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_f3bf180436c74527a1909f1af367814e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:43.732726 2493 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_70c346e7110644f2b3b5b4bec1789d4a" } new_table_name: "default.Table_fb41c97ca0a9409c963fbe195007a57f" modify_external_catalogs: true
I20260317 20:57:43.737447 881 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Refusing update from remote peer db5e708fd6404c0daa842bfc7e8f4806: Log matching property violated. Preceding OpId in replica: term: 4 index: 248. Preceding OpId from leader: term: 5 index: 250. (index mismatch)
W20260317 20:57:43.738197 2477 consensus_peers.cc:597] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 -> Peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Couldn't send request to peer 5022d9ddb45c41faa9f114e2a0a31fc3. Status: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260317 20:57:43.738807 2550 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 7 out of 9 received events: NotificationEvent(eventId=76, eventTime=1773781059, eventType=DROP_TABLE, dbName=default, tableName=table_e0a1ab3af8974191818e51a5608c5724, message={"server":"","servicePrincipal":"","db":"default","table":"table_e0a1ab3af8974191818e51a5608c5724","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_e0a1ab3af8974191818e51a5608c5724\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781056},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_e0a1ab3af8974191818e51a5608c5724\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_e0a1ab3af8974191818e51a5608c5724\",\"kudu.table_id\":\"110ed734bb04495784d1d8ca1a7a8498\",\"transient_lastDdlTime\":\"1773781056\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781059}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=77, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_0544e71a0de540529c2f7865976f74f3, message={"server":"","servicePrincipal":"","db":"default","table":"table_0544e71a0de540529c2f7865976f74f3","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0544e71a0de540529c2f7865976f74f3\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781059},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_0544e71a0de540529c2f7865976f74f3\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0544e71a0de540529c2f7865976f74f3\",\"kudu.table_id\":\"4c1e17a5a7714446bfd8dbc5d5abb95b\",\"transient_lastDdlTime\":\"1773781059\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1773781060, eventType=ALTER_TABLE, dbName=default, tableName=table_15d4ddf21b5d49f7bf9245c9e7e07e0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_ffa8292a8cda469787b621281ed2203c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_ffa8292a8cda469787b621281ed2203c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_ffa8292a8cda469787b621281ed2203c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ffa8292a8cda469787b621281ed2203c\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_15d4ddf21b5d49f7bf9245c9e7e07e0e\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_4b318a4173584e1298cc874712d94e47, message={"server":"","servicePrincipal":"","db":"default","table":"table_4b318a4173584e1298cc874712d94e47","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4b318a4173584e1298cc874712d94e47\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781053},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_4b318a4173584e1298cc874712d94e47\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4b318a4173584e1298cc874712d94e47\",\"kudu.table_id\":\"0e789a2f9f64400eb7e38a789e0ec299\",\"transient_lastDdlTime\":\"1773781053\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"transient_lastDdlTime\":\"1773781060\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_a5ab9704ed704e619e80ab8d4d623a68, message={"server":"","servicePrincipal":"","db":"default","table":"table_a5ab9704ed704e619e80ab8d4d623a68","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a5ab9704ed704e619e80ab8d4d623a68\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781051},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_a5ab9704ed704e619e80ab8d4d623a68\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a5ab9704ed704e619e80ab8d4d623a68\",\"transient_lastDdlTime\":\"1773781051\",\"kudu.table_id\":\"a4ba9bce277146cc8c2a1cfcbf90f951\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"transient_lastDdlTime\":\"1773781060\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260317 20:57:43.741443 2566 consensus_queue.cc:1048] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 249, Last known committed idx: 248, Time since last communication: 0.000s
@ 0x7fe688b52dcd google::LogMessage::Fail() at ??:0
@ 0x7fe688b56b93 google::LogMessage::SendToLog() at ??:0
I20260317 20:57:43.745607 2571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 5 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:43.745889 2571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:43.747506 2561 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:43.747684 2561 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:43.748004 2571 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:43.748178 2571 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fe688b527cc google::LogMessage::Flush() at ??:0
I20260317 20:57:43.749408 2495 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet d498b1efdbca451087928cdb42d06485
I20260317 20:57:43.750949 2495 catalog_manager.cc:6741] ReplaceTablet: tablet d498b1efdbca451087928cdb42d06485 deleted and replaced by tablet 1106c838e4bc4e0d91905b7d61e8584a
I20260317 20:57:43.751310 2495 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_a9891e641d7144228ae4fa567a20f67d" } new_table_name: "default.Table_db0d09da77234c72a4649ad59de113e0" modify_external_catalogs: true
I20260317 20:57:43.752713 2497 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet d41e07f06cdc44a7821b1dfab9135b23
I20260317 20:57:43.753070 2497 catalog_manager.cc:6741] ReplaceTablet: tablet d41e07f06cdc44a7821b1dfab9135b23 deleted and replaced by tablet 1fe62c71f1b64cecbe0019b02e4bc3e1
I20260317 20:57:43.753307 2497 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" } modify_external_catalogs: true
I20260317 20:57:43.753434 2497 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" } modify_external_catalogs: true
I20260317 20:57:43.754730 2491 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet a4a60c7b22b5475eb2c9d6b40ed1a89b
I20260317 20:57:43.754699 2496 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet db67839dc0e7439e8ffa370019a88afd
I20260317 20:57:43.755259 2491 catalog_manager.cc:6741] ReplaceTablet: tablet a4a60c7b22b5475eb2c9d6b40ed1a89b deleted and replaced by tablet beaabcef2bb4416499d418c8ffd0a718
@ 0x7fe688b52a11 google::LogMessage::~LogMessage() at ??:0
I20260317 20:57:43.755265 2496 catalog_manager.cc:6741] ReplaceTablet: tablet db67839dc0e7439e8ffa370019a88afd deleted and replaced by tablet 651eab88ddbe481c9da4d7f1015a4920
I20260317 20:57:43.757820 2491 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_e0a1ab3af8974191818e51a5608c5724" } modify_external_catalogs: true
I20260317 20:57:43.757992 2491 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59982:
table { table_name: "default.Table_e0a1ab3af8974191818e51a5608c5724" } modify_external_catalogs: true
I20260317 20:57:43.758315 2496 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59982:
name: "default.Table_234c371e883449c4ab6fc105a42b24fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:43.762491 1177 tablet_service.cc:1558] Processing DeleteTablet for tablet d498b1efdbca451087928cdb42d06485 with delete_type TABLET_DATA_DELETED (replaced by tablet 1106c838e4bc4e0d91905b7d61e8584a) from {username='slave'} at 127.0.0.1:34068
I20260317 20:57:43.762693 1176 tablet_service.cc:1558] Processing DeleteTablet for tablet db67839dc0e7439e8ffa370019a88afd with delete_type TABLET_DATA_DELETED (replaced by tablet 651eab88ddbe481c9da4d7f1015a4920) from {username='slave'} at 127.0.0.1:34068
I20260317 20:57:43.762835 1178 tablet_service.cc:1558] Processing DeleteTablet for tablet d41e07f06cdc44a7821b1dfab9135b23 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fe62c71f1b64cecbe0019b02e4bc3e1) from {username='slave'} at 127.0.0.1:34068
I20260317 20:57:43.762876 1175 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b with delete_type TABLET_DATA_DELETED (replaced by tablet beaabcef2bb4416499d418c8ffd0a718) from {username='slave'} at 127.0.0.1:34068
@ 0x7fe68dd25847 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260317 20:57:43.768155 1175 tablet_service.cc:1511] Processing CreateTablet for tablet 1106c838e4bc4e0d91905b7d61e8584a (DEFAULT_TABLE table=default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.768395 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet db67839dc0e7439e8ffa370019a88afd with delete_type TABLET_DATA_DELETED (replaced by tablet 651eab88ddbe481c9da4d7f1015a4920) from {username='slave'} at 127.0.0.1:37390
I20260317 20:57:43.768451 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b with delete_type TABLET_DATA_DELETED (replaced by tablet beaabcef2bb4416499d418c8ffd0a718) from {username='slave'} at 127.0.0.1:37390
I20260317 20:57:43.768548 1175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1106c838e4bc4e0d91905b7d61e8584a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.768922 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 1106c838e4bc4e0d91905b7d61e8584a (DEFAULT_TABLE table=default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.769228 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1106c838e4bc4e0d91905b7d61e8584a. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fe68dd2475e kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260317 20:57:43.770798 2588 tablet_replica.cc:333] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:43.770985 2588 raft_consensus.cc:2243] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:43.771126 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet d498b1efdbca451087928cdb42d06485 with delete_type TABLET_DATA_DELETED (replaced by tablet 1106c838e4bc4e0d91905b7d61e8584a) from {username='slave'} at 127.0.0.1:53676
I20260317 20:57:43.771206 1312 tablet_service.cc:1558] Processing DeleteTablet for tablet d41e07f06cdc44a7821b1dfab9135b23 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fe62c71f1b64cecbe0019b02e4bc3e1) from {username='slave'} at 127.0.0.1:53676
I20260317 20:57:43.771340 2588 raft_consensus.cc:2272] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.771451 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet d498b1efdbca451087928cdb42d06485 with delete_type TABLET_DATA_DELETED (replaced by tablet 1106c838e4bc4e0d91905b7d61e8584a) from {username='slave'} at 127.0.0.1:37390
I20260317 20:57:43.771564 1308 tablet_service.cc:1558] Processing DeleteTablet for tablet a4a60c7b22b5475eb2c9d6b40ed1a89b with delete_type TABLET_DATA_DELETED (replaced by tablet beaabcef2bb4416499d418c8ffd0a718) from {username='slave'} at 127.0.0.1:53676
I20260317 20:57:43.771608 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet d41e07f06cdc44a7821b1dfab9135b23 with delete_type TABLET_DATA_DELETED (replaced by tablet 1fe62c71f1b64cecbe0019b02e4bc3e1) from {username='slave'} at 127.0.0.1:37390
I20260317 20:57:43.771737 1309 tablet_service.cc:1558] Processing DeleteTablet for tablet db67839dc0e7439e8ffa370019a88afd with delete_type TABLET_DATA_DELETED (replaced by tablet 651eab88ddbe481c9da4d7f1015a4920) from {username='slave'} at 127.0.0.1:53676
I20260317 20:57:43.771850 2588 ts_tablet_manager.cc:1916] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.772840 1311 tablet_service.cc:1511] Processing CreateTablet for tablet 1106c838e4bc4e0d91905b7d61e8584a (DEFAULT_TABLE table=default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.773169 1311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1106c838e4bc4e0d91905b7d61e8584a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.773697 2591 tablet_replica.cc:333] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:43.773859 2591 raft_consensus.cc:2243] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:43.774129 2591 raft_consensus.cc:2272] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.774593 2591 ts_tablet_manager.cc:1916] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.775118 2588 ts_tablet_manager.cc:1929] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.775468 2593 tablet_bootstrap.cc:492] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:43.776347 2588 log.cc:1199] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/d498b1efdbca451087928cdb42d06485
I20260317 20:57:43.776690 2588 ts_tablet_manager.cc:1950] T d498b1efdbca451087928cdb42d06485 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:43.777019 2593 tablet_bootstrap.cc:654] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
@ 0x7fe68dd23ec1 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260317 20:57:43.777449 2588 tablet_replica.cc:333] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:43.777616 2588 raft_consensus.cc:2243] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:43.777618 2475 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet d498b1efdbca451087928cdb42d06485 (table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]) successfully deleted
I20260317 20:57:43.777747 2588 raft_consensus.cc:2272] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.778221 2588 ts_tablet_manager.cc:1916] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.778412 2592 tablet_bootstrap.cc:492] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:43.780691 2592 tablet_bootstrap.cc:654] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.780957 2588 ts_tablet_manager.cc:1929] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.781033 2588 log.cc:1199] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/db67839dc0e7439e8ffa370019a88afd
I20260317 20:57:43.781294 2588 ts_tablet_manager.cc:1950] T db67839dc0e7439e8ffa370019a88afd P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:43.781759 2591 ts_tablet_manager.cc:1929] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.781838 2591 log.cc:1199] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/d498b1efdbca451087928cdb42d06485
I20260317 20:57:43.782061 2588 tablet_replica.cc:333] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:43.782002 1309 tablet_service.cc:1511] Processing CreateTablet for tablet beaabcef2bb4416499d418c8ffd0a718 (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.782212 2588 raft_consensus.cc:2243] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:43.782305 1309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beaabcef2bb4416499d418c8ffd0a718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.782378 1041 tablet_service.cc:1511] Processing CreateTablet for tablet beaabcef2bb4416499d418c8ffd0a718 (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.782444 2588 raft_consensus.cc:2272] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.782483 1311 tablet_service.cc:1511] Processing CreateTablet for tablet 651eab88ddbe481c9da4d7f1015a4920 (DEFAULT_TABLE table=default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.782642 1041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beaabcef2bb4416499d418c8ffd0a718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.782730 1311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651eab88ddbe481c9da4d7f1015a4920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.782907 2588 ts_tablet_manager.cc:1916] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.784817 1308 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe62c71f1b64cecbe0019b02e4bc3e1 (DEFAULT_TABLE table=default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.784806 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe62c71f1b64cecbe0019b02e4bc3e1 (DEFAULT_TABLE table=default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.785082 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe62c71f1b64cecbe0019b02e4bc3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.785082 1308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe62c71f1b64cecbe0019b02e4bc3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.785195 1037 tablet_service.cc:1511] Processing CreateTablet for tablet 651eab88ddbe481c9da4d7f1015a4920 (DEFAULT_TABLE table=default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.785459 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651eab88ddbe481c9da4d7f1015a4920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.785621 2588 ts_tablet_manager.cc:1929] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.785701 2588 log.cc:1199] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/d41e07f06cdc44a7821b1dfab9135b23
I20260317 20:57:43.785998 2588 ts_tablet_manager.cc:1950] T d41e07f06cdc44a7821b1dfab9135b23 P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:43.786602 2475 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet db67839dc0e7439e8ffa370019a88afd (table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]) successfully deleted
I20260317 20:57:43.786737 2588 tablet_replica.cc:333] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: stopping tablet replica
I20260317 20:57:43.786880 2588 raft_consensus.cc:2243] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:43.787007 2588 raft_consensus.cc:2272] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.787425 2588 ts_tablet_manager.cc:1916] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.788308 2589 tablet_replica.cc:333] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:43.788324 1175 tablet_service.cc:1511] Processing CreateTablet for tablet 651eab88ddbe481c9da4d7f1015a4920 (DEFAULT_TABLE table=default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.788461 2589 raft_consensus.cc:2243] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:43.788671 1175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651eab88ddbe481c9da4d7f1015a4920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.788705 2589 raft_consensus.cc:2272] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.788980 1178 tablet_service.cc:1511] Processing CreateTablet for tablet beaabcef2bb4416499d418c8ffd0a718 (DEFAULT_TABLE table=default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.789135 2589 ts_tablet_manager.cc:1916] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.789206 1178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet beaabcef2bb4416499d418c8ffd0a718. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.790201 2594 tablet_bootstrap.cc:492] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:43.791105 1176 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe62c71f1b64cecbe0019b02e4bc3e1 (DEFAULT_TABLE table=default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:43.791338 1176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe62c71f1b64cecbe0019b02e4bc3e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:43.791394 2594 tablet_bootstrap.cc:654] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.792686 2588 ts_tablet_manager.cc:1929] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.792768 2588 log.cc:1199] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-1/wal/wals/a4a60c7b22b5475eb2c9d6b40ed1a89b
I20260317 20:57:43.793345 2588 ts_tablet_manager.cc:1950] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 35518b51259b46d1b9b5e82b6841057b: Deleting consensus metadata
I20260317 20:57:43.793931 2593 tablet_bootstrap.cc:492] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:43.793982 2475 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet d41e07f06cdc44a7821b1dfab9135b23 (table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]) successfully deleted
I20260317 20:57:43.794256 2593 ts_tablet_manager.cc:1403] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.000s
I20260317 20:57:43.794494 2475 catalog_manager.cc:5002] TS 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): tablet a4a60c7b22b5475eb2c9d6b40ed1a89b (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]) successfully deleted
I20260317 20:57:43.794765 2593 raft_consensus.cc:359] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:43.794874 2593 raft_consensus.cc:385] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
@ 0x7fe68dd295c8 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260317 20:57:43.794911 2593 raft_consensus.cc:740] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.795073 2593 consensus_queue.cc:260] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:43.795557 2593 ts_tablet_manager.cc:1434] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
@ 0x5600bf73518a std::function<>::operator()() at ??:0
I20260317 20:57:43.796504 2589 ts_tablet_manager.cc:1929] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.796586 2589 log.cc:1199] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/db67839dc0e7439e8ffa370019a88afd
I20260317 20:57:43.796856 2589 ts_tablet_manager.cc:1950] T db67839dc0e7439e8ffa370019a88afd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:43.797492 2589 tablet_replica.cc:333] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:43.797621 2589 raft_consensus.cc:2243] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:43.797724 2589 raft_consensus.cc:2272] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.797981 2591 ts_tablet_manager.cc:1950] T d498b1efdbca451087928cdb42d06485 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:43.798246 2593 tablet_bootstrap.cc:492] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
W20260317 20:57:43.798228 1269 consensus_peers.cc:597] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260317 20:57:43.798506 2476 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet db67839dc0e7439e8ffa370019a88afd (table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]) successfully deleted
I20260317 20:57:43.799408 2593 tablet_bootstrap.cc:654] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
@ 0x7fe68a052214 kudu::Thread::SuperviseThread() at ??:0
I20260317 20:57:43.800637 2594 tablet_bootstrap.cc:492] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:43.800731 2594 ts_tablet_manager.cc:1403] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20260317 20:57:43.801483 2594 raft_consensus.cc:359] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:43.801614 2594 raft_consensus.cc:385] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.801658 2594 raft_consensus.cc:740] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.801818 2594 consensus_queue.cc:260] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
@ 0x7fe68a83a6db start_thread at ??:0
I20260317 20:57:43.802177 2594 ts_tablet_manager.cc:1434] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260317 20:57:43.802553 2589 ts_tablet_manager.cc:1916] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.803534 2594 tablet_bootstrap.cc:492] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:43.804663 2594 tablet_bootstrap.cc:654] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
@ 0x7fe687d0961f clone at ??:0
I20260317 20:57:43.806218 2592 tablet_bootstrap.cc:492] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:43.806311 2592 ts_tablet_manager.cc:1403] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.000s
I20260317 20:57:43.806910 2592 raft_consensus.cc:359] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:43.807039 2592 raft_consensus.cc:385] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.807076 2592 raft_consensus.cc:740] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.807221 2592 consensus_queue.cc:260] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:43.807601 2592 ts_tablet_manager.cc:1434] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:43.807685 2589 ts_tablet_manager.cc:1929] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.807839 1109 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:43.807881 2592 tablet_bootstrap.cc:492] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:43.809213 2591 tablet_replica.cc:333] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:43.809350 2591 raft_consensus.cc:2243] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:43.809465 2591 raft_consensus.cc:2272] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.809815 2589 log.cc:1199] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/a4a60c7b22b5475eb2c9d6b40ed1a89b
I20260317 20:57:43.810185 2589 ts_tablet_manager.cc:1950] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:43.810817 2589 tablet_replica.cc:333] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:43.810987 2589 raft_consensus.cc:2243] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:43.811093 2589 raft_consensus.cc:2272] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.811280 2592 tablet_bootstrap.cc:654] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.811483 2589 ts_tablet_manager.cc:1916] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.811586 2591 ts_tablet_manager.cc:1916] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.813308 2594 tablet_bootstrap.cc:492] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:43.813405 2594 ts_tablet_manager.cc:1403] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260317 20:57:43.813401 2592 tablet_bootstrap.cc:492] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:43.813482 2592 ts_tablet_manager.cc:1403] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:43.813947 2594 raft_consensus.cc:359] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.814116 2594 raft_consensus.cc:385] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.814157 2594 raft_consensus.cc:740] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.813966 2592 raft_consensus.cc:359] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.814278 2594 consensus_queue.cc:260] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.814319 2592 raft_consensus.cc:385] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.814360 2592 raft_consensus.cc:740] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.814496 2592 consensus_queue.cc:260] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.814599 2594 ts_tablet_manager.cc:1434] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:43.814850 2592 ts_tablet_manager.cc:1434] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:43.815003 2594 tablet_bootstrap.cc:492] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:43.815085 2592 tablet_bootstrap.cc:492] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:43.815810 2591 ts_tablet_manager.cc:1929] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.815872 2591 log.cc:1199] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/d41e07f06cdc44a7821b1dfab9135b23
I20260317 20:57:43.816061 2594 tablet_bootstrap.cc:654] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.816126 2592 tablet_bootstrap.cc:654] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.816159 2591 ts_tablet_manager.cc:1950] T d41e07f06cdc44a7821b1dfab9135b23 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:43.816740 2591 tablet_replica.cc:333] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:43.816865 2591 raft_consensus.cc:2243] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:43.817066 2591 raft_consensus.cc:2272] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.817426 2591 ts_tablet_manager.cc:1916] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.817665 2589 ts_tablet_manager.cc:1929] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.817734 2589 log.cc:1199] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/d498b1efdbca451087928cdb42d06485
I20260317 20:57:43.817999 2589 ts_tablet_manager.cc:1950] T d498b1efdbca451087928cdb42d06485 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:43.818450 2594 tablet_bootstrap.cc:492] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:43.818528 2594 ts_tablet_manager.cc:1403] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:43.819190 2594 raft_consensus.cc:359] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.819295 2594 raft_consensus.cc:385] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.819325 2594 raft_consensus.cc:740] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.819432 2594 consensus_queue.cc:260] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.819895 2594 ts_tablet_manager.cc:1434] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:43.820086 2594 tablet_bootstrap.cc:492] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:43.820900 2592 tablet_bootstrap.cc:492] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:43.820986 2592 ts_tablet_manager.cc:1403] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:43.821291 2593 tablet_bootstrap.cc:492] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:43.821403 2593 ts_tablet_manager.cc:1403] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20260317 20:57:43.821463 2592 raft_consensus.cc:359] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.821573 2592 raft_consensus.cc:385] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.821615 2592 raft_consensus.cc:740] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.821776 2592 consensus_queue.cc:260] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.821822 2591 ts_tablet_manager.cc:1929] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.821882 2591 log.cc:1199] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/a4a60c7b22b5475eb2c9d6b40ed1a89b
I20260317 20:57:43.821941 2593 raft_consensus.cc:359] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.822124 2593 raft_consensus.cc:385] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.822160 2593 raft_consensus.cc:740] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.822206 2591 ts_tablet_manager.cc:1950] T a4a60c7b22b5475eb2c9d6b40ed1a89b P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:43.822220 2592 ts_tablet_manager.cc:1434] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:43.822296 2593 consensus_queue.cc:260] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.822592 2593 ts_tablet_manager.cc:1434] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:43.822777 2591 tablet_replica.cc:333] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:43.822815 2593 tablet_bootstrap.cc:492] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:43.822902 2591 raft_consensus.cc:2243] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:43.823016 2591 raft_consensus.cc:2272] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.823395 2591 ts_tablet_manager.cc:1916] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.824929 2593 tablet_bootstrap.cc:654] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.825927 2594 tablet_bootstrap.cc:654] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.826171 2592 tablet_bootstrap.cc:492] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:43.826844 2591 ts_tablet_manager.cc:1929] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.826916 2591 log.cc:1199] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/db67839dc0e7439e8ffa370019a88afd
I20260317 20:57:43.827203 2591 ts_tablet_manager.cc:1950] T db67839dc0e7439e8ffa370019a88afd P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:43.828419 2593 tablet_bootstrap.cc:492] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:43.828512 2593 ts_tablet_manager.cc:1403] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260317 20:57:43.828768 2592 tablet_bootstrap.cc:654] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.829059 2593 raft_consensus.cc:359] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.829222 2593 raft_consensus.cc:385] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.829259 2593 raft_consensus.cc:740] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.829391 2593 consensus_queue.cc:260] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.829769 2593 ts_tablet_manager.cc:1434] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:43.830567 2593 tablet_bootstrap.cc:492] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:43.830614 2589 tablet_replica.cc:333] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:43.830746 2589 raft_consensus.cc:2243] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:43.830868 2589 raft_consensus.cc:2272] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:43.831248 2589 ts_tablet_manager.cc:1916] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:43.831700 2593 tablet_bootstrap.cc:654] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:43.832738 2592 tablet_bootstrap.cc:492] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:43.832827 2592 ts_tablet_manager.cc:1403] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20260317 20:57:43.833369 2592 raft_consensus.cc:359] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.833478 2592 raft_consensus.cc:385] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.833513 2592 raft_consensus.cc:740] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.833559 2593 tablet_bootstrap.cc:492] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b: No bootstrap required, opened a new log
I20260317 20:57:43.833640 2593 ts_tablet_manager.cc:1403] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:43.833684 2592 consensus_queue.cc:260] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.834167 2593 raft_consensus.cc:359] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.834266 2593 raft_consensus.cc:385] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.834295 2593 raft_consensus.cc:740] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.834403 2593 consensus_queue.cc:260] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.834686 2593 ts_tablet_manager.cc:1434] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:43.834826 2592 ts_tablet_manager.cc:1434] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260317 20:57:43.835984 2594 tablet_bootstrap.cc:492] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:43.836073 2594 ts_tablet_manager.cc:1403] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260317 20:57:43.836684 2594 raft_consensus.cc:359] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.836797 2594 raft_consensus.cc:385] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:43.836830 2594 raft_consensus.cc:740] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:43.836946 2594 consensus_queue.cc:260] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.840978 2589 ts_tablet_manager.cc:1929] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:43.841079 2589 log.cc:1199] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/d41e07f06cdc44a7821b1dfab9135b23
I20260317 20:57:43.841341 2589 ts_tablet_manager.cc:1950] T d41e07f06cdc44a7821b1dfab9135b23 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:43.841516 2594 ts_tablet_manager.cc:1434] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260317 20:57:43.872758 1715 raft_consensus.cc:493] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:43.872934 1715 raft_consensus.cc:515] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.873399 1715 leader_election.cc:290] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:43.873750 2423 raft_consensus.cc:493] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:43.873921 2423 raft_consensus.cc:515] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.874125 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651eab88ddbe481c9da4d7f1015a4920" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:43.874220 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651eab88ddbe481c9da4d7f1015a4920" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:43.874270 1332 raft_consensus.cc:2468] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:43.874330 1061 raft_consensus.cc:2468] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 0.
I20260317 20:57:43.874409 2423 leader_election.cc:290] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:43.874694 1133 leader_election.cc:304] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:43.874933 1715 raft_consensus.cc:2804] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:43.874997 1715 raft_consensus.cc:493] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:43.875043 1715 raft_consensus.cc:3060] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.875054 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe62c71f1b64cecbe0019b02e4bc3e1" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:43.875167 1332 raft_consensus.cc:2468] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:43.875484 996 leader_election.cc:304] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:43.875651 2423 raft_consensus.cc:2804] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:43.875608 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe62c71f1b64cecbe0019b02e4bc3e1" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:43.875695 2423 raft_consensus.cc:493] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:43.875733 2423 raft_consensus.cc:3060] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.875738 1196 raft_consensus.cc:2468] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:43.876295 1715 raft_consensus.cc:515] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.876669 1715 leader_election.cc:290] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:43.876852 2423 raft_consensus.cc:515] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.877166 1061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651eab88ddbe481c9da4d7f1015a4920" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:43.877195 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651eab88ddbe481c9da4d7f1015a4920" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:43.877267 2423 leader_election.cc:290] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:43.877296 1332 raft_consensus.cc:3060] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.877275 1061 raft_consensus.cc:3060] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.877748 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe62c71f1b64cecbe0019b02e4bc3e1" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:43.877815 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe62c71f1b64cecbe0019b02e4bc3e1" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:43.877878 1333 raft_consensus.cc:3060] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.877914 1196 raft_consensus.cc:3060] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.878536 1332 raft_consensus.cc:2468] T 651eab88ddbe481c9da4d7f1015a4920 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:43.878716 1061 raft_consensus.cc:2468] T 651eab88ddbe481c9da4d7f1015a4920 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
I20260317 20:57:43.878852 1333 raft_consensus.cc:2468] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:43.878952 1133 leader_election.cc:304] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters:
I20260317 20:57:43.879268 1715 raft_consensus.cc:2804] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:43.879252 996 leader_election.cc:304] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:43.878961 1196 raft_consensus.cc:2468] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:43.879490 1715 raft_consensus.cc:697] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [term 1 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:57:43.879526 2423 raft_consensus.cc:2804] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:43.879590 2423 raft_consensus.cc:697] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:43.879657 1715 consensus_queue.cc:237] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.879698 2423 consensus_queue.cc:237] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.901469 2616 raft_consensus.cc:493] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:43.901656 2616 raft_consensus.cc:515] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:43.902211 2616 leader_election.cc:290] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:43.902702 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1106c838e4bc4e0d91905b7d61e8584a" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:43.902726 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1106c838e4bc4e0d91905b7d61e8584a" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:43.902834 1196 raft_consensus.cc:2468] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:43.902902 1333 raft_consensus.cc:2468] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:43.903203 995 leader_election.cc:304] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:43.903445 2616 raft_consensus.cc:2804] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:43.903491 2616 raft_consensus.cc:493] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:43.903519 2616 raft_consensus.cc:3060] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.904433 2616 raft_consensus.cc:515] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:43.904850 2616 leader_election.cc:290] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:43.905223 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1106c838e4bc4e0d91905b7d61e8584a" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:43.905210 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1106c838e4bc4e0d91905b7d61e8584a" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:43.905367 1333 raft_consensus.cc:3060] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.905368 1196 raft_consensus.cc:3060] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.906271 1196 raft_consensus.cc:2468] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:43.906500 1333 raft_consensus.cc:2468] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:43.906628 995 leader_election.cc:304] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:43.906849 2616 raft_consensus.cc:2804] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:43.906970 2616 raft_consensus.cc:697] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:43.907121 2616 consensus_queue.cc:237] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:57:43.962599 2616 raft_consensus.cc:493] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:43.962734 2616 raft_consensus.cc:515] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.963223 2616 leader_election.cc:290] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:43.963649 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaabcef2bb4416499d418c8ffd0a718" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:57:43.963688 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaabcef2bb4416499d418c8ffd0a718" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:43.963817 1196 raft_consensus.cc:2468] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:43.963852 1333 raft_consensus.cc:2468] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:43.964169 995 leader_election.cc:304] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:43.964432 2616 raft_consensus.cc:2804] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:43.964496 2616 raft_consensus.cc:493] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:43.964550 2616 raft_consensus.cc:3060] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.965411 2616 raft_consensus.cc:515] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:43.965823 2616 leader_election.cc:290] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:43.966245 1196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaabcef2bb4416499d418c8ffd0a718" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:57:43.966244 1333 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "beaabcef2bb4416499d418c8ffd0a718" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:43.966388 1333 raft_consensus.cc:3060] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.966390 1196 raft_consensus.cc:3060] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:43.967204 1196 raft_consensus.cc:2468] T beaabcef2bb4416499d418c8ffd0a718 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:43.967475 1333 raft_consensus.cc:2468] T beaabcef2bb4416499d418c8ffd0a718 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:43.967562 995 leader_election.cc:304] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters:
I20260317 20:57:43.967734 2616 raft_consensus.cc:2804] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:43.967958 2616 raft_consensus.cc:697] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:43.968102 2616 consensus_queue.cc:237] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
W20260317 20:57:44.006564 996 connection.cc:537] server connection from 127.0.0.1:37390 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:44.006564 1268 connection.cc:537] server connection from 127.0.0.1:53676 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:44.006839 996 connection.cc:537] client connection to 127.0.102.253:38969 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:44.007115 1389 connection.cc:537] client connection to 127.0.102.253:38969 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:44.007520 1389 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.102.253:38969)
W20260317 20:57:44.007784 1389 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:44.007875 1389 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:44.008328 1389 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:44.009135 2560 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:44.007384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.102.195:39517)
0317 20:57:44.007590 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:44.007608 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0317 20:57:44.007704 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0317 20:57:44.009010 (+ 1306us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":114}
W20260317 20:57:44.009512 2557 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:44.007978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.102.194:51781)
0317 20:57:44.008335 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:44.008353 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0317 20:57:44.008438 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0317 20:57:44.009429 (+ 991us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":269}
W20260317 20:57:44.009883 2556 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:44.008728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.102.193:33917)
0317 20:57:44.008945 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:44.008958 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0317 20:57:44.009045 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0317 20:57:44.009796 (+ 751us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":122}
I20260317 20:57:44.279698 2624 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:44.279876 2624 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:44.280346 2624 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:44.281019 857 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260317 20:57:44.281749 858 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:44.281888 857 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:44.281965 857 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:44.282140 2624 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260317 20:57:44.310710 2616 consensus_queue.cc:1048] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:44.315061 2423 consensus_queue.cc:1048] T 1fe62c71f1b64cecbe0019b02e4bc3e1 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:44.336927 2423 consensus_queue.cc:1048] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:44.342146 2423 consensus_queue.cc:1048] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:44.350287 2617 consensus_queue.cc:1048] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:44.355365 1715 consensus_queue.cc:1048] T 651eab88ddbe481c9da4d7f1015a4920 P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:44.409283 2616 consensus_queue.cc:1048] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:44.412593 2616 consensus_queue.cc:1048] T beaabcef2bb4416499d418c8ffd0a718 P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:44.818957 2643 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:44.819092 2643 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:44.819730 2643 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:44.820776 858 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:44.820920 857 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:44.821024 857 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:44.821192 2643 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260317 20:57:45.591100 411 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu with pid 837
I20260317 20:57:46.559569 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.252:34639
--webserver_interface=127.0.102.252
--webserver_port=38583
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260317 20:57:46.678769 2670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:46.679106 2670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:46.679212 2670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:46.683033 2670 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:46.683175 2670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:46.683212 2670 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:46.683256 2670 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:46.687750 2670 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.252:34639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.102.252
--webserver_port=38583
--never_fsync=true
--heap_profile_path=/tmp/kudu.2670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:46.689162 2670 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:46.690521 2670 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:46.696373 2676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:46.696460 2675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:46.696549 2678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:46.697057 2670 server_base.cc:1060] running on GCE node
I20260317 20:57:46.697546 2670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:46.698549 2670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:46.699702 2670 hybrid_clock.cc:648] HybridClock initialized: now 1773781066699689 us; error 33 us; skew 500 ppm
I20260317 20:57:46.701728 2670 webserver.cc:492] Webserver started at http://127.0.102.252:38583/ using document root <none> and password file <none>
I20260317 20:57:46.702451 2670 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:46.702531 2670 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:46.706238 2670 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260317 20:57:46.708505 2684 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:46.709753 2670 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:46.709870 2670 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:46.710345 2670 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:46.746512 2670 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:46.747291 2670 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:46.747460 2670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:46.755728 2670 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.252:34639
I20260317 20:57:46.755733 2736 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.252:34639 every 8 connection(s)
I20260317 20:57:46.756950 2670 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
I20260317 20:57:46.761225 2737 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:46.762965 2737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap starting.
I20260317 20:57:46.766477 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 2670
I20260317 20:57:46.784268 2737 log.cc:826] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:46.871598 1244 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:46.910161 2737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=257 overwritten=2 applied=255 ignored=0} inserts{seen=167 ignored=0} mutations{seen=226 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:46.910759 2737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap complete.
I20260317 20:57:46.912912 1107 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:46.914323 2737 raft_consensus.cc:359] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:46.914987 2737 raft_consensus.cc:740] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a5313a52eb40a3ab5d14d0d8be52f7, State: Initialized, Role: FOLLOWER
I20260317 20:57:46.915558 2737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 255, Last appended: 5.255, Last appended by leader: 255, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:46.916427 2747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:46.916564 2747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:46.916967 2737 sys_catalog.cc:565] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:46.922524 2670 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111),
I20260317 20:57:46.924722 2670 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:46.926390 2761 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:46.926465 2761 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: loading cluster ID for follower catalog manager: success
I20260317 20:57:46.930688 2761 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: acquiring CA information for follower catalog manager: success
I20260317 20:57:46.934424 2761 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:57:46.939633 1380 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:46.941625 2701 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:48707; Asking this server to re-register.
I20260317 20:57:46.942255 1380 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:46.944108 2701 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:47.376245 2701 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:53899; Asking this server to re-register.
I20260317 20:57:47.376933 1244 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:47.378494 2701 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:47.416895 2701 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:42009; Asking this server to re-register.
I20260317 20:57:47.417613 1107 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:47.418962 2701 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:47.461681 2769 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:47.461967 2769 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:47.463420 2769 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:47.464062 2688 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:47.464926 2687 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:47.465061 2688 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:47.465189 2688 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:47.465452 2769 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260317 20:57:48.129048 2780 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:48.129184 2780 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:48.129758 2780 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:48.131407 2688 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:48.131577 2687 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:48.131641 2687 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:48.131824 2780 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260317 20:57:48.756371 2791 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:48.756510 2791 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:48.756973 2791 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:48.758502 2688 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:48.758634 2687 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:48.758715 2687 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:48.758882 2791 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260317 20:57:50.024240 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.253:38969
--webserver_interface=127.0.102.253
--webserver_port=45191
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260317 20:57:50.137480 2817 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:50.137820 2817 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:50.137943 2817 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:50.141598 2817 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:50.141738 2817 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:50.141777 2817 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:50.141826 2817 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:50.146247 2817 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.253:38969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.0.102.253
--webserver_port=45191
--never_fsync=true
--heap_profile_path=/tmp/kudu.2817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:50.147501 2817 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:50.148730 2817 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:50.154397 2825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:50.154400 2823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:50.154407 2822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:50.154793 2817 server_base.cc:1060] running on GCE node
I20260317 20:57:50.155354 2817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:50.156309 2817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:50.157500 2817 hybrid_clock.cc:648] HybridClock initialized: now 1773781070157490 us; error 33 us; skew 500 ppm
I20260317 20:57:50.159669 2817 webserver.cc:492] Webserver started at http://127.0.102.253:45191/ using document root <none> and password file <none>
I20260317 20:57:50.160390 2817 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:50.160487 2817 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:50.165241 2817 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260317 20:57:50.167629 2831 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:50.168975 2817 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260317 20:57:50.169100 2817 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
uuid: "db5e708fd6404c0daa842bfc7e8f4806"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:50.169503 2817 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:50.197853 2817 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:50.198637 2817 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:50.198845 2817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:50.202229 2839 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:50.202455 2839 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:50.204203 2839 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:50.204447 2688 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:50.204805 2687 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:50.204885 2687 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:50.205052 2839 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260317 20:57:50.207012 2886 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.253:38969 every 8 connection(s)
I20260317 20:57:50.207012 2817 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.253:38969
I20260317 20:57:50.208266 2817 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-1/data/info.pb
I20260317 20:57:50.210851 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 2817
I20260317 20:57:50.212900 2887 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:50.215204 2887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap starting.
I20260317 20:57:50.237157 2887 log.cc:826] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:50.363557 2887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap replayed 1/1 log segments. Stats: ops{read=255 overwritten=0 applied=255 ignored=0} inserts{seen=167 ignored=0} mutations{seen=226 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:50.364035 2887 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Bootstrap complete.
I20260317 20:57:50.366863 2887 raft_consensus.cc:359] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:50.367274 2887 raft_consensus.cc:740] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: db5e708fd6404c0daa842bfc7e8f4806, State: Initialized, Role: FOLLOWER
I20260317 20:57:50.367796 2887 consensus_queue.cc:260] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 255, Last appended: 5.255, Last appended by leader: 255, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:50.368360 2891 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:50.368490 2891 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:50.369046 2887 sys_catalog.cc:565] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:50.375371 2817 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111),
I20260317 20:57:50.377486 2817 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:50.378753 2905 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:50.378871 2905 catalog_manager.cc:1562] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: loading cluster ID for follower catalog manager: success
I20260317 20:57:50.380775 1246 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:50.383706 2905 catalog_manager.cc:1584] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: acquiring CA information for follower catalog manager: success
I20260317 20:57:50.384266 2849 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:45595; Asking this server to re-register.
I20260317 20:57:50.385165 1246 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:50.386914 2849 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:50.387117 2905 catalog_manager.cc:1612] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:57:50.422143 1109 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:50.422317 1109 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:50.424767 2849 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:54459; Asking this server to re-register.
I20260317 20:57:50.425354 1109 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:50.426813 2849 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:50.432180 1382 heartbeater.cc:344] Connected to a master server at 127.0.102.253:38969
I20260317 20:57:50.433705 2849 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:60927; Asking this server to re-register.
I20260317 20:57:50.434222 1382 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:50.435514 2849 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:50.874794 2916 raft_consensus.cc:493] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:50.875032 2916 raft_consensus.cc:515] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:50.876418 2916 leader_election.cc:290] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:57:50.877146 2835 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:50.878115 2835 leader_election.cc:336] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:50.880709 2711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 6 candidate_status { last_received { term: 5 index: 255 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" is_pre_election: true
I20260317 20:57:50.881023 2711 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 5.
I20260317 20:57:50.881557 2833 leader_election.cc:304] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3
I20260317 20:57:50.881861 2916 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260317 20:57:50.881963 2916 raft_consensus.cc:493] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:50.882014 2916 raft_consensus.cc:3060] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 5 FOLLOWER]: Advancing to term 6
I20260317 20:57:50.884152 2916 raft_consensus.cc:515] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:50.884555 2916 leader_election.cc:290] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 6 election: Requested vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
I20260317 20:57:50.885054 2711 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "db5e708fd6404c0daa842bfc7e8f4806" candidate_term: 6 candidate_status { last_received { term: 5 index: 255 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
I20260317 20:57:50.885210 2711 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 5 FOLLOWER]: Advancing to term 6
W20260317 20:57:50.885721 2835 leader_election.cc:336] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:50.887192 2711 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate db5e708fd6404c0daa842bfc7e8f4806 in term 6.
I20260317 20:57:50.887609 2833 leader_election.cc:304] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3
I20260317 20:57:50.887873 2916 raft_consensus.cc:2804] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 6 FOLLOWER]: Leader election won for term 6
I20260317 20:57:50.888123 2916 raft_consensus.cc:697] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [term 6 LEADER]: Becoming Leader. State: Replica: db5e708fd6404c0daa842bfc7e8f4806, State: Running, Role: LEADER
I20260317 20:57:50.888453 2916 consensus_queue.cc:237] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 255, Committed index: 255, Last appended: 5.255, Last appended by leader: 255, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:50.890470 2921 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 6 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:50.890630 2921 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:50.890977 2923 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260317 20:57:50.893963 2923 catalog_manager.cc:679] Loaded metadata for table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]
I20260317 20:57:50.894444 2923 catalog_manager.cc:679] Loaded metadata for table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]
I20260317 20:57:50.894721 2923 catalog_manager.cc:679] Loaded metadata for table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]
I20260317 20:57:50.894969 2923 catalog_manager.cc:679] Loaded metadata for table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299]
I20260317 20:57:50.895215 2923 catalog_manager.cc:679] Loaded metadata for table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]
I20260317 20:57:50.895831 2923 catalog_manager.cc:679] Loaded metadata for table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]
I20260317 20:57:50.896126 2923 catalog_manager.cc:679] Loaded metadata for table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]
I20260317 20:57:50.896443 2923 catalog_manager.cc:679] Loaded metadata for table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]
I20260317 20:57:50.896601 2923 catalog_manager.cc:679] Loaded metadata for table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]
I20260317 20:57:50.896770 2923 catalog_manager.cc:679] Loaded metadata for table default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b]
I20260317 20:57:50.896939 2923 catalog_manager.cc:679] Loaded metadata for table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]
I20260317 20:57:50.897413 2923 catalog_manager.cc:679] Loaded metadata for table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]
I20260317 20:57:50.897665 2923 catalog_manager.cc:679] Loaded metadata for table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]
I20260317 20:57:50.897820 2923 catalog_manager.cc:679] Loaded metadata for table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]
I20260317 20:57:50.897989 2923 catalog_manager.cc:679] Loaded metadata for table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]
I20260317 20:57:50.898339 2923 catalog_manager.cc:679] Loaded metadata for table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]
I20260317 20:57:50.898541 2923 catalog_manager.cc:679] Loaded metadata for table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]
I20260317 20:57:50.898869 2923 catalog_manager.cc:679] Loaded metadata for table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]
I20260317 20:57:50.899027 2923 catalog_manager.cc:679] Loaded metadata for table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]
I20260317 20:57:50.899181 2923 catalog_manager.cc:679] Loaded metadata for table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951]
I20260317 20:57:50.899412 2923 catalog_manager.cc:679] Loaded metadata for table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]
I20260317 20:57:50.899576 2923 catalog_manager.cc:679] Loaded metadata for table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd]
I20260317 20:57:50.899741 2923 catalog_manager.cc:679] Loaded metadata for table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]
I20260317 20:57:50.899905 2923 catalog_manager.cc:679] Loaded metadata for table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]
I20260317 20:57:50.900137 2923 catalog_manager.cc:679] Loaded metadata for table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]
I20260317 20:57:50.900290 2923 catalog_manager.cc:679] Loaded metadata for table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]
I20260317 20:57:50.900537 2923 catalog_manager.cc:679] Loaded metadata for table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]
I20260317 20:57:50.900794 2923 catalog_manager.cc:679] Loaded metadata for table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]
I20260317 20:57:50.901166 2923 catalog_manager.cc:679] Loaded metadata for table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]
I20260317 20:57:50.903702 2923 tablet_loader.cc:96] loaded metadata for tablet 0d7946629e25418c9c23d09363e305b8 (table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4])
I20260317 20:57:50.904224 2923 tablet_loader.cc:96] loaded metadata for tablet 1106c838e4bc4e0d91905b7d61e8584a (table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498])
I20260317 20:57:50.904464 2923 tablet_loader.cc:96] loaded metadata for tablet 1947a091d5c8450abb0b7ed7acc05136 (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e])
I20260317 20:57:50.904769 2923 tablet_loader.cc:96] loaded metadata for tablet 1bc0397641de4016baca65a655b38c30 (table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41])
I20260317 20:57:50.904958 2923 tablet_loader.cc:96] loaded metadata for tablet 1e084fc67777419fb5af7936ab89e8bf (table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502])
I20260317 20:57:50.905143 2923 tablet_loader.cc:96] loaded metadata for tablet 1fe62c71f1b64cecbe0019b02e4bc3e1 (table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c])
I20260317 20:57:50.905321 2923 tablet_loader.cc:96] loaded metadata for tablet 2919b2a953ef4d74955ca04b622b6c33 (table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd])
I20260317 20:57:50.905586 2923 tablet_loader.cc:96] loaded metadata for tablet 3958625929884f3397edf4c3aee3260e (table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d])
I20260317 20:57:50.905853 2923 tablet_loader.cc:96] loaded metadata for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7])
I20260317 20:57:50.906260 2923 tablet_loader.cc:96] loaded metadata for tablet 492e0f23d6b74854bc68f51c8136d495 (table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543])
I20260317 20:57:50.906456 2923 tablet_loader.cc:96] loaded metadata for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93])
I20260317 20:57:50.906808 2923 tablet_loader.cc:96] loaded metadata for tablet 56fc6787771c43bba68a082d1010d0d9 (table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad])
I20260317 20:57:50.907230 2923 tablet_loader.cc:96] loaded metadata for tablet 651eab88ddbe481c9da4d7f1015a4920 (table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4])
I20260317 20:57:50.907572 2923 tablet_loader.cc:96] loaded metadata for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d])
I20260317 20:57:50.908083 2923 tablet_loader.cc:96] loaded metadata for tablet 7d60f1c4eba344a3bbf72ab296b68843 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06])
I20260317 20:57:50.908353 2923 tablet_loader.cc:96] loaded metadata for tablet a78fdc83a3d54554a08f01915f102f6e (table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5])
I20260317 20:57:50.908612 2923 tablet_loader.cc:96] loaded metadata for tablet aa23ce23d4b0465baf378859e9ad018c (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69])
I20260317 20:57:50.909047 2923 tablet_loader.cc:96] loaded metadata for tablet b5739d6cb9a84de78767b471608f1671 (table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2])
I20260317 20:57:50.909309 2923 tablet_loader.cc:96] loaded metadata for tablet beaabcef2bb4416499d418c8ffd0a718 (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62])
I20260317 20:57:50.909648 2923 tablet_loader.cc:96] loaded metadata for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3])
I20260317 20:57:50.910136 2923 tablet_loader.cc:96] loaded metadata for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951])
I20260317 20:57:50.910332 2923 tablet_loader.cc:96] loaded metadata for tablet d9a43741bfda4ccdb070e74b9f638766 (table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438])
I20260317 20:57:50.910598 2923 tablet_loader.cc:96] loaded metadata for tablet dcc244fe79aa45e18427da2be335636a (table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427])
I20260317 20:57:50.910861 2923 tablet_loader.cc:96] loaded metadata for tablet dffa580b372540689e21e4f2a9de8661 (table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182])
I20260317 20:57:50.911041 2923 tablet_loader.cc:96] loaded metadata for tablet e4124783269f438c803d4fb68f223d20 (table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299])
I20260317 20:57:50.911696 2923 tablet_loader.cc:96] loaded metadata for tablet f435bb41bb6e411cb6bfb471312b6085 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113])
I20260317 20:57:50.912051 2923 tablet_loader.cc:96] loaded metadata for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd])
I20260317 20:57:50.912313 2923 tablet_loader.cc:96] loaded metadata for tablet fd5cc18aee45453aa02797da17b5554f (table default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b])
I20260317 20:57:50.912488 2923 tablet_loader.cc:96] loaded metadata for tablet fef79942fe3440baa17a42f660b80be6 (table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1])
I20260317 20:57:50.912678 2923 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260317 20:57:50.913914 2923 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:50.913965 2923 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260317 20:57:50.915472 2923 catalog_manager.cc:1514] Loading token signing keys...
I20260317 20:57:50.916594 2923 catalog_manager.cc:6055] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Loaded TSK: 0
I20260317 20:57:50.917629 2923 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260317 20:57:50.919343 2923 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260317 20:57:50.920405 2923 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 75
I20260317 20:57:50.973321 2849 master_service.cc:954] ReplaceTablet: received request to replace tablet 0d7946629e25418c9c23d09363e305b8 from {username='slave'} at 127.0.0.1:32802
I20260317 20:57:50.973476 2848 master_service.cc:954] ReplaceTablet: received request to replace tablet 3958625929884f3397edf4c3aee3260e from {username='slave'} at 127.0.0.1:32802
I20260317 20:57:50.974261 2841 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32802:
name: "default.Table_2bb25afec8d34b60a23f812af93043f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:50.974783 2843 master_service.cc:954] ReplaceTablet: received request to replace tablet e69ac6bd9aca4af5aa72d76b4764b14c from {username='slave'} at 127.0.0.1:32802
I20260317 20:57:50.974808 2840 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32802:
name: "default.Table_2c85af89e0d2498184e2a12f5708ef6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:50.975117 2847 master_service.cc:954] ReplaceTablet: received request to replace tablet 6d152d8bcdb544bd80c998d9dd0a8cbd from {username='slave'} at 127.0.0.1:32802
I20260317 20:57:50.975237 2843 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32802:
name: "default.Table_3d8df4ce76d747a38a984e386c6d96bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:50.975757 2846 master_service.cc:954] ReplaceTablet: received request to replace tablet dcc244fe79aa45e18427da2be335636a from {username='slave'} at 127.0.0.1:32802
I20260317 20:57:50.976025 2844 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32802:
name: "default.Table_489d4d491c244f80ad787d520144e905"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:50.976308 2845 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32802:
table { table_name: "default.Table_4b318a4173584e1298cc874712d94e47" } modify_external_catalogs: true
I20260317 20:57:50.976449 2845 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32802:
table { table_name: "default.Table_4b318a4173584e1298cc874712d94e47" } modify_external_catalogs: true
I20260317 20:57:50.976449 2842 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32802:
name: "default.Table_20e6210c7a18419c901e9ae16b5560a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260317 20:57:50.979046 2835 consensus_peers.cc:597] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 -> Peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Couldn't send request to peer 5022d9ddb45c41faa9f114e2a0a31fc3. Status: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260317 20:57:50.979553 2904 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 7 out of 9 received events: NotificationEvent(eventId=76, eventTime=1773781059, eventType=DROP_TABLE, dbName=default, tableName=table_e0a1ab3af8974191818e51a5608c5724, message={"server":"","servicePrincipal":"","db":"default","table":"table_e0a1ab3af8974191818e51a5608c5724","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_e0a1ab3af8974191818e51a5608c5724\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781056},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_e0a1ab3af8974191818e51a5608c5724\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_e0a1ab3af8974191818e51a5608c5724\",\"kudu.table_id\":\"110ed734bb04495784d1d8ca1a7a8498\",\"transient_lastDdlTime\":\"1773781056\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781059}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=77, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_0544e71a0de540529c2f7865976f74f3, message={"server":"","servicePrincipal":"","db":"default","table":"table_0544e71a0de540529c2f7865976f74f3","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0544e71a0de540529c2f7865976f74f3\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781059},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_0544e71a0de540529c2f7865976f74f3\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0544e71a0de540529c2f7865976f74f3\",\"kudu.table_id\":\"4c1e17a5a7714446bfd8dbc5d5abb95b\",\"transient_lastDdlTime\":\"1773781059\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1773781060, eventType=ALTER_TABLE, dbName=default, tableName=table_15d4ddf21b5d49f7bf9245c9e7e07e0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_ffa8292a8cda469787b621281ed2203c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_ffa8292a8cda469787b621281ed2203c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_ffa8292a8cda469787b621281ed2203c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ffa8292a8cda469787b621281ed2203c\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_15d4ddf21b5d49f7bf9245c9e7e07e0e\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_4b318a4173584e1298cc874712d94e47, message={"server":"","servicePrincipal":"","db":"default","table":"table_4b318a4173584e1298cc874712d94e47","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4b318a4173584e1298cc874712d94e47\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781053},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_4b318a4173584e1298cc874712d94e47\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4b318a4173584e1298cc874712d94e47\",\"kudu.table_id\":\"0e789a2f9f64400eb7e38a789e0ec299\",\"transient_lastDdlTime\":\"1773781053\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"transient_lastDdlTime\":\"1773781060\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_a5ab9704ed704e619e80ab8d4d623a68, message={"server":"","servicePrincipal":"","db":"default","table":"table_a5ab9704ed704e619e80ab8d4d623a68","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a5ab9704ed704e619e80ab8d4d623a68\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781051},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_a5ab9704ed704e619e80ab8d4d623a68\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a5ab9704ed704e619e80ab8d4d623a68\",\"transient_lastDdlTime\":\"1773781051\",\"kudu.table_id\":\"a4ba9bce277146cc8c2a1cfcbf90f951\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"transient_lastDdlTime\":\"1773781060\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20260317 20:57:50.980194 2711 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Refusing update from remote peer db5e708fd6404c0daa842bfc7e8f4806: Log matching property violated. Preceding OpId in replica: term: 5 index: 255. Preceding OpId from leader: term: 6 index: 257. (index mismatch)
I20260317 20:57:50.980819 2921 consensus_queue.cc:1048] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 256, Last known committed idx: 255, Time since last communication: 0.000s
@ 0x7f75d5d95dcd google::LogMessage::Fail() at ??:0
@ 0x7f75d5d99b93 google::LogMessage::SendToLog() at ??:0
I20260317 20:57:50.985543 2925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db5e708fd6404c0daa842bfc7e8f4806. Latest consensus state: current_term: 6 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:50.985720 2925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f75d5d957cc google::LogMessage::Flush() at ??:0
I20260317 20:57:50.988639 2916 sys_catalog.cc:455] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:50.988807 2916 sys_catalog.cc:458] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806 [sys.catalog]: This master's current role is: LEADER
I20260317 20:57:50.989352 2925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "db5e708fd6404c0daa842bfc7e8f4806" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:50.989482 2925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:50.989569 2927 mvcc.cc:204] Tried to move back new op lower bound from 7265407266730127360 to 7265407266362175488. Current Snapshot: MvccSnapshot[applied={T|T < 7265407266722197504}]
@ 0x7f75d5d95a11 google::LogMessage::~LogMessage() at ??:0
I20260317 20:57:50.992211 2849 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 0d7946629e25418c9c23d09363e305b8
I20260317 20:57:50.992440 2847 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:57:50.993340 2847 catalog_manager.cc:6741] ReplaceTablet: tablet 6d152d8bcdb544bd80c998d9dd0a8cbd deleted and replaced by tablet 1d5f2b4be23042a0b5c96eae8140f5de
I20260317 20:57:50.993564 2847 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32802:
table { table_name: "default.Table_cde2029a6fbb404892afd070c4de7abd" } modify_external_catalogs: true
I20260317 20:57:50.993716 2847 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32802:
table { table_name: "default.Table_cde2029a6fbb404892afd070c4de7abd" } modify_external_catalogs: true
I20260317 20:57:50.993845 2849 catalog_manager.cc:6741] ReplaceTablet: tablet 0d7946629e25418c9c23d09363e305b8 deleted and replaced by tablet 40384fdafa1e47cc8dfa372e4b2d4a9d
I20260317 20:57:50.994026 2849 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32802:
name: "default.Table_6215ae4e2f8745489185062d37f72f06"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:57:50.994786 2848 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet 3958625929884f3397edf4c3aee3260e
I20260317 20:57:50.995076 2848 catalog_manager.cc:6741] ReplaceTablet: tablet 3958625929884f3397edf4c3aee3260e deleted and replaced by tablet 17b2789d9ebd49d5b97646ea55414bfa
I20260317 20:57:50.995319 2848 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32802:
table { table_name: "default.Table_70c346e7110644f2b3b5b4bec1789d4a" } new_table_name: "default.Table_fb41c97ca0a9409c963fbe195007a57f" modify_external_catalogs: true
I20260317 20:57:50.997633 2846 catalog_manager.cc:5958] T 00000000000000000000000000000000 P db5e708fd6404c0daa842bfc7e8f4806: Sending DeleteTablet for 3 replicas of tablet dcc244fe79aa45e18427da2be335636a
I20260317 20:57:50.997982 2846 catalog_manager.cc:6741] ReplaceTablet: tablet dcc244fe79aa45e18427da2be335636a deleted and replaced by tablet c8a15f27b2bb42cea16e96588aa9d2a1
I20260317 20:57:50.998200 2846 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:32802:
table { table_name: "default.Table_d75875b48ed64da7a376b2b012ffe68c" } new_table_name: "default.Table_4ff5658252364bb1bf6fa149608be43f" modify_external_catalogs: true
@ 0x7f75daf68847 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260317 20:57:50.999976 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd with delete_type TABLET_DATA_DELETED (replaced by tablet 1d5f2b4be23042a0b5c96eae8140f5de) from {username='slave'} at 127.0.0.1:52736
I20260317 20:57:51.000197 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d7946629e25418c9c23d09363e305b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 40384fdafa1e47cc8dfa372e4b2d4a9d) from {username='slave'} at 127.0.0.1:52736
I20260317 20:57:51.000291 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 3958625929884f3397edf4c3aee3260e with delete_type TABLET_DATA_DELETED (replaced by tablet 17b2789d9ebd49d5b97646ea55414bfa) from {username='slave'} at 127.0.0.1:52736
I20260317 20:57:51.000370 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc244fe79aa45e18427da2be335636a with delete_type TABLET_DATA_DELETED (replaced by tablet c8a15f27b2bb42cea16e96588aa9d2a1) from {username='slave'} at 127.0.0.1:52736
I20260317 20:57:51.000658 2944 tablet_replica.cc:333] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:51.000818 2944 raft_consensus.cc:2243] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:51.001066 2944 raft_consensus.cc:2272] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:51.001502 2944 ts_tablet_manager.cc:1916] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:51.004071 2944 ts_tablet_manager.cc:1929] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:51.004148 2944 log.cc:1199] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:57:51.004338 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5f2b4be23042a0b5c96eae8140f5de (DEFAULT_TABLE table=default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:51.004650 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5f2b4be23042a0b5c96eae8140f5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:51.007087 1040 tablet_service.cc:1511] Processing CreateTablet for tablet 40384fdafa1e47cc8dfa372e4b2d4a9d (DEFAULT_TABLE table=default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:51.007361 1040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40384fdafa1e47cc8dfa372e4b2d4a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:51.007794 1313 tablet_service.cc:1558] Processing DeleteTablet for tablet dcc244fe79aa45e18427da2be335636a with delete_type TABLET_DATA_DELETED (replaced by tablet c8a15f27b2bb42cea16e96588aa9d2a1) from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:51.007895 1308 tablet_service.cc:1558] Processing DeleteTablet for tablet 6d152d8bcdb544bd80c998d9dd0a8cbd with delete_type TABLET_DATA_DELETED (replaced by tablet 1d5f2b4be23042a0b5c96eae8140f5de) from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:51.008015 1309 tablet_service.cc:1558] Processing DeleteTablet for tablet 3958625929884f3397edf4c3aee3260e with delete_type TABLET_DATA_DELETED (replaced by tablet 17b2789d9ebd49d5b97646ea55414bfa) from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:51.008098 1312 tablet_service.cc:1511] Processing CreateTablet for tablet 1d5f2b4be23042a0b5c96eae8140f5de (DEFAULT_TABLE table=default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:51.004406 2944 ts_tablet_manager.cc:1950] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:51.008368 1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5f2b4be23042a0b5c96eae8140f5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:51.008545 2945 tablet_replica.cc:333] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:51.008723 2945 raft_consensus.cc:2243] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:51.008862 2945 raft_consensus.cc:2272] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:51.008949 1311 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d7946629e25418c9c23d09363e305b8 with delete_type TABLET_DATA_DELETED (replaced by tablet 40384fdafa1e47cc8dfa372e4b2d4a9d) from {username='slave'} at 127.0.0.1:57868
I20260317 20:57:51.009222 2945 ts_tablet_manager.cc:1916] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:51.009194 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 40384fdafa1e47cc8dfa372e4b2d4a9d (DEFAULT_TABLE table=default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:51.009423 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40384fdafa1e47cc8dfa372e4b2d4a9d. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f75daf6775e kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260317 20:57:51.011466 2945 ts_tablet_manager.cc:1929] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:51.013054 2945 log.cc:1199] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/dcc244fe79aa45e18427da2be335636a
I20260317 20:57:51.013361 2945 ts_tablet_manager.cc:1950] T dcc244fe79aa45e18427da2be335636a P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:51.014222 2834 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet dcc244fe79aa45e18427da2be335636a (table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]) successfully deleted
I20260317 20:57:51.014503 2945 tablet_replica.cc:333] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:51.014680 2945 raft_consensus.cc:2243] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:51.014798 2945 raft_consensus.cc:2272] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:51.014900 2944 tablet_replica.cc:333] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:51.015056 2944 raft_consensus.cc:2243] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:57:51.015185 2944 raft_consensus.cc:2272] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:51.015597 2944 ts_tablet_manager.cc:1916] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:51.015682 1314 tablet_service.cc:1511] Processing CreateTablet for tablet 17b2789d9ebd49d5b97646ea55414bfa (DEFAULT_TABLE table=default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]), partition=RANGE (key) PARTITION UNBOUNDED
@ 0x7f75daf66ec1 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260317 20:57:51.016009 1314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2789d9ebd49d5b97646ea55414bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:51.016438 1312 tablet_service.cc:1511] Processing CreateTablet for tablet c8a15f27b2bb42cea16e96588aa9d2a1 (DEFAULT_TABLE table=default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:51.016690 1312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a15f27b2bb42cea16e96588aa9d2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:51.018430 1037 tablet_service.cc:1511] Processing CreateTablet for tablet c8a15f27b2bb42cea16e96588aa9d2a1 (DEFAULT_TABLE table=default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:51.018743 1037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a15f27b2bb42cea16e96588aa9d2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:51.019101 2945 ts_tablet_manager.cc:1916] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:51.019100 2834 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]) successfully deleted
@ 0x7f75daf6c5c8 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x55814371d18a std::function<>::operator()() at ??:0
I20260317 20:57:51.022877 2944 ts_tablet_manager.cc:1929] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:51.022950 2944 log.cc:1199] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/0d7946629e25418c9c23d09363e305b8
I20260317 20:57:51.023149 2944 ts_tablet_manager.cc:1950] T 0d7946629e25418c9c23d09363e305b8 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:51.023517 1039 tablet_service.cc:1511] Processing CreateTablet for tablet 17b2789d9ebd49d5b97646ea55414bfa (DEFAULT_TABLE table=default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260317 20:57:51.023764 1039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2789d9ebd49d5b97646ea55414bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:51.024066 2834 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 0d7946629e25418c9c23d09363e305b8 (table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]) successfully deleted
I20260317 20:57:51.024303 2944 tablet_replica.cc:333] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:51.024425 2944 raft_consensus.cc:2243] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
@ 0x7f75d7295214 kudu::Thread::SuperviseThread() at ??:0
I20260317 20:57:51.024525 2944 raft_consensus.cc:2272] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:51.025071 2944 ts_tablet_manager.cc:1916] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:51.025918 2945 ts_tablet_manager.cc:1929] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:51.026003 2945 log.cc:1199] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:57:51.026310 2945 ts_tablet_manager.cc:1950] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:51.027081 2945 tablet_replica.cc:333] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
@ 0x7f75d7a7d6db start_thread at ??:0
I20260317 20:57:51.027246 2945 raft_consensus.cc:2243] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:51.027230 2834 catalog_manager.cc:5002] TS 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): tablet 6d152d8bcdb544bd80c998d9dd0a8cbd (table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]) successfully deleted
I20260317 20:57:51.027459 2945 raft_consensus.cc:2272] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:51.027493 2944 ts_tablet_manager.cc:1929] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:51.027554 2944 log.cc:1199] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/3958625929884f3397edf4c3aee3260e
I20260317 20:57:51.027808 2944 ts_tablet_manager.cc:1950] T 3958625929884f3397edf4c3aee3260e P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:51.027904 2945 ts_tablet_manager.cc:1916] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:51.028473 2834 catalog_manager.cc:5002] TS 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): tablet 3958625929884f3397edf4c3aee3260e (table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]) successfully deleted
I20260317 20:57:51.028724 2944 tablet_replica.cc:333] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:57:51.028851 2944 raft_consensus.cc:2243] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:51.029033 2944 raft_consensus.cc:2272] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7f75d4f4c61f clone at ??:0
I20260317 20:57:51.029421 2944 ts_tablet_manager.cc:1916] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:51.031150 2948 tablet_bootstrap.cc:492] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:51.031168 2945 ts_tablet_manager.cc:1929] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:51.031239 2945 log.cc:1199] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/3958625929884f3397edf4c3aee3260e
I20260317 20:57:51.031319 2947 tablet_bootstrap.cc:492] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:51.031490 2945 ts_tablet_manager.cc:1950] T 3958625929884f3397edf4c3aee3260e P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:51.032085 2944 ts_tablet_manager.cc:1929] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:51.032114 2945 tablet_replica.cc:333] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: stopping tablet replica
I20260317 20:57:51.032150 2944 log.cc:1199] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/dcc244fe79aa45e18427da2be335636a
I20260317 20:57:51.032239 2945 raft_consensus.cc:2243] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:57:51.032357 2947 tablet_bootstrap.cc:654] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:51.032407 2944 ts_tablet_manager.cc:1950] T dcc244fe79aa45e18427da2be335636a P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:57:51.032444 2945 raft_consensus.cc:2272] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:57:51.032845 2945 ts_tablet_manager.cc:1916] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:57:51.032403 2948 tablet_bootstrap.cc:654] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:51.034487 2948 tablet_bootstrap.cc:492] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:51.034574 2948 ts_tablet_manager.cc:1403] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:51.035204 2945 ts_tablet_manager.cc:1929] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:57:51.035159 2948 raft_consensus.cc:359] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.035272 2945 log.cc:1199] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-2/wal/wals/0d7946629e25418c9c23d09363e305b8
I20260317 20:57:51.035281 2948 raft_consensus.cc:385] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:51.035317 2948 raft_consensus.cc:740] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:51.035471 2948 consensus_queue.cc:260] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.035537 2945 ts_tablet_manager.cc:1950] T 0d7946629e25418c9c23d09363e305b8 P 630e777e97c141a69e35660f32b26f6d: Deleting consensus metadata
I20260317 20:57:51.035789 2948 ts_tablet_manager.cc:1434] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:51.035822 1109 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:51.035962 2948 tablet_bootstrap.cc:492] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:51.037206 2948 tablet_bootstrap.cc:654] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:51.038548 2948 tablet_bootstrap.cc:492] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:51.038647 2948 ts_tablet_manager.cc:1403] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260317 20:57:51.039067 2947 tablet_bootstrap.cc:492] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:51.039155 2947 ts_tablet_manager.cc:1403] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260317 20:57:51.039304 2948 raft_consensus.cc:359] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.039409 2948 raft_consensus.cc:385] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:51.039441 2948 raft_consensus.cc:740] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:51.039562 2948 consensus_queue.cc:260] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.039878 2948 ts_tablet_manager.cc:1434] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260317 20:57:51.040165 2948 tablet_bootstrap.cc:492] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:51.039639 2947 raft_consensus.cc:359] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.041167 2947 raft_consensus.cc:385] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:51.041219 2947 raft_consensus.cc:740] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:51.041365 2947 consensus_queue.cc:260] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.041615 2948 tablet_bootstrap.cc:654] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:51.041718 2947 ts_tablet_manager.cc:1434] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260317 20:57:51.041918 1382 heartbeater.cc:499] Master 127.0.102.253:38969 was elected leader, sending a full tablet report...
I20260317 20:57:51.041973 2947 tablet_bootstrap.cc:492] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:51.043063 2947 tablet_bootstrap.cc:654] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:51.044137 2947 tablet_bootstrap.cc:492] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:51.044255 2947 ts_tablet_manager.cc:1403] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:51.044719 2947 raft_consensus.cc:359] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.044816 2947 raft_consensus.cc:385] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:51.044844 2947 raft_consensus.cc:740] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:51.044970 2947 consensus_queue.cc:260] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.045241 2947 ts_tablet_manager.cc:1434] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:51.045413 2947 tablet_bootstrap.cc:492] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:51.046833 2948 tablet_bootstrap.cc:492] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:51.046602 2947 tablet_bootstrap.cc:654] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:51.046921 2948 ts_tablet_manager.cc:1403] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20260317 20:57:51.047433 2948 raft_consensus.cc:359] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.047555 2948 raft_consensus.cc:385] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:51.047596 2948 raft_consensus.cc:740] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:51.047740 2948 consensus_queue.cc:260] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.048031 2948 ts_tablet_manager.cc:1434] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:51.048245 2948 tablet_bootstrap.cc:492] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a: Bootstrap starting.
I20260317 20:57:51.049154 2947 tablet_bootstrap.cc:492] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:51.049237 2947 ts_tablet_manager.cc:1403] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260317 20:57:51.049285 2948 tablet_bootstrap.cc:654] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:51.049714 2947 raft_consensus.cc:359] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.049818 2947 raft_consensus.cc:385] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:51.049863 2947 raft_consensus.cc:740] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:51.049997 2947 consensus_queue.cc:260] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.050395 2947 ts_tablet_manager.cc:1434] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260317 20:57:51.050828 2948 tablet_bootstrap.cc:492] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a: No bootstrap required, opened a new log
I20260317 20:57:51.050999 2948 ts_tablet_manager.cc:1403] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:51.051360 2947 tablet_bootstrap.cc:492] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d: Bootstrap starting.
I20260317 20:57:51.051477 2948 raft_consensus.cc:359] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.051568 2948 raft_consensus.cc:385] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:51.051597 2948 raft_consensus.cc:740] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Initialized, Role: FOLLOWER
I20260317 20:57:51.051718 2948 consensus_queue.cc:260] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.052026 2948 ts_tablet_manager.cc:1434] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:51.053210 2947 tablet_bootstrap.cc:654] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d: Neither blocks nor log segments found. Creating new log.
I20260317 20:57:51.054277 2947 tablet_bootstrap.cc:492] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d: No bootstrap required, opened a new log
I20260317 20:57:51.054338 2947 ts_tablet_manager.cc:1403] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:51.054677 2947 raft_consensus.cc:359] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.054754 2947 raft_consensus.cc:385] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260317 20:57:51.054773 2947 raft_consensus.cc:740] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Initialized, Role: FOLLOWER
I20260317 20:57:51.054905 2947 consensus_queue.cc:260] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.057813 2947 ts_tablet_manager.cc:1434] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260317 20:57:51.075201 2668 raft_consensus.cc:493] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:51.075352 2668 raft_consensus.cc:515] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.076035 2668 leader_election.cc:290] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:51.076699 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a15f27b2bb42cea16e96588aa9d2a1" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
W20260317 20:57:51.076766 1268 leader_election.cc:343] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: c8a15f27b2bb42cea16e96588aa9d2a1
I20260317 20:57:51.076864 1060 raft_consensus.cc:2468] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
I20260317 20:57:51.077178 1269 leader_election.cc:304] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:51.077355 2668 raft_consensus.cc:2804] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:51.077420 2668 raft_consensus.cc:493] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:51.077476 2668 raft_consensus.cc:3060] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:51.078390 2668 raft_consensus.cc:515] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.078774 2668 leader_election.cc:290] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:51.079087 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8a15f27b2bb42cea16e96588aa9d2a1" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:51.079193 1060 raft_consensus.cc:3060] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
W20260317 20:57:51.079381 1268 leader_election.cc:343] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: c8a15f27b2bb42cea16e96588aa9d2a1
I20260317 20:57:51.080010 1060 raft_consensus.cc:2468] T c8a15f27b2bb42cea16e96588aa9d2a1 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:51.080327 1269 leader_election.cc:304] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:51.080576 2668 raft_consensus.cc:2804] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:51.080780 2668 raft_consensus.cc:697] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:51.080938 2668 consensus_queue.cc:237] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.169432 2668 raft_consensus.cc:493] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:51.169644 2668 raft_consensus.cc:515] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.169855 2915 raft_consensus.cc:493] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:51.169993 2915 raft_consensus.cc:515] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.170284 2668 leader_election.cc:290] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:51.170614 2915 leader_election.cc:290] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:51.170737 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5f2b4be23042a0b5c96eae8140f5de" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" is_pre_election: true
I20260317 20:57:51.170876 1060 raft_consensus.cc:2468] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 0.
W20260317 20:57:51.171118 1268 leader_election.cc:343] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: 1d5f2b4be23042a0b5c96eae8140f5de
I20260317 20:57:51.171267 1269 leader_election.cc:304] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:51.171432 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2789d9ebd49d5b97646ea55414bfa" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
W20260317 20:57:51.171521 995 leader_election.cc:343] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: 17b2789d9ebd49d5b97646ea55414bfa
I20260317 20:57:51.171550 1332 raft_consensus.cc:2468] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
I20260317 20:57:51.171598 2668 raft_consensus.cc:2804] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:51.171649 2668 raft_consensus.cc:493] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:51.171691 2668 raft_consensus.cc:3060] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:51.171912 996 leader_election.cc:304] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:51.172116 2915 raft_consensus.cc:2804] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:51.172170 2915 raft_consensus.cc:493] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:51.172212 2915 raft_consensus.cc:3060] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:51.172896 2668 raft_consensus.cc:515] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.173319 2668 leader_election.cc:290] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Requested vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:51.173295 2915 raft_consensus.cc:515] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.173695 2915 leader_election.cc:290] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:51.173760 1060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d5f2b4be23042a0b5c96eae8140f5de" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a"
I20260317 20:57:51.173866 1060 raft_consensus.cc:3060] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
W20260317 20:57:51.174019 1268 leader_election.cc:343] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: 1d5f2b4be23042a0b5c96eae8140f5de
I20260317 20:57:51.174131 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17b2789d9ebd49d5b97646ea55414bfa" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:51.174229 1332 raft_consensus.cc:3060] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
W20260317 20:57:51.174723 995 leader_election.cc:343] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: 17b2789d9ebd49d5b97646ea55414bfa
I20260317 20:57:51.174930 1060 raft_consensus.cc:2468] T 1d5f2b4be23042a0b5c96eae8140f5de P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:57:51.175259 1269 leader_election.cc:304] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:51.175395 1332 raft_consensus.cc:2468] T 17b2789d9ebd49d5b97646ea55414bfa P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:51.175565 2668 raft_consensus.cc:2804] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:51.175658 2668 raft_consensus.cc:697] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [term 1 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:57:51.175709 996 leader_election.cc:304] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:51.175834 2668 consensus_queue.cc:237] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.175876 2915 raft_consensus.cc:2804] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:51.176333 2915 raft_consensus.cc:697] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:51.176482 2915 consensus_queue.cc:237] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
W20260317 20:57:51.218593 997 connection.cc:537] server connection from 127.0.0.1:52736 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:51.218583 1268 connection.cc:537] server connection from 127.0.0.1:57868 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:51.218606 1269 connection.cc:537] client connection to 127.0.102.253:38969 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:51.218798 996 connection.cc:537] client connection to 127.0.102.253:38969 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:51.219103 2939 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:50.993958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43220 (local address 127.0.102.194:40679)
0317 20:57:50.999234 (+ 5276us) server_negotiation.cc:207] Beginning negotiation
0317 20:57:50.999239 (+ 5us) server_negotiation.cc:400] Waiting for connection header
0317 20:57:50.999254 (+ 15us) server_negotiation.cc:408] Connection header received
0317 20:57:50.999302 (+ 48us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0317 20:57:50.999306 (+ 4us) server_negotiation.cc:462] Received NEGOTIATE request from client
0317 20:57:50.999355 (+ 49us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0317 20:57:51.000584 (+ 1229us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0317 20:57:51.002863 (+ 2279us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0317 20:57:51.030858 (+ 27995us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0317 20:57:51.218928 (+188070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43220: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":5187,"thread_start_us":84,"threads_started":1}
W20260317 20:57:51.219511 1389 connection.cc:537] client connection to 127.0.102.253:38969 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:57:51.220122 1389 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.102.253:38969)
W20260317 20:57:51.220575 1389 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:51.220692 1389 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:51.220834 1389 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.102.253:38969)
W20260317 20:57:51.221639 2913 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:57:51.219783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.0.102.253:38969 (local address 127.0.102.195:33657)
0317 20:57:51.219906 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0317 20:57:51.219922 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0317 20:57:51.220022 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0317 20:57:51.221529 (+ 1507us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":41}
I20260317 20:57:51.358811 2915 raft_consensus.cc:493] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:51.358954 2915 raft_consensus.cc:515] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.359371 2915 leader_election.cc:290] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:51.359823 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384fdafa1e47cc8dfa372e4b2d4a9d" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:57:51.359999 1332 raft_consensus.cc:2468] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 0.
W20260317 20:57:51.360167 995 leader_election.cc:343] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: 40384fdafa1e47cc8dfa372e4b2d4a9d
I20260317 20:57:51.360351 996 leader_election.cc:304] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:51.360519 2915 raft_consensus.cc:2804] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260317 20:57:51.360582 2915 raft_consensus.cc:493] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:57:51.360620 2915 raft_consensus.cc:3060] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 0 FOLLOWER]: Advancing to term 1
I20260317 20:57:51.361472 2915 raft_consensus.cc:515] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.361850 2915 leader_election.cc:290] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:51.362274 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40384fdafa1e47cc8dfa372e4b2d4a9d" candidate_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:57:51.362416 1332 raft_consensus.cc:3060] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d [term 0 FOLLOWER]: Advancing to term 1
W20260317 20:57:51.362571 995 leader_election.cc:343] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Not found: Tablet not found: 40384fdafa1e47cc8dfa372e4b2d4a9d
I20260317 20:57:51.363440 1332 raft_consensus.cc:2468] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d68c1a3a2642cca908f2c7e9d7e13a in term 1.
I20260317 20:57:51.363780 996 leader_election.cc:304] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a; no voters: 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:51.363998 2915 raft_consensus.cc:2804] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Leader election won for term 1
I20260317 20:57:51.364115 2915 raft_consensus.cc:697] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Becoming Leader. State: Replica: 92d68c1a3a2642cca908f2c7e9d7e13a, State: Running, Role: LEADER
I20260317 20:57:51.364280 2915 consensus_queue.cc:237] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:51.515230 2974 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:51.515411 2974 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:51.515946 2974 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:51.517222 2688 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:51.517339 2687 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:51.517429 2687 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:51.517620 2974 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260317 20:57:51.584695 1268 consensus_peers.cc:597] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d -> Peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Couldn't send request to peer 35518b51259b46d1b9b5e82b6841057b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d5f2b4be23042a0b5c96eae8140f5de. This is attempt 1: this message will repeat every 5th retry.
I20260317 20:57:51.626003 2965 consensus_queue.cc:1048] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260317 20:57:51.631335 1268 consensus_peers.cc:597] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d -> Peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Couldn't send request to peer 35518b51259b46d1b9b5e82b6841057b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8a15f27b2bb42cea16e96588aa9d2a1. This is attempt 1: this message will repeat every 5th retry.
W20260317 20:57:51.699875 995 consensus_peers.cc:597] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a -> Peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Couldn't send request to peer 35518b51259b46d1b9b5e82b6841057b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 17b2789d9ebd49d5b97646ea55414bfa. This is attempt 1: this message will repeat every 5th retry.
I20260317 20:57:51.699968 2810 consensus_queue.cc:1048] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:51.714084 2668 consensus_queue.cc:1048] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260317 20:57:51.823210 995 consensus_peers.cc:597] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a -> Peer 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679): Couldn't send request to peer 35518b51259b46d1b9b5e82b6841057b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 40384fdafa1e47cc8dfa372e4b2d4a9d. This is attempt 1: this message will repeat every 5th retry.
I20260317 20:57:51.925717 2670 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111),
I20260317 20:57:51.925846 2670 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:51.972324 2810 consensus_queue.cc:1048] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260317 20:57:51.990720 2987 ts_tablet_manager.cc:933] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: Initiating tablet copy from peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:51.991289 2987 tablet_copy_client.cc:323] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.102.195:46847
I20260317 20:57:51.992028 1352 tablet_copy_service.cc:140] P 630e777e97c141a69e35660f32b26f6d: Received BeginTabletCopySession request for tablet 1d5f2b4be23042a0b5c96eae8140f5de from peer 35518b51259b46d1b9b5e82b6841057b ({username='slave'} at 127.0.102.194:47685)
I20260317 20:57:51.992205 1352 tablet_copy_service.cc:161] P 630e777e97c141a69e35660f32b26f6d: Beginning new tablet copy session on tablet 1d5f2b4be23042a0b5c96eae8140f5de from peer 35518b51259b46d1b9b5e82b6841057b at {username='slave'} at 127.0.102.194:47685: session id = 35518b51259b46d1b9b5e82b6841057b-1d5f2b4be23042a0b5c96eae8140f5de
I20260317 20:57:51.993749 1352 tablet_copy_source_session.cc:215] T 1d5f2b4be23042a0b5c96eae8140f5de P 630e777e97c141a69e35660f32b26f6d: Tablet Copy: opened 0 blocks and 1 log segments
I20260317 20:57:51.995231 2987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d5f2b4be23042a0b5c96eae8140f5de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:51.997275 2987 tablet_copy_client.cc:806] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Starting download of 0 data blocks...
I20260317 20:57:51.997475 2987 tablet_copy_client.cc:670] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Starting download of 1 WAL segments...
I20260317 20:57:51.999286 2987 tablet_copy_client.cc:538] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260317 20:57:52.000846 2987 tablet_bootstrap.cc:492] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:52.004508 2987 tablet_bootstrap.cc:492] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:52.004819 2987 tablet_bootstrap.cc:492] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: Bootstrap complete.
I20260317 20:57:52.005044 2987 ts_tablet_manager.cc:1403] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260317 20:57:52.005540 2987 raft_consensus.cc:359] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.005648 2987 raft_consensus.cc:740] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:52.005803 2987 consensus_queue.cc:260] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.006155 2987 ts_tablet_manager.cc:1434] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s
I20260317 20:57:52.007031 1352 tablet_copy_service.cc:342] P 630e777e97c141a69e35660f32b26f6d: Request end of tablet copy session 35518b51259b46d1b9b5e82b6841057b-1d5f2b4be23042a0b5c96eae8140f5de received from {username='slave'} at 127.0.102.194:47685
I20260317 20:57:52.008553 1352 tablet_copy_service.cc:434] P 630e777e97c141a69e35660f32b26f6d: ending tablet copy session 35518b51259b46d1b9b5e82b6841057b-1d5f2b4be23042a0b5c96eae8140f5de on tablet 1d5f2b4be23042a0b5c96eae8140f5de with peer 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:52.038329 2987 ts_tablet_manager.cc:933] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: Initiating tablet copy from peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:52.038677 2987 tablet_copy_client.cc:323] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.102.195:46847
I20260317 20:57:52.039204 1352 tablet_copy_service.cc:140] P 630e777e97c141a69e35660f32b26f6d: Received BeginTabletCopySession request for tablet c8a15f27b2bb42cea16e96588aa9d2a1 from peer 35518b51259b46d1b9b5e82b6841057b ({username='slave'} at 127.0.102.194:47685)
I20260317 20:57:52.039354 1352 tablet_copy_service.cc:161] P 630e777e97c141a69e35660f32b26f6d: Beginning new tablet copy session on tablet c8a15f27b2bb42cea16e96588aa9d2a1 from peer 35518b51259b46d1b9b5e82b6841057b at {username='slave'} at 127.0.102.194:47685: session id = 35518b51259b46d1b9b5e82b6841057b-c8a15f27b2bb42cea16e96588aa9d2a1
I20260317 20:57:52.040366 1352 tablet_copy_source_session.cc:215] T c8a15f27b2bb42cea16e96588aa9d2a1 P 630e777e97c141a69e35660f32b26f6d: Tablet Copy: opened 0 blocks and 1 log segments
I20260317 20:57:52.041173 2987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8a15f27b2bb42cea16e96588aa9d2a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:52.042977 2987 tablet_copy_client.cc:806] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Starting download of 0 data blocks...
I20260317 20:57:52.043147 2987 tablet_copy_client.cc:670] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Starting download of 1 WAL segments...
I20260317 20:57:52.044294 2987 tablet_copy_client.cc:538] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260317 20:57:52.045281 2987 tablet_bootstrap.cc:492] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:52.048238 2987 tablet_bootstrap.cc:492] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:52.048542 2987 tablet_bootstrap.cc:492] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: Bootstrap complete.
I20260317 20:57:52.048731 2987 ts_tablet_manager.cc:1403] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260317 20:57:52.049193 2987 raft_consensus.cc:359] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.049299 2987 raft_consensus.cc:740] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:52.049455 2987 consensus_queue.cc:260] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.049754 2987 ts_tablet_manager.cc:1434] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:52.050745 1352 tablet_copy_service.cc:342] P 630e777e97c141a69e35660f32b26f6d: Request end of tablet copy session 35518b51259b46d1b9b5e82b6841057b-c8a15f27b2bb42cea16e96588aa9d2a1 received from {username='slave'} at 127.0.102.194:47685
I20260317 20:57:52.050838 1352 tablet_copy_service.cc:434] P 630e777e97c141a69e35660f32b26f6d: ending tablet copy session 35518b51259b46d1b9b5e82b6841057b-c8a15f27b2bb42cea16e96588aa9d2a1 on tablet c8a15f27b2bb42cea16e96588aa9d2a1 with peer 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:52.087604 2967 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:57:52.087795 2967 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:52.088366 2967 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:57:52.089262 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:57:52.089419 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:57:52.089478 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:52.089699 2967 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:52.100310 2993 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader db5e708fd6404c0daa842bfc7e8f4806)
I20260317 20:57:52.100432 2993 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:52.100903 2993 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:52.102068 2687 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:52.102243 2688 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:52.102303 2688 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:52.102437 2993 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260317 20:57:52.178611 2967 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:57:52.178825 2967 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.179351 2967 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:57:52.180377 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:57:52.180558 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:57:52.180651 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:52.180866 2967 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:52.217813 2987 ts_tablet_manager.cc:933] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: Initiating tablet copy from peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:52.218223 2987 tablet_copy_client.cc:323] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.102.193:34743
I20260317 20:57:52.218880 1081 tablet_copy_service.cc:140] P 92d68c1a3a2642cca908f2c7e9d7e13a: Received BeginTabletCopySession request for tablet 40384fdafa1e47cc8dfa372e4b2d4a9d from peer 35518b51259b46d1b9b5e82b6841057b ({username='slave'} at 127.0.102.194:36587)
I20260317 20:57:52.219036 1081 tablet_copy_service.cc:161] P 92d68c1a3a2642cca908f2c7e9d7e13a: Beginning new tablet copy session on tablet 40384fdafa1e47cc8dfa372e4b2d4a9d from peer 35518b51259b46d1b9b5e82b6841057b at {username='slave'} at 127.0.102.194:36587: session id = 35518b51259b46d1b9b5e82b6841057b-40384fdafa1e47cc8dfa372e4b2d4a9d
I20260317 20:57:52.220242 1081 tablet_copy_source_session.cc:215] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 92d68c1a3a2642cca908f2c7e9d7e13a: Tablet Copy: opened 0 blocks and 1 log segments
I20260317 20:57:52.221446 2987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40384fdafa1e47cc8dfa372e4b2d4a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:52.223788 2987 tablet_copy_client.cc:806] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Starting download of 0 data blocks...
I20260317 20:57:52.223939 2987 tablet_copy_client.cc:670] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Starting download of 1 WAL segments...
I20260317 20:57:52.225399 2987 tablet_copy_client.cc:538] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260317 20:57:52.226665 2987 tablet_bootstrap.cc:492] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:52.229460 2987 tablet_bootstrap.cc:492] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:52.229732 2987 tablet_bootstrap.cc:492] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: Bootstrap complete.
I20260317 20:57:52.229940 2987 ts_tablet_manager.cc:1403] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260317 20:57:52.230531 2987 raft_consensus.cc:359] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.230692 2987 raft_consensus.cc:740] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:52.230861 2987 consensus_queue.cc:260] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.232293 2987 ts_tablet_manager.cc:1434] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:52.234689 1081 tablet_copy_service.cc:342] P 92d68c1a3a2642cca908f2c7e9d7e13a: Request end of tablet copy session 35518b51259b46d1b9b5e82b6841057b-40384fdafa1e47cc8dfa372e4b2d4a9d received from {username='slave'} at 127.0.102.194:36587
I20260317 20:57:52.234807 1081 tablet_copy_service.cc:434] P 92d68c1a3a2642cca908f2c7e9d7e13a: ending tablet copy session 35518b51259b46d1b9b5e82b6841057b-40384fdafa1e47cc8dfa372e4b2d4a9d on tablet 40384fdafa1e47cc8dfa372e4b2d4a9d with peer 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:52.252620 2987 ts_tablet_manager.cc:933] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: Initiating tablet copy from peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:52.253067 2987 tablet_copy_client.cc:323] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Beginning tablet copy session from remote peer at address 127.0.102.193:34743
I20260317 20:57:52.253559 1081 tablet_copy_service.cc:140] P 92d68c1a3a2642cca908f2c7e9d7e13a: Received BeginTabletCopySession request for tablet 17b2789d9ebd49d5b97646ea55414bfa from peer 35518b51259b46d1b9b5e82b6841057b ({username='slave'} at 127.0.102.194:36587)
I20260317 20:57:52.253662 1081 tablet_copy_service.cc:161] P 92d68c1a3a2642cca908f2c7e9d7e13a: Beginning new tablet copy session on tablet 17b2789d9ebd49d5b97646ea55414bfa from peer 35518b51259b46d1b9b5e82b6841057b at {username='slave'} at 127.0.102.194:36587: session id = 35518b51259b46d1b9b5e82b6841057b-17b2789d9ebd49d5b97646ea55414bfa
I20260317 20:57:52.254671 1081 tablet_copy_source_session.cc:215] T 17b2789d9ebd49d5b97646ea55414bfa P 92d68c1a3a2642cca908f2c7e9d7e13a: Tablet Copy: opened 0 blocks and 1 log segments
I20260317 20:57:52.255651 2987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17b2789d9ebd49d5b97646ea55414bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260317 20:57:52.257525 2987 tablet_copy_client.cc:806] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Starting download of 0 data blocks...
I20260317 20:57:52.257717 2987 tablet_copy_client.cc:670] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Starting download of 1 WAL segments...
I20260317 20:57:52.259131 2987 tablet_copy_client.cc:538] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260317 20:57:52.260404 2987 tablet_bootstrap.cc:492] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: Bootstrap starting.
I20260317 20:57:52.263954 2987 tablet_bootstrap.cc:492] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:52.264227 2987 tablet_bootstrap.cc:492] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: Bootstrap complete.
I20260317 20:57:52.264401 2987 ts_tablet_manager.cc:1403] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260317 20:57:52.264868 2987 raft_consensus.cc:359] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.265021 2987 raft_consensus.cc:740] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Initialized, Role: FOLLOWER
I20260317 20:57:52.265192 2987 consensus_queue.cc:260] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:52.265552 2987 ts_tablet_manager.cc:1434] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260317 20:57:52.266871 1081 tablet_copy_service.cc:342] P 92d68c1a3a2642cca908f2c7e9d7e13a: Request end of tablet copy session 35518b51259b46d1b9b5e82b6841057b-17b2789d9ebd49d5b97646ea55414bfa received from {username='slave'} at 127.0.102.194:36587
I20260317 20:57:52.266995 1081 tablet_copy_service.cc:434] P 92d68c1a3a2642cca908f2c7e9d7e13a: ending tablet copy session 35518b51259b46d1b9b5e82b6841057b-17b2789d9ebd49d5b97646ea55414bfa on tablet 17b2789d9ebd49d5b97646ea55414bfa with peer 35518b51259b46d1b9b5e82b6841057b
I20260317 20:57:52.419283 2967 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:57:52.419428 2967 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:52.419818 2967 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:57:52.420382 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:57:52.420527 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:57:52.420583 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:52.420739 3000 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:52.432156 411 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu with pid 2670
I20260317 20:57:52.451819 3000 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:57:52.451977 3000 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:52.452368 3000 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:57:52.453163 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:57:52.453325 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:57:52.453380 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:52.453575 3000 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:52.520021 1198 raft_consensus.cc:1217] T c8a15f27b2bb42cea16e96588aa9d2a1 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260317 20:57:52.599566 1198 raft_consensus.cc:1217] T 1d5f2b4be23042a0b5c96eae8140f5de P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260317 20:57:52.668884 1198 raft_consensus.cc:1217] T 40384fdafa1e47cc8dfa372e4b2d4a9d P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260317 20:57:52.768031 1198 raft_consensus.cc:1217] T 17b2789d9ebd49d5b97646ea55414bfa P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Deduplicated request from leader. Original: 0.0->[1.1-1.1] Dedup: 1.1->[]
I20260317 20:57:52.986436 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.252:34639
--webserver_interface=127.0.102.252
--webserver_port=38583
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260317 20:57:53.096868 3009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:53.097092 3009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:53.097204 3009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:53.101518 3009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:53.101588 3009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:53.101609 3009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:53.101627 3009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:53.105651 3009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.252:34639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.102.252
--webserver_port=38583
--never_fsync=true
--heap_profile_path=/tmp/kudu.3009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:53.107039 3009 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:53.108232 3009 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:53.114190 3018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:53.114163 3015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:53.114341 3016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:53.114813 3009 server_base.cc:1060] running on GCE node
I20260317 20:57:53.115350 3009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:53.116319 3009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:53.117511 3009 hybrid_clock.cc:648] HybridClock initialized: now 1773781073117485 us; error 43 us; skew 500 ppm
I20260317 20:57:53.119717 3009 webserver.cc:492] Webserver started at http://127.0.102.252:38583/ using document root <none> and password file <none>
I20260317 20:57:53.120337 3009 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:53.120429 3009 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:53.124094 3009 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.002s
I20260317 20:57:53.126245 3024 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:53.127274 3009 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260317 20:57:53.127429 3009 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:53.127857 3009 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:53.138413 3009 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:53.139122 3009 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:53.139329 3009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:53.148113 3009 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.252:34639
I20260317 20:57:53.148161 3076 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.252:34639 every 8 connection(s)
I20260317 20:57:53.149338 3009 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
I20260317 20:57:53.153324 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 3009
I20260317 20:57:53.153697 3077 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:53.155671 3077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap starting.
I20260317 20:57:53.176852 3077 log.cc:826] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:53.274333 1107 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:53.277328 1244 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:53.307363 3077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=264 overwritten=2 applied=262 ignored=0} inserts{seen=171 ignored=0} mutations{seen=234 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:53.307883 3077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap complete.
I20260317 20:57:53.310851 3077 raft_consensus.cc:359] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:53.311273 3077 raft_consensus.cc:740] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a5313a52eb40a3ab5d14d0d8be52f7, State: Initialized, Role: FOLLOWER
I20260317 20:57:53.311781 3077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 262, Last appended: 6.262, Last appended by leader: 262, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:53.312361 3087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:53.312479 3087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:53.313104 3077 sys_catalog.cc:565] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:53.318811 3009 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111),
I20260317 20:57:53.321136 3101 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:53.321230 3009 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:53.321369 3101 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: loading cluster ID for follower catalog manager: success
I20260317 20:57:53.326692 3101 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: acquiring CA information for follower catalog manager: success
I20260317 20:57:53.330790 3101 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:57:53.606204 1380 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:53.608098 3032 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:37145; Asking this server to re-register.
I20260317 20:57:53.608768 1380 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:53.610548 3032 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:53.652503 3105 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:57:53.652660 3105 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:53.653204 3105 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:57:53.653860 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:57:53.654067 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:57:53.654140 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:53.654320 3105 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:53.778905 3032 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:50459; Asking this server to re-register.
I20260317 20:57:53.779526 1107 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:53.780555 3032 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:50213; Asking this server to re-register.
I20260317 20:57:53.780819 3040 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:53.781123 1244 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:53.782357 3040 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:53.835891 3110 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:53.836117 3110 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:53.837337 3110 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:53.837990 3028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:53.838829 3028 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:53.838961 3027 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:53.839064 3027 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:53.839272 3110 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260317 20:57:54.058200 3105 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:57:54.058362 3105 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:54.058828 3105 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:57:54.059417 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:57:54.059571 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:57:54.059644 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:54.059775 3105 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:54.341924 3105 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:57:54.342113 3105 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:54.342568 3105 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:57:54.343150 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:57:54.343312 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:57:54.343357 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:54.343484 3105 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:54.410852 3121 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:54.410979 3121 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:54.411469 3121 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:54.412683 3028 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:54.412846 3027 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:54.412942 3027 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:54.413089 3121 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260317 20:57:54.642928 3125 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:57:54.643074 3125 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:54.643445 3125 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:57:54.644014 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:57:54.644270 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:57:54.644358 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:54.644532 3125 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:55.259634 3136 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:55.259783 3136 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:55.260241 3136 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:55.261624 3028 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:55.261776 3027 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:55.261838 3027 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:55.261999 3136 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260317 20:57:55.265952 3133 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:57:55.266189 3133 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:55.266659 3133 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:57:55.267576 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:57:55.267746 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:57:55.267815 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:55.267956 3133 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:55.566636 3133 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:57:55.566761 3133 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:55.567212 3133 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:57:55.567835 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:57:55.567991 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:57:55.568063 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:55.568279 3133 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:55.613637 411 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu with pid 3009
W20260317 20:57:55.620249 1268 connection.cc:537] client connection to 127.0.102.252:34639 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260317 20:57:56.166846 3133 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:57:56.166996 3133 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:56.167428 3133 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:57:56.168231 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:57:56.168462 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:57:56.168536 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:56.168730 3133 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:56.368139 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.252:34639
--webserver_interface=127.0.102.252
--webserver_port=38583
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260317 20:57:56.480355 3157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:56.480582 3157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:56.480659 3157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:56.484776 3157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:56.484855 3157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:56.484876 3157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:56.484897 3157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:56.489157 3157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.252:34639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.0.102.252
--webserver_port=38583
--never_fsync=true
--heap_profile_path=/tmp/kudu.3157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:56.490417 3157 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:56.491644 3157 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:56.497751 3163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:56.497931 3157 server_base.cc:1060] running on GCE node
W20260317 20:57:56.497967 3166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:56.497736 3164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:56.498682 3157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:56.499667 3157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:56.500860 3157 hybrid_clock.cc:648] HybridClock initialized: now 1773781076500835 us; error 48 us; skew 500 ppm
I20260317 20:57:56.503139 3157 webserver.cc:492] Webserver started at http://127.0.102.252:38583/ using document root <none> and password file <none>
I20260317 20:57:56.503788 3157 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:56.503909 3157 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:56.507561 3157 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260317 20:57:56.509816 3172 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:56.511152 3157 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260317 20:57:56.511317 3157 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
uuid: "15a5313a52eb40a3ab5d14d0d8be52f7"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:56.511776 3157 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:56.538852 3157 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:56.539610 3157 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:56.539810 3157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:56.548099 3157 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.252:34639
I20260317 20:57:56.548099 3224 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.252:34639 every 8 connection(s)
I20260317 20:57:56.549362 3157 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-2/data/info.pb
I20260317 20:57:56.553954 3225 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:56.554927 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 3157
I20260317 20:57:56.556792 3225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap starting.
I20260317 20:57:56.578765 3225 log.cc:826] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:56.613183 1380 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:56.718735 3225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=264 overwritten=2 applied=262 ignored=0} inserts{seen=171 ignored=0} mutations{seen=234 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:56.719256 3225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Bootstrap complete.
I20260317 20:57:56.722436 3225 raft_consensus.cc:359] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:56.722877 3225 raft_consensus.cc:740] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15a5313a52eb40a3ab5d14d0d8be52f7, State: Initialized, Role: FOLLOWER
I20260317 20:57:56.723376 3225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 262, Last appended: 6.262, Last appended by leader: 262, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:56.723917 3233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:56.724045 3233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:56.724701 3225 sys_catalog.cc:565] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:56.730847 3157 master_runner.cc:186] Error getting master registration for 127.0.102.254:45865: Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111),
I20260317 20:57:56.733049 3157 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:56.733110 3247 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:56.733168 3247 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: loading cluster ID for follower catalog manager: success
I20260317 20:57:56.736677 3247 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: acquiring CA information for follower catalog manager: success
I20260317 20:57:56.740145 3247 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:57:56.783720 1107 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:56.785521 3189 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:51867; Asking this server to re-register.
I20260317 20:57:56.786198 1107 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:56.787815 3189 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:57:56.795647 1244 heartbeater.cc:344] Connected to a master server at 127.0.102.252:34639
I20260317 20:57:56.797514 3189 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:56233; Asking this server to re-register.
I20260317 20:57:56.798098 1244 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:56.799494 3189 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:57:57.032843 3133 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:57:57.032994 3133 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:57.033509 3133 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:57:57.034271 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:57:57.034427 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:57:57.034480 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:57.034631 3133 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:57.117738 3189 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:58031; Asking this server to re-register.
I20260317 20:57:57.118292 1380 heartbeater.cc:461] Registering TS with master...
I20260317 20:57:57.119483 3189 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:57:57.120292 3233 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:57.120486 3233 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:57.121661 3233 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:57.122148 3175 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:57.123070 3176 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:57.123178 3175 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:57.123246 3175 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:57.123425 3233 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260317 20:57:57.776561 3261 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:57.776705 3261 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:57.777244 3261 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:57.778610 3176 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:57.778723 3175 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:57.778811 3175 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:57.778920 3261 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260317 20:57:58.888597 3274 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:58.888767 3274 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:58.889254 3274 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:58.890820 3175 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:57:58.890935 3176 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
I20260317 20:57:58.891052 3176 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:58.891245 3274 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260317 20:57:59.554601 411 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
/tmp/dist-test-taskbzIMi0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.254:45865
--webserver_interface=127.0.102.254
--webserver_port=37411
--builtin_ntp_servers=127.0.102.212:40383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260317 20:57:59.568112 3285 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:57:59.568274 3285 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:59.568766 3285 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:57:59.570003 3176 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865): Network error: Client connection negotiation failed: client connection to 127.0.102.254:45865: connect: Connection refused (error 111)
W20260317 20:57:59.570206 3175 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:57:59.570290 3175 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7; no voters: 5022d9ddb45c41faa9f114e2a0a31fc3, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:57:59.570421 3285 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260317 20:57:59.668247 3284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260317 20:57:59.668478 3284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260317 20:57:59.668556 3284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260317 20:57:59.672017 3284 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260317 20:57:59.672077 3284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260317 20:57:59.672099 3284 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260317 20:57:59.672147 3284 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260317 20:57:59.676148 3284 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.102.212:40383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:35517
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.102.254:45865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.102.254
--webserver_port=37411
--never_fsync=true
--heap_profile_path=/tmp/kudu.3284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 07148adc8b1ea21ab089857e39de46f7fa68ddab
build type DEBUG
built by None at 17 Mar 2026 20:43:17 UTC on bdcb31816ec0
build id 10976
I20260317 20:57:59.677232 3284 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260317 20:57:59.678368 3284 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20260317 20:57:59.683888 3296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:59.683864 3298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260317 20:57:59.683867 3295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260317 20:57:59.684079 3284 server_base.cc:1060] running on GCE node
I20260317 20:57:59.684567 3284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260317 20:57:59.685451 3284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260317 20:57:59.686628 3284 hybrid_clock.cc:648] HybridClock initialized: now 1773781079686612 us; error 37 us; skew 500 ppm
I20260317 20:57:59.688465 3284 webserver.cc:492] Webserver started at http://127.0.102.254:37411/ using document root <none> and password file <none>
I20260317 20:57:59.689038 3284 fs_manager.cc:362] Metadata directory not provided
I20260317 20:57:59.689123 3284 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260317 20:57:59.692425 3284 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260317 20:57:59.694432 3304 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260317 20:57:59.695465 3284 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260317 20:57:59.695618 3284 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data,/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
format_stamp: "Formatted at 2026-03-17 20:57:29 on dist-test-slave-kxrc"
I20260317 20:57:59.696041 3284 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260317 20:57:59.708480 3284 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20260317 20:57:59.709225 3284 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260317 20:57:59.709447 3284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260317 20:57:59.717991 3356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.102.254:45865 every 8 connection(s)
I20260317 20:57:59.717993 3284 rpc_server.cc:307] RPC server started. Bound to: 127.0.102.254:45865
I20260317 20:57:59.719409 3284 server_base.cc:1192] Dumped server information to /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/master-0/data/info.pb
I20260317 20:57:59.720788 411 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbzIMi0/build/debug/bin/kudu as pid 3284
I20260317 20:57:59.723871 3357 sys_catalog.cc:263] Verifying existing consensus state
I20260317 20:57:59.726107 3357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap starting.
I20260317 20:57:59.747076 3357 log.cc:826] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Log is configured to *not* fsync() on all Append() calls
I20260317 20:57:59.790565 1245 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:59.792546 1108 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:57:59.836211 3280 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:57:59.836364 3280 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:57:59.836830 3280 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:57:59.837622 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:57:59.837814 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:57:59.837884 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:59.838059 3280 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:59.843400 3280 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:57:59.843566 3280 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:57:59.844071 3280 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:57:59.844903 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:57:59.845063 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:57:59.845129 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:57:59.845309 3280 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:57:59.865514 3357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap replayed 1/1 log segments. Stats: ops{read=238 overwritten=0 applied=238 ignored=0} inserts{seen=159 ignored=0} mutations{seen=206 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260317 20:57:59.865962 3357 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: Bootstrap complete.
I20260317 20:57:59.868872 3357 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:59.869328 3357 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5022d9ddb45c41faa9f114e2a0a31fc3, State: Initialized, Role: FOLLOWER
I20260317 20:57:59.869889 3357 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 238, Last appended: 3.238, Last appended by leader: 238, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:57:59.870635 3366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:57:59.870785 3366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:57:59.871032 3357 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260317 20:57:59.878747 3380 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:57:59.878927 3380 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: loading cluster ID for follower catalog manager: success
I20260317 20:57:59.883102 3380 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: acquiring CA information for follower catalog manager: success
I20260317 20:57:59.883113 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:57:59.885506 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:57:59.886943 3380 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260317 20:58:00.120301 1381 heartbeater.cc:344] Connected to a master server at 127.0.102.254:45865
I20260317 20:58:00.122653 3321 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "630e777e97c141a69e35660f32b26f6d" instance_seqno: 1773781050600238) as {username='slave'} at 127.0.102.195:35353; Asking this server to re-register.
I20260317 20:58:00.123317 1381 heartbeater.cc:461] Registering TS with master...
I20260317 20:58:00.124799 3321 ts_manager.cc:194] Registered new tserver with Master: 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
I20260317 20:58:00.296694 3321 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" instance_seqno: 1773781050410029) as {username='slave'} at 127.0.102.194:33387; Asking this server to re-register.
I20260317 20:58:00.297276 1245 heartbeater.cc:461] Registering TS with master...
I20260317 20:58:00.297400 3320 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" instance_seqno: 1773781050215088) as {username='slave'} at 127.0.102.193:45785; Asking this server to re-register.
I20260317 20:58:00.298082 1108 heartbeater.cc:461] Registering TS with master...
I20260317 20:58:00.298799 3320 ts_manager.cc:194] Registered new tserver with Master: 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679)
I20260317 20:58:00.299312 3321 ts_manager.cc:194] Registered new tserver with Master: 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:58:00.391659 3388 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:58:00.391947 3388 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:00.393337 3388 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:00.393926 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:00.394891 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:58:00.397915 3199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" candidate_term: 4 candidate_status { last_received { term: 3 index: 238 } } ignore_live_leader: false dest_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" is_pre_election: true
I20260317 20:58:00.398277 3199 raft_consensus.cc:2368] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5022d9ddb45c41faa9f114e2a0a31fc3 for earlier term 4. Current term is 6.
I20260317 20:58:00.398809 3306 leader_election.cc:400] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5022d9ddb45c41faa9f114e2a0a31fc3 for earlier term 4. Current term is 6.
I20260317 20:58:00.398881 3306 leader_election.cc:403] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260317 20:58:00.399075 3388 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 3 FOLLOWER]: Advancing to term 6
I20260317 20:58:00.400966 3388 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 6 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5022d9ddb45c41faa9f114e2a0a31fc3 for earlier term 4. Current term is 6.
I20260317 20:58:00.505641 3280 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:00.505800 3280 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:00.506325 3280 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:00.507185 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:58:00.507340 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:58:00.507404 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:00.507606 3280 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:00.529131 3395 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260317 20:58:00.529261 3395 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:00.529773 3395 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
W20260317 20:58:00.531152 3175 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:58:00.533859 3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 262 } } ignore_live_leader: false dest_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" is_pre_election: true
I20260317 20:58:00.534204 3331 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15a5313a52eb40a3ab5d14d0d8be52f7 in term 6.
I20260317 20:58:00.534725 3176 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:00.534961 3395 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260317 20:58:00.535033 3395 raft_consensus.cc:493] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260317 20:58:00.535064 3395 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 6 FOLLOWER]: Advancing to term 7
I20260317 20:58:00.536815 3395 raft_consensus.cc:515] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:00.537195 3395 leader_election.cc:290] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 election: Requested vote from peers 5022d9ddb45c41faa9f114e2a0a31fc3 (127.0.102.254:45865), db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969)
I20260317 20:58:00.537667 3331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" candidate_term: 7 candidate_status { last_received { term: 6 index: 262 } } ignore_live_leader: false dest_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3"
I20260317 20:58:00.537811 3331 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 6 FOLLOWER]: Advancing to term 7
W20260317 20:58:00.538396 3175 leader_election.cc:336] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:58:00.539098 3331 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15a5313a52eb40a3ab5d14d0d8be52f7 in term 7.
I20260317 20:58:00.539402 3176 leader_election.cc:304] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 15a5313a52eb40a3ab5d14d0d8be52f7, 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:00.539573 3395 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 7 FOLLOWER]: Leader election won for term 7
I20260317 20:58:00.539801 3395 raft_consensus.cc:697] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [term 7 LEADER]: Becoming Leader. State: Replica: 15a5313a52eb40a3ab5d14d0d8be52f7, State: Running, Role: LEADER
I20260317 20:58:00.540151 3395 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 262, Committed index: 262, Last appended: 6.262, Last appended by leader: 262, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:00.542014 3399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15a5313a52eb40a3ab5d14d0d8be52f7. Latest consensus state: current_term: 7 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:58:00.542248 3399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: LEADER
I20260317 20:58:00.542618 3401 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20260317 20:58:00.545284 3401 catalog_manager.cc:679] Loaded metadata for table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182]
I20260317 20:58:00.545707 3401 catalog_manager.cc:679] Loaded metadata for table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d]
I20260317 20:58:00.545990 3401 catalog_manager.cc:679] Loaded metadata for table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad]
I20260317 20:58:00.546311 3401 catalog_manager.cc:679] Loaded metadata for table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299]
I20260317 20:58:00.546573 3401 catalog_manager.cc:679] Loaded metadata for table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498]
I20260317 20:58:00.547246 3401 catalog_manager.cc:679] Loaded metadata for table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438]
I20260317 20:58:00.547673 3401 catalog_manager.cc:679] Loaded metadata for table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543]
I20260317 20:58:00.548159 3401 catalog_manager.cc:679] Loaded metadata for table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd]
I20260317 20:58:00.548470 3401 catalog_manager.cc:679] Loaded metadata for table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06]
I20260317 20:58:00.548703 3401 catalog_manager.cc:679] Loaded metadata for table default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b]
I20260317 20:58:00.548956 3401 catalog_manager.cc:679] Loaded metadata for table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2]
I20260317 20:58:00.549419 3401 catalog_manager.cc:679] Loaded metadata for table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e]
I20260317 20:58:00.549726 3401 catalog_manager.cc:679] Loaded metadata for table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1]
I20260317 20:58:00.549957 3401 catalog_manager.cc:679] Loaded metadata for table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d]
I20260317 20:58:00.550248 3401 catalog_manager.cc:679] Loaded metadata for table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427]
I20260317 20:58:00.550475 3401 catalog_manager.cc:679] Loaded metadata for table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69]
I20260317 20:58:00.550806 3401 catalog_manager.cc:679] Loaded metadata for table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3]
I20260317 20:58:00.551448 3401 catalog_manager.cc:679] Loaded metadata for table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41]
I20260317 20:58:00.551678 3401 catalog_manager.cc:679] Loaded metadata for table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4]
I20260317 20:58:00.551909 3401 catalog_manager.cc:679] Loaded metadata for table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951]
I20260317 20:58:00.552227 3401 catalog_manager.cc:679] Loaded metadata for table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93]
I20260317 20:58:00.552446 3401 catalog_manager.cc:679] Loaded metadata for table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd]
I20260317 20:58:00.552659 3401 catalog_manager.cc:679] Loaded metadata for table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502]
I20260317 20:58:00.552887 3401 catalog_manager.cc:679] Loaded metadata for table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c]
I20260317 20:58:00.553205 3401 catalog_manager.cc:679] Loaded metadata for table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62]
I20260317 20:58:00.553431 3401 catalog_manager.cc:679] Loaded metadata for table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7]
I20260317 20:58:00.553643 3401 catalog_manager.cc:679] Loaded metadata for table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113]
I20260317 20:58:00.553876 3401 catalog_manager.cc:679] Loaded metadata for table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4]
I20260317 20:58:00.554257 3401 catalog_manager.cc:679] Loaded metadata for table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5]
I20260317 20:58:00.557000 3401 tablet_loader.cc:96] loaded metadata for tablet 1106c838e4bc4e0d91905b7d61e8584a (table default.table_e0a1ab3af8974191818e51a5608c5724 [id=110ed734bb04495784d1d8ca1a7a8498])
I20260317 20:58:00.557252 3401 tablet_loader.cc:96] loaded metadata for tablet 17b2789d9ebd49d5b97646ea55414bfa (table default.table_e4fa526f77d344718df6708418c87f82 [id=06410da5fbbd4232956782060e2ccf0d])
I20260317 20:58:00.557446 3401 tablet_loader.cc:96] loaded metadata for tablet 1947a091d5c8450abb0b7ed7acc05136 (table default.table_791a1827dff94dfc93d45ed5bfbcce82 [id=5252bc6500764ca8825af7718c54d03e])
I20260317 20:58:00.557714 3401 tablet_loader.cc:96] loaded metadata for tablet 1bc0397641de4016baca65a655b38c30 (table default.table_87b0031e8517466b85bf93c1d68fa16d [id=908584e6a5aa4ab7b658f151fc6a7c41])
I20260317 20:58:00.557907 3401 tablet_loader.cc:96] loaded metadata for tablet 1d5f2b4be23042a0b5c96eae8140f5de (table default.table_7ae68704f7cd4052955e0c7a7a3fd162 [id=67ccf689c8cc40c291fa641510e5308d])
I20260317 20:58:00.558153 3401 tablet_loader.cc:96] loaded metadata for tablet 1e084fc67777419fb5af7936ab89e8bf (table default.table_cde2029a6fbb404892afd070c4de7abd [id=be7ee71957a44bbfbfd419246984e502])
I20260317 20:58:00.558347 3401 tablet_loader.cc:96] loaded metadata for tablet 1fe62c71f1b64cecbe0019b02e4bc3e1 (table default.table_f032e881f2224caa93060a22bf502dc4 [id=c406620a80784edcbc4741933c4dde1c])
I20260317 20:58:00.558539 3401 tablet_loader.cc:96] loaded metadata for tablet 2919b2a953ef4d74955ca04b622b6c33 (table default.table_143f9036b95c45388916784f134edd5d [id=4298738fab6d487d957cf73164bf35cd])
I20260317 20:58:00.558974 3401 tablet_loader.cc:96] loaded metadata for tablet 40384fdafa1e47cc8dfa372e4b2d4a9d (table default.table_0ac761fd53a0407da10c160875b08eb2 [id=9e830bfaf0f54f649394507a011313d4])
I20260317 20:58:00.559165 3401 tablet_loader.cc:96] loaded metadata for tablet 44eb25147f54448997a7147be3de6518 (table default.table_4ff5658252364bb1bf6fa149608be43f [id=d3ad9378b2884b7b8b856a82a8cd0ff7])
I20260317 20:58:00.559549 3401 tablet_loader.cc:96] loaded metadata for tablet 492e0f23d6b74854bc68f51c8136d495 (table default.table_c10d78c7d64942d2b7eca1757de7f68b [id=265562f7c8354c4aa654a7283a601543])
I20260317 20:58:00.559751 3401 tablet_loader.cc:96] loaded metadata for tablet 4dbe1ef827b545dfa7a4aba06e254a03 (table default.table_59673e06fbb64ab38291807c2e04e319 [id=b4359316a03b48bcb97b2d377b1c5c93])
I20260317 20:58:00.560196 3401 tablet_loader.cc:96] loaded metadata for tablet 56fc6787771c43bba68a082d1010d0d9 (table default.table_6dc3bfd2de6b485098bb35884f8287fb [id=06a4801fbead41c6adfb06c624d3c9ad])
I20260317 20:58:00.560735 3401 tablet_loader.cc:96] loaded metadata for tablet 651eab88ddbe481c9da4d7f1015a4920 (table default.table_679a54af9b06407d9c33d94b850dc43b [id=e25f1c4289634fb7a06fb011b555d9b4])
I20260317 20:58:00.561761 3401 tablet_loader.cc:96] loaded metadata for tablet 7d60f1c4eba344a3bbf72ab296b68843 (table default.table_a9891e641d7144228ae4fa567a20f67d [id=46afec8330f8417e8d3811d32eda4b06])
I20260317 20:58:00.562170 3401 tablet_loader.cc:96] loaded metadata for tablet a78fdc83a3d54554a08f01915f102f6e (table default.table_ac887ad780da4e9396fee8f025bfd410 [id=fa7454b6e5ff4f85aa96a7ea73b601e5])
I20260317 20:58:00.562469 3401 tablet_loader.cc:96] loaded metadata for tablet aa23ce23d4b0465baf378859e9ad018c (table default.table_e2da314b82a64ac3abd49740cd983744 [id=779672e78a3549a48fef75a3ef465b69])
I20260317 20:58:00.562896 3401 tablet_loader.cc:96] loaded metadata for tablet b5739d6cb9a84de78767b471608f1671 (table default.table_3f1239b88bdb48df909e4bc3f433a9bb [id=4c6775ab37ed4575bdfbcf3930e3acd2])
I20260317 20:58:00.563175 3401 tablet_loader.cc:96] loaded metadata for tablet beaabcef2bb4416499d418c8ffd0a718 (table default.table_ffa8292a8cda469787b621281ed2203c [id=d0dc2033a1814ff399f25e0d0f567c62])
I20260317 20:58:00.563524 3401 tablet_loader.cc:96] loaded metadata for tablet c1aabdbda61848958c6a5dd40f8795d8 (table default.table_79079ba13bf044beba452a11826c4ca8 [id=7eb5962822e84dfd9a9180115824aeb3])
I20260317 20:58:00.563704 3401 tablet_loader.cc:96] loaded metadata for tablet c8a15f27b2bb42cea16e96588aa9d2a1 (table default.table_881b6f17f7bc4a1ab950e332bd29d36c [id=76e2ba1634604600866a199c9879c427])
I20260317 20:58:00.564142 3401 tablet_loader.cc:96] loaded metadata for tablet d5cd4964ea9d4a2aa4db0bd970b854ea (table default.table_a5ab9704ed704e619e80ab8d4d623a68 [id=a4ba9bce277146cc8c2a1cfcbf90f951])
I20260317 20:58:00.564328 3401 tablet_loader.cc:96] loaded metadata for tablet d9a43741bfda4ccdb070e74b9f638766 (table default.table_79c743594792412ea112f4cd57316c36 [id=25284c95383d4736bd72836dbc5b8438])
I20260317 20:58:00.564755 3401 tablet_loader.cc:96] loaded metadata for tablet dffa580b372540689e21e4f2a9de8661 (table default.table_b9b69d0268774a8a8a0d7fb130e53075 [id=056ee1541039492b9cf64fc4ca835182])
I20260317 20:58:00.564944 3401 tablet_loader.cc:96] loaded metadata for tablet e4124783269f438c803d4fb68f223d20 (table default.table_4b318a4173584e1298cc874712d94e47 [id=0e789a2f9f64400eb7e38a789e0ec299])
I20260317 20:58:00.565604 3401 tablet_loader.cc:96] loaded metadata for tablet f435bb41bb6e411cb6bfb471312b6085 (table default.table_89e9501cdfa143e797b1116ee618deea [id=d7c13d82129f4480806573f2a089e113])
I20260317 20:58:00.565970 3401 tablet_loader.cc:96] loaded metadata for tablet fc76f8e8a4af47aba2a64bd60fc6941f (table default.table_fb41c97ca0a9409c963fbe195007a57f [id=bc541149fbdd48ea9861ed3c108807cd])
I20260317 20:58:00.566323 3401 tablet_loader.cc:96] loaded metadata for tablet fd5cc18aee45453aa02797da17b5554f (table default.table_0544e71a0de540529c2f7865976f74f3 [id=4c1e17a5a7714446bfd8dbc5d5abb95b])
I20260317 20:58:00.566524 3401 tablet_loader.cc:96] loaded metadata for tablet fef79942fe3440baa17a42f660b80be6 (table default.table_985a38ed1c344c8386f0b656b4a5cc95 [id=60e57136849e4d3f946131445d27a0c1])
I20260317 20:58:00.566721 3401 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20260317 20:58:00.568038 3401 catalog_manager.cc:1269] Loaded cluster ID: 78cb02f05de74b1ea9a3cda9ca6bf4f0
I20260317 20:58:00.568109 3401 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20260317 20:58:00.569533 3401 catalog_manager.cc:1514] Loading token signing keys...
I20260317 20:58:00.570861 3401 catalog_manager.cc:6055] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Loaded TSK: 0
I20260317 20:58:00.571682 3401 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20260317 20:58:00.573081 3401 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20260317 20:58:00.574389 3401 catalog_manager.cc:5893] Last processed Hive Metastore notification event ID: 75
I20260317 20:58:00.587538 3189 master_service.cc:954] ReplaceTablet: received request to replace tablet fc76f8e8a4af47aba2a64bd60fc6941f from {username='slave'} at 127.0.0.1:40886
I20260317 20:58:00.587777 3187 master_service.cc:954] ReplaceTablet: received request to replace tablet 1106c838e4bc4e0d91905b7d61e8584a from {username='slave'} at 127.0.0.1:40886
I20260317 20:58:00.588034 3185 master_service.cc:954] ReplaceTablet: received request to replace tablet 44eb25147f54448997a7147be3de6518 from {username='slave'} at 127.0.0.1:40886
I20260317 20:58:00.588294 3181 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_e0a1ab3af8974191818e51a5608c5724" } modify_external_catalogs: true
I20260317 20:58:00.588442 3181 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_e0a1ab3af8974191818e51a5608c5724" } modify_external_catalogs: true
I20260317 20:58:00.589062 3183 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40886:
name: "default.Table_234c371e883449c4ab6fc105a42b24fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:58:00.589474 3180 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" } modify_external_catalogs: true
I20260317 20:58:00.589531 3188 master_service.cc:954] ReplaceTablet: received request to replace tablet e4124783269f438c803d4fb68f223d20 from {username='slave'} at 127.0.0.1:40886
I20260317 20:58:00.589578 3180 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_a5ab9704ed704e619e80ab8d4d623a68" } modify_external_catalogs: true
I20260317 20:58:00.589756 3182 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40886:
name: "default.Table_9c0299624ff84be09887bc390f45fffa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:58:00.589988 3186 master_service.cc:954] ReplaceTablet: received request to replace tablet aa23ce23d4b0465baf378859e9ad018c from {username='slave'} at 127.0.0.1:40886
I20260317 20:58:00.590260 3184 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_0544e71a0de540529c2f7865976f74f3" } new_table_name: "default.Table_7d2b916f34184334960bf278e6737669" modify_external_catalogs: true
I20260317 20:58:00.592190 3331 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Refusing update from remote peer 15a5313a52eb40a3ab5d14d0d8be52f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 238. Preceding OpId from leader: term: 7 index: 264. (index mismatch)
I20260317 20:58:00.592949 3399 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 263, Last known committed idx: 238, Time since last communication: 0.000s
W20260317 20:58:00.593479 3175 consensus_peers.cc:597] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 -> Peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Couldn't send request to peer db5e708fd6404c0daa842bfc7e8f4806. Status: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20260317 20:58:00.593983 3246 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 7 out of 9 received events: NotificationEvent(eventId=76, eventTime=1773781059, eventType=DROP_TABLE, dbName=default, tableName=table_e0a1ab3af8974191818e51a5608c5724, message={"server":"","servicePrincipal":"","db":"default","table":"table_e0a1ab3af8974191818e51a5608c5724","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_e0a1ab3af8974191818e51a5608c5724\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781056},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_e0a1ab3af8974191818e51a5608c5724\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_e0a1ab3af8974191818e51a5608c5724\",\"kudu.table_id\":\"110ed734bb04495784d1d8ca1a7a8498\",\"transient_lastDdlTime\":\"1773781056\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781059}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=77, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_0544e71a0de540529c2f7865976f74f3, message={"server":"","servicePrincipal":"","db":"default","table":"table_0544e71a0de540529c2f7865976f74f3","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_0544e71a0de540529c2f7865976f74f3\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781059},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_0544e71a0de540529c2f7865976f74f3\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_0544e71a0de540529c2f7865976f74f3\",\"kudu.table_id\":\"4c1e17a5a7714446bfd8dbc5d5abb95b\",\"transient_lastDdlTime\":\"1773781059\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1773781060, eventType=ALTER_TABLE, dbName=default, tableName=table_15d4ddf21b5d49f7bf9245c9e7e07e0e, message={"server":"","servicePrincipal":"","db":"default","table":"table_ffa8292a8cda469787b621281ed2203c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_ffa8292a8cda469787b621281ed2203c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_ffa8292a8cda469787b621281ed2203c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_ffa8292a8cda469787b621281ed2203c\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781055},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_15d4ddf21b5d49f7bf9245c9e7e07e0e\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_15d4ddf21b5d49f7bf9245c9e7e07e0e\",\"kudu.table_id\":\"d0dc2033a1814ff399f25e0d0f567c62\",\"transient_lastDdlTime\":\"1773781055\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_4b318a4173584e1298cc874712d94e47, message={"server":"","servicePrincipal":"","db":"default","table":"table_4b318a4173584e1298cc874712d94e47","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_4b318a4173584e1298cc874712d94e47\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781053},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_4b318a4173584e1298cc874712d94e47\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_4b318a4173584e1298cc874712d94e47\",\"kudu.table_id\":\"0e789a2f9f64400eb7e38a789e0ec299\",\"transient_lastDdlTime\":\"1773781053\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1773781060, eventType=CREATE_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"transient_lastDdlTime\":\"1773781060\",\"comment\":\"\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_a5ab9704ed704e619e80ab8d4d623a68, message={"server":"","servicePrincipal":"","db":"default","table":"table_a5ab9704ed704e619e80ab8d4d623a68","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a5ab9704ed704e619e80ab8d4d623a68\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781051},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_a5ab9704ed704e619e80ab8d4d623a68\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a5ab9704ed704e619e80ab8d4d623a68\",\"transient_lastDdlTime\":\"1773781051\",\"kudu.table_id\":\"a4ba9bce277146cc8c2a1cfcbf90f951\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1773781060, eventType=DROP_TABLE, dbName=default, tableName=table_9c0299624ff84be09887bc390f45fffa, message={"server":"","servicePrincipal":"","db":"default","table":"table_9c0299624ff84be09887bc390f45fffa","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_9c0299624ff84be09887bc390f45fffa\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1773781060},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/warehouse/table_9c0299624ff84be09887bc390f45fffa\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_9c0299624ff84be09887bc390f45fffa\",\"transient_lastDdlTime\":\"1773781060\",\"kudu.table_id\":\"c93ebc62702e4b9bac97b238a6159d2b\",\"comment\":\"\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.master_addresses\":\"127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639\",\"kudu.cluster_id\":\"78cb02f05de74b1ea9a3cda9ca6bf4f0\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1773781060}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7fc7dfd79dcd google::LogMessage::Fail() at ??:0
@ 0x7fc7dfd7db93 google::LogMessage::SendToLog() at ??:0
@ 0x7fc7dfd797cc google::LogMessage::Flush() at ??:0
@ 0x7fc7dfd79a11 google::LogMessage::~LogMessage() at ??:0
I20260317 20:58:00.605307 3388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15a5313a52eb40a3ab5d14d0d8be52f7. Latest consensus state: current_term: 7 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:58:00.605449 3388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:58:00.605535 3388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:58:00.605599 3388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:58:00.605662 3388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:58:00.605726 3388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:58:00.605785 3388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:58:00.605839 3388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fc7e4f4c847 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260317 20:58:00.613741 3404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:58:00.613909 3404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7 [sys.catalog]: This master's current role is: LEADER
@ 0x7fc7e4f4b75e kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260317 20:58:00.615724 3407 mvcc.cc:204] Tried to move back new op lower bound from 7265407306110701568 to 7265407224459849728. Current Snapshot: MvccSnapshot[applied={T|T < 7265407306106667008}]
I20260317 20:58:00.616398 3416 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } } }
I20260317 20:58:00.616518 3416 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [sys.catalog]: This master's current role is: FOLLOWER
I20260317 20:58:00.617717 3188 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Sending DeleteTablet for 3 replicas of tablet e4124783269f438c803d4fb68f223d20
I20260317 20:58:00.617877 3185 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Sending DeleteTablet for 3 replicas of tablet 44eb25147f54448997a7147be3de6518
I20260317 20:58:00.617885 3186 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Sending DeleteTablet for 3 replicas of tablet aa23ce23d4b0465baf378859e9ad018c
I20260317 20:58:00.618955 3186 catalog_manager.cc:6741] ReplaceTablet: tablet aa23ce23d4b0465baf378859e9ad018c deleted and replaced by tablet 3b5616082cd5494e8e3f00c6ce3ceee9
@ 0x7fc7e4f4aec1 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20260317 20:58:00.619252 3186 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_a9891e641d7144228ae4fa567a20f67d" } new_table_name: "default.Table_db0d09da77234c72a4649ad59de113e0" modify_external_catalogs: true
I20260317 20:58:00.620828 3187 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Sending DeleteTablet for 3 replicas of tablet 1106c838e4bc4e0d91905b7d61e8584a
I20260317 20:58:00.621189 3187 catalog_manager.cc:6741] ReplaceTablet: tablet 1106c838e4bc4e0d91905b7d61e8584a deleted and replaced by tablet 2e2acd4bc6634b6d85e9dfb9e83a61b1
I20260317 20:58:00.621409 3187 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_143f9036b95c45388916784f134edd5d" } modify_external_catalogs: true
I20260317 20:58:00.621548 3187 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_143f9036b95c45388916784f134edd5d" } modify_external_catalogs: true
I20260317 20:58:00.621901 3185 catalog_manager.cc:6741] ReplaceTablet: tablet 44eb25147f54448997a7147be3de6518 deleted and replaced by tablet 5bd7276795b84400a79a8be36f1fc706
I20260317 20:58:00.622167 3185 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40886:
name: "default.Table_6bacc979980f45f3bff68d78ea0c114d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260317 20:58:00.622633 3189 catalog_manager.cc:5958] T 00000000000000000000000000000000 P 15a5313a52eb40a3ab5d14d0d8be52f7: Sending DeleteTablet for 3 replicas of tablet fc76f8e8a4af47aba2a64bd60fc6941f
I20260317 20:58:00.622921 3189 catalog_manager.cc:6741] ReplaceTablet: tablet fc76f8e8a4af47aba2a64bd60fc6941f deleted and replaced by tablet 6b7a5b02d94348d3ae5e12dadd124dfb
I20260317 20:58:00.623096 3189 catalog_manager.cc:3544] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40886:
table { table_name: "default.Table_df3d165713f44a8b87b980f60d112d34" } new_table_name: "default.Table_6dc3bfd2de6b485098bb35884f8287fb" modify_external_catalogs: true
I20260317 20:58:00.623384 3188 catalog_manager.cc:6741] ReplaceTablet: tablet e4124783269f438c803d4fb68f223d20 deleted and replaced by tablet bcad289a6164468a8537c837ec672314
@ 0x7fc7e4f505c8 _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20260317 20:58:00.623574 3188 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40886:
name: "default.Table_489d4d491c244f80ad787d520144e905"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x5600fb49f18a std::function<>::operator()() at ??:0
@ 0x7fc7e1279214 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc7e1a616db start_thread at ??:0
@ 0x7fc7def3061f clone at ??:0
I20260317 20:58:00.636590 1039 tablet_service.cc:1558] Processing DeleteTablet for tablet e4124783269f438c803d4fb68f223d20 with delete_type TABLET_DATA_DELETED (replaced by tablet bcad289a6164468a8537c837ec672314) from {username='slave'} at 127.0.0.1:38842
I20260317 20:58:00.636854 1041 tablet_service.cc:1558] Processing DeleteTablet for tablet 44eb25147f54448997a7147be3de6518 with delete_type TABLET_DATA_DELETED (replaced by tablet 5bd7276795b84400a79a8be36f1fc706) from {username='slave'} at 127.0.0.1:38842
I20260317 20:58:00.636906 1037 tablet_service.cc:1558] Processing DeleteTablet for tablet aa23ce23d4b0465baf378859e9ad018c with delete_type TABLET_DATA_DELETED (replaced by tablet 3b5616082cd5494e8e3f00c6ce3ceee9) from {username='slave'} at 127.0.0.1:38842
I20260317 20:58:00.637034 1040 tablet_service.cc:1558] Processing DeleteTablet for tablet 1106c838e4bc4e0d91905b7d61e8584a with delete_type TABLET_DATA_DELETED (replaced by tablet 2e2acd4bc6634b6d85e9dfb9e83a61b1) from {username='slave'} at 127.0.0.1:38842
I20260317 20:58:00.637058 1038 tablet_service.cc:1558] Processing DeleteTablet for tablet fc76f8e8a4af47aba2a64bd60fc6941f with delete_type TABLET_DATA_DELETED (replaced by tablet 6b7a5b02d94348d3ae5e12dadd124dfb) from {username='slave'} at 127.0.0.1:38842
I20260317 20:58:00.637844 3427 tablet_replica.cc:333] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:58:00.638015 3427 raft_consensus.cc:2243] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:58:00.638187 3427 raft_consensus.cc:2272] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:58:00.638561 3427 ts_tablet_manager.cc:1916] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:58:00.640554 3427 ts_tablet_manager.cc:1929] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:58:00.640619 3427 log.cc:1199] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/e4124783269f438c803d4fb68f223d20
I20260317 20:58:00.640817 3427 ts_tablet_manager.cc:1950] T e4124783269f438c803d4fb68f223d20 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:58:00.641793 3427 tablet_replica.cc:333] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:58:00.641953 3427 raft_consensus.cc:2243] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:58:00.642238 3427 raft_consensus.cc:2272] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:58:00.642663 3427 ts_tablet_manager.cc:1916] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:58:00.645107 3427 ts_tablet_manager.cc:1929] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260317 20:58:00.645181 3427 log.cc:1199] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/44eb25147f54448997a7147be3de6518
I20260317 20:58:00.645464 3427 ts_tablet_manager.cc:1950] T 44eb25147f54448997a7147be3de6518 P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:58:00.646247 3427 tablet_replica.cc:333] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:58:00.646395 3427 raft_consensus.cc:2243] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:58:00.646526 3427 raft_consensus.cc:2272] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:58:00.646961 3427 ts_tablet_manager.cc:1916] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:58:00.649384 3427 ts_tablet_manager.cc:1929] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:58:00.649456 3427 log.cc:1199] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/aa23ce23d4b0465baf378859e9ad018c
I20260317 20:58:00.649737 3427 ts_tablet_manager.cc:1950] T aa23ce23d4b0465baf378859e9ad018c P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:58:00.650527 3427 tablet_replica.cc:333] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:58:00.650660 3427 raft_consensus.cc:2243] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 LEADER]: Raft consensus shutting down.
I20260317 20:58:00.650890 3427 raft_consensus.cc:2272] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:58:00.651306 3427 ts_tablet_manager.cc:1916] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260317 20:58:00.653487 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 1: this message will repeat every 5th retry.
I20260317 20:58:00.653534 3427 ts_tablet_manager.cc:1929] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260317 20:58:00.653607 3427 log.cc:1199] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/1106c838e4bc4e0d91905b7d61e8584a
I20260317 20:58:00.653882 3427 ts_tablet_manager.cc:1950] T 1106c838e4bc4e0d91905b7d61e8584a P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
I20260317 20:58:00.654533 3427 tablet_replica.cc:333] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: stopping tablet replica
I20260317 20:58:00.654691 3427 raft_consensus.cc:2243] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260317 20:58:00.654815 3427 raft_consensus.cc:2272] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260317 20:58:00.655197 3427 ts_tablet_manager.cc:1916] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260317 20:58:00.657367 3427 ts_tablet_manager.cc:1929] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260317 20:58:00.657442 3427 log.cc:1199] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting WAL directory at /tmp/dist-test-taskbzIMi0/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1773781030279251-411-0/minicluster-data/ts-0/wal/wals/fc76f8e8a4af47aba2a64bd60fc6941f
I20260317 20:58:00.657706 3427 ts_tablet_manager.cc:1950] T fc76f8e8a4af47aba2a64bd60fc6941f P 92d68c1a3a2642cca908f2c7e9d7e13a: Deleting consensus metadata
W20260317 20:58:00.755971 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 1: this message will repeat every 5th retry.
W20260317 20:58:00.805502 995 connection.cc:537] server connection from 127.0.0.1:38842 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:58:00.805781 3425 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:58:00.621352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41514 (local address 127.0.102.194:40679)
0317 20:58:00.624161 (+ 2809us) server_negotiation.cc:207] Beginning negotiation
0317 20:58:00.624166 (+ 5us) server_negotiation.cc:400] Waiting for connection header
0317 20:58:00.624178 (+ 12us) server_negotiation.cc:408] Connection header received
0317 20:58:00.624218 (+ 40us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0317 20:58:00.624221 (+ 3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0317 20:58:00.624262 (+ 41us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0317 20:58:00.624347 (+ 85us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0317 20:58:00.625339 (+ 992us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0317 20:58:00.626214 (+ 875us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0317 20:58:00.805609 (+179395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41514: BlockingRecv error: recv got EOF from 127.0.0.1:41514 (error 108)
Metrics: {"server-negotiator.queue_time_us":2725,"thread_start_us":70,"threads_started":1}
W20260317 20:58:00.805804 3424 negotiation.cc:337] Failed RPC negotiation. Trace:
0317 20:58:00.620890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41612 (local address 127.0.102.195:46847)
0317 20:58:00.624867 (+ 3977us) server_negotiation.cc:207] Beginning negotiation
0317 20:58:00.624872 (+ 5us) server_negotiation.cc:400] Waiting for connection header
0317 20:58:00.624884 (+ 12us) server_negotiation.cc:408] Connection header received
0317 20:58:00.624925 (+ 41us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0317 20:58:00.624928 (+ 3us) server_negotiation.cc:462] Received NEGOTIATE request from client
0317 20:58:00.624975 (+ 47us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0317 20:58:00.635912 (+ 10937us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0317 20:58:00.636029 (+ 117us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
0317 20:58:00.637554 (+ 1525us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
0317 20:58:00.805627 (+168073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41612: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":3896,"thread_start_us":70,"threads_started":1}
W20260317 20:58:00.806399 995 connection.cc:537] client connection to 127.0.102.252:34639 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:58:00.806452 1268 connection.cc:537] client connection to 127.0.102.252:34639 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260317 20:58:00.806881 1388 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.102.252:34639)
W20260317 20:58:00.807057 1388 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.102.252:34639)
W20260317 20:58:00.807253 1388 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.102.252:34639)
W20260317 20:58:00.826195 1388 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.102.252:34639)
W20260317 20:58:01.112215 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 1: this message will repeat every 5th retry.
I20260317 20:58:01.131775 3440 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:01.131937 3440 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:01.132555 3440 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:01.133780 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:01.133919 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:01.134014 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:01.134263 3440 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:58:01.657671 3402 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:01.657837 3402 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:01.658350 3402 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:01.659090 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:58:01.659804 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:58:01.659891 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:01.660074 3402 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:01.661723 3449 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:01.661829 3449 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:01.662317 3449 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:01.663528 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:01.663619 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:01.663671 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:01.663817 3449 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:58:01.785646 3402 raft_consensus.cc:493] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:01.785830 3402 raft_consensus.cc:515] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:58:01.786345 3402 leader_election.cc:290] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:58:01.786700 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eb25147f54448997a7147be3de6518" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
W20260317 20:58:01.787226 1133 leader_election.cc:343] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 44eb25147f54448997a7147be3de6518
I20260317 20:58:01.787346 1133 leader_election.cc:304] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:01.787528 3402 raft_consensus.cc:2749] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:01.856237 3444 raft_consensus.cc:493] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:01.856376 3444 raft_consensus.cc:515] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:58:01.856845 3444 leader_election.cc:290] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:58:01.857255 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1106c838e4bc4e0d91905b7d61e8584a" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
W20260317 20:58:01.857574 1269 leader_election.cc:343] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a
I20260317 20:58:01.857666 1268 leader_election.cc:304] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 630e777e97c141a69e35660f32b26f6d; no voters: 35518b51259b46d1b9b5e82b6841057b, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:01.857838 3444 raft_consensus.cc:2749] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:02.039465 3444 raft_consensus.cc:493] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:02.039623 3444 raft_consensus.cc:515] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:58:02.040114 3444 leader_election.cc:290] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:02.040727 1269 leader_election.cc:343] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 44eb25147f54448997a7147be3de6518
I20260317 20:58:02.040756 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eb25147f54448997a7147be3de6518" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b" is_pre_election: true
I20260317 20:58:02.040918 1197 raft_consensus.cc:2468] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 1.
I20260317 20:58:02.041208 1268 leader_election.cc:304] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters: 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:02.041386 3444 raft_consensus.cc:2804] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260317 20:58:02.041448 3444 raft_consensus.cc:493] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:02.041491 3444 raft_consensus.cc:3060] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Advancing to term 2
I20260317 20:58:02.042412 3444 raft_consensus.cc:515] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:58:02.042755 3444 leader_election.cc:290] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 election: Requested vote from peers 35518b51259b46d1b9b5e82b6841057b (127.0.102.194:40679), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:58:02.043040 1197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44eb25147f54448997a7147be3de6518" candidate_uuid: "630e777e97c141a69e35660f32b26f6d" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "35518b51259b46d1b9b5e82b6841057b"
I20260317 20:58:02.043167 1197 raft_consensus.cc:3060] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Advancing to term 2
W20260317 20:58:02.043442 1269 leader_election.cc:343] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 44eb25147f54448997a7147be3de6518
I20260317 20:58:02.044106 1197 raft_consensus.cc:2468] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 630e777e97c141a69e35660f32b26f6d in term 2.
I20260317 20:58:02.044448 1268 leader_election.cc:304] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters: 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:02.044663 3444 raft_consensus.cc:2804] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 2 FOLLOWER]: Leader election won for term 2
I20260317 20:58:02.044772 3444 raft_consensus.cc:697] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [term 2 LEADER]: Becoming Leader. State: Replica: 630e777e97c141a69e35660f32b26f6d, State: Running, Role: LEADER
I20260317 20:58:02.044943 3444 consensus_queue.cc:237] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:58:02.076570 3402 raft_consensus.cc:493] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:02.076694 3402 raft_consensus.cc:515] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:58:02.077140 3402 leader_election.cc:290] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:58:02.077569 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1106c838e4bc4e0d91905b7d61e8584a" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d" is_pre_election: true
I20260317 20:58:02.077702 1332 raft_consensus.cc:2468] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 1.
W20260317 20:58:02.077896 1133 leader_election.cc:343] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a
I20260317 20:58:02.078177 1133 leader_election.cc:304] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters: 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:02.078344 3402 raft_consensus.cc:2804] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260317 20:58:02.078411 3402 raft_consensus.cc:493] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:02.078462 3402 raft_consensus.cc:3060] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Advancing to term 2
I20260317 20:58:02.079581 3402 raft_consensus.cc:515] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:58:02.079989 3402 leader_election.cc:290] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 election: Requested vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
I20260317 20:58:02.080310 1332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1106c838e4bc4e0d91905b7d61e8584a" candidate_uuid: "35518b51259b46d1b9b5e82b6841057b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "630e777e97c141a69e35660f32b26f6d"
I20260317 20:58:02.080420 1332 raft_consensus.cc:3060] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 1 FOLLOWER]: Advancing to term 2
W20260317 20:58:02.080665 1133 leader_election.cc:343] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a
I20260317 20:58:02.081385 1332 raft_consensus.cc:2468] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35518b51259b46d1b9b5e82b6841057b in term 2.
I20260317 20:58:02.081772 1133 leader_election.cc:304] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b, 630e777e97c141a69e35660f32b26f6d; no voters: 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:02.081951 3402 raft_consensus.cc:2804] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 2 FOLLOWER]: Leader election won for term 2
I20260317 20:58:02.082090 3402 raft_consensus.cc:697] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [term 2 LEADER]: Becoming Leader. State: Replica: 35518b51259b46d1b9b5e82b6841057b, State: Running, Role: LEADER
I20260317 20:58:02.082247 3402 consensus_queue.cc:237] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } }
I20260317 20:58:02.134248 411 master-stress-test.cc:577] Killing test thread 1/25
W20260317 20:58:02.425284 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 1: this message will repeat every 5th retry.
I20260317 20:58:02.454305 1197 raft_consensus.cc:1275] T 44eb25147f54448997a7147be3de6518 P 35518b51259b46d1b9b5e82b6841057b [term 2 FOLLOWER]: Refusing update from remote peer 630e777e97c141a69e35660f32b26f6d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260317 20:58:02.454779 3444 consensus_queue.cc:1048] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260317 20:58:02.597286 1332 raft_consensus.cc:1275] T 1106c838e4bc4e0d91905b7d61e8584a P 630e777e97c141a69e35660f32b26f6d [term 2 FOLLOWER]: Refusing update from remote peer 35518b51259b46d1b9b5e82b6841057b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260317 20:58:02.597816 3402 consensus_queue.cc:1048] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b [LEADER]: Connected to new peer: Peer: permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260317 20:58:02.601375 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 1: this message will repeat every 5th retry.
I20260317 20:58:02.707949 3464 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:02.708096 3464 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:02.708684 3464 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:02.710007 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:02.710172 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:02.710265 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:02.710457 3464 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:58:03.402343 3469 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:03.402510 3469 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:03.402953 3469 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:03.404137 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:03.404269 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:03.404356 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:03.404520 3469 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:58:04.485913 3461 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:04.486145 3461 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:58:04.486658 3461 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:04.487617 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:58:04.487792 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:58:04.487870 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:04.488037 3461 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:04.887854 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:04.887988 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:58:04.988476 3483 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:04.988611 3483 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:04.989099 3483 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:04.990306 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 20:58:04.990417 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:58:04.990499 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:04.990629 3483 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 20:58:05.724133 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 6: this message will repeat every 5th retry.
W20260317 20:58:05.855468 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 6: this message will repeat every 5th retry.
W20260317 20:58:05.921515 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 6: this message will repeat every 5th retry.
I20260317 20:58:05.998438 3491 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:05.998584 3491 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:05.998966 3491 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:05.999594 3306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111) [suppressed 10 similar messages]
W20260317 20:58:06.000452 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:06.000633 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:06.000715 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:06.000905 3491 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:58:06.880043 3490 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:06.880157 3490 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:06.880558 3490 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:06.881242 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:58:06.881356 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:58:06.881426 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:06.881639 3490 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:07.062711 3501 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:07.062845 3501 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:07.063349 3501 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:07.064697 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:07.064813 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:07.064941 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:07.065111 3501 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 20:58:07.351430 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 6: this message will repeat every 5th retry.
W20260317 20:58:07.573585 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 6: this message will repeat every 5th retry.
I20260317 20:58:07.765357 3490 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:07.765563 3490 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:07.766259 3490 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:07.767021 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:58:07.767606 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:58:07.767696 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:07.767921 3490 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:07.800920 3490 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:07.801083 3490 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:07.801568 3490 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:07.802441 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:58:07.802703 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:58:07.802793 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:07.802935 3490 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:08.568261 3507 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:08.568463 3507 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:58:08.568893 3507 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:08.570325 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:58:08.570521 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:58:08.570587 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:08.570777 3507 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:09.890134 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:09.890276 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:58:10.340773 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 11: this message will repeat every 5th retry.
W20260317 20:58:10.361629 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 11: this message will repeat every 5th retry.
I20260317 20:58:10.476832 3518 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:10.476979 3518 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:10.477490 3518 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:10.478835 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:10.478930 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:10.479018 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:10.479139 3518 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 20:58:11.073076 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 11: this message will repeat every 5th retry.
W20260317 20:58:12.289211 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 11: this message will repeat every 5th retry.
W20260317 20:58:12.416635 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 11: this message will repeat every 5th retry.
I20260317 20:58:12.601879 3531 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:12.602026 3531 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:12.602550 3531 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:12.603470 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:58:12.603663 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:58:12.603729 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:12.603942 3531 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:14.258972 3548 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:14.259130 3548 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:14.259600 3548 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:14.260145 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260317 20:58:14.260860 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 20:58:14.260973 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:58:14.261055 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:14.261245 3548 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:58:14.892554 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:14.892668 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:58:15.034585 3531 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:15.034744 3531 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:15.035228 3531 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:15.036110 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:58:15.036273 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:58:15.036350 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:15.036504 3531 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:58:15.187872 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 16: this message will repeat every 5th retry.
W20260317 20:58:15.224959 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 16: this message will repeat every 5th retry.
I20260317 20:58:15.640524 3531 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:15.640693 3531 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:15.641167 3531 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:15.642117 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:58:15.642313 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:58:15.642372 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:15.642519 3531 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:58:15.933748 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 16: this message will repeat every 5th retry.
W20260317 20:58:17.010104 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 16: this message will repeat every 5th retry.
W20260317 20:58:17.117290 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 16: this message will repeat every 5th retry.
I20260317 20:58:18.495358 3531 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:18.495648 3531 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:18.496110 3531 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:18.496975 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:58:18.497169 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:58:18.497232 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:18.497426 3531 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:19.894567 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:19.894685 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:58:20.158450 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 21: this message will repeat every 5th retry.
W20260317 20:58:20.227941 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 21: this message will repeat every 5th retry.
I20260317 20:58:20.624761 3584 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:20.624899 3584 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:20.625411 3584 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:20.626209 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:58:20.626408 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:58:20.626477 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:20.626608 3584 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:58:20.965142 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 21: this message will repeat every 5th retry.
I20260317 20:58:21.578527 3592 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:21.578661 3592 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:21.579121 3592 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:21.579808 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:58:21.579964 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:58:21.580024 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:21.580194 3592 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:58:21.771028 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 21: this message will repeat every 5th retry.
W20260317 20:58:22.210381 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 21: this message will repeat every 5th retry.
I20260317 20:58:22.950759 3599 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:22.950910 3599 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:22.951458 3599 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:22.952100 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:58:22.952267 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:58:22.952327 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:22.952486 3599 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:24.771077 3599 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:24.771204 3599 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:58:24.771649 3599 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:24.773146 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:58:24.773443 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:58:24.773521 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:24.773732 3604 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:24.896778 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:24.896945 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:58:25.252676 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 26: this message will repeat every 5th retry.
W20260317 20:58:25.546924 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 26: this message will repeat every 5th retry.
W20260317 20:58:25.965655 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 26: this message will repeat every 5th retry.
I20260317 20:58:26.162879 3599 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:26.163028 3599 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:26.163475 3599 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:26.164324 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:58:26.164517 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:58:26.164582 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:26.164775 3599 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:26.173915 3619 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:26.174161 3619 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:26.174633 3619 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:26.175254 3306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 20:58:26.176103 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:26.176229 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:26.176303 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:26.176446 3619 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 20:58:26.985275 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 26: this message will repeat every 5th retry.
W20260317 20:58:27.035427 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 26: this message will repeat every 5th retry.
I20260317 20:58:29.168618 3628 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:29.168782 3628 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:58:29.169181 3628 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:29.170079 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:58:29.170259 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:58:29.170331 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:29.170495 3628 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:29.899031 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:29.899189 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:58:30.587371 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 31: this message will repeat every 5th retry.
W20260317 20:58:30.719367 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 31: this message will repeat every 5th retry.
W20260317 20:58:30.849035 1109 heartbeater.cc:646] Failed to heartbeat to 127.0.102.253:38969 (88 consecutive failures): Network error: Failed to ping master at 127.0.102.253:38969: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:31.142728 1382 heartbeater.cc:646] Failed to heartbeat to 127.0.102.253:38969 (271 consecutive failures): Network error: Failed to ping master at 127.0.102.253:38969: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:31.142980 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 31: this message will repeat every 5th retry.
W20260317 20:58:31.287418 1246 heartbeater.cc:646] Failed to heartbeat to 127.0.102.253:38969 (121 consecutive failures): Network error: Failed to ping master at 127.0.102.253:38969: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:31.855988 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 31: this message will repeat every 5th retry.
W20260317 20:58:31.875895 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 31: this message will repeat every 5th retry.
I20260317 20:58:32.441576 3641 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:32.441726 3641 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:32.442263 3641 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:32.443298 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:58:32.443439 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:58:32.443537 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:32.443765 3641 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:34.906906 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:34.907044 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:58:35.140601 3661 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:35.140763 3661 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:58:35.141239 3661 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:35.141726 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 20:58:35.142587 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:35.142696 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:35.142829 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:35.143023 3661 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 20:58:35.585143 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 36: this message will repeat every 5th retry.
W20260317 20:58:35.973567 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 36: this message will repeat every 5th retry.
W20260317 20:58:36.044793 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 36: this message will repeat every 5th retry.
I20260317 20:58:36.536325 3674 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:36.536604 3674 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:36.537027 3674 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:36.537570 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:58:36.537684 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:58:36.537724 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:36.537853 3674 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:58:36.982949 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 36: this message will repeat every 5th retry.
W20260317 20:58:37.177979 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 36: this message will repeat every 5th retry.
I20260317 20:58:37.551136 3674 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:37.551282 3674 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:37.551723 3674 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:37.552487 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:58:37.552852 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:58:37.552935 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:37.553115 3674 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:39.909232 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:39.909361 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:58:40.552930 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 41: this message will repeat every 5th retry.
W20260317 20:58:40.789429 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 41: this message will repeat every 5th retry.
W20260317 20:58:41.472635 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 41: this message will repeat every 5th retry.
W20260317 20:58:41.767936 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 41: this message will repeat every 5th retry.
W20260317 20:58:42.192591 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 41: this message will repeat every 5th retry.
I20260317 20:58:44.911625 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:44.911777 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:58:45.373016 3722 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:45.373171 3722 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:45.373862 3722 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:45.374745 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:58:45.374900 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:58:45.374945 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:45.375103 3722 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:58:45.824147 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 46: this message will repeat every 5th retry.
W20260317 20:58:46.347576 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 46: this message will repeat every 5th retry.
W20260317 20:58:46.610920 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 46: this message will repeat every 5th retry.
W20260317 20:58:46.647536 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 46: this message will repeat every 5th retry.
W20260317 20:58:47.151362 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 46: this message will repeat every 5th retry.
I20260317 20:58:48.862094 3746 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:48.862353 3746 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:58:48.863397 3746 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:48.863452 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:58:48.863770 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:58:48.863854 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:48.864022 3746 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:49.913795 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:49.913949 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:58:50.778631 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 51: this message will repeat every 5th retry.
W20260317 20:58:51.297267 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 51: this message will repeat every 5th retry.
W20260317 20:58:51.567332 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 51: this message will repeat every 5th retry.
W20260317 20:58:51.636345 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 51: this message will repeat every 5th retry.
W20260317 20:58:52.105691 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 51: this message will repeat every 5th retry.
I20260317 20:58:52.152330 3761 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:58:52.152511 3761 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
W20260317 20:58:52.153601 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260317 20:58:52.153896 3761 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:58:52.154407 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:58:52.154556 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:58:52.154613 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:58:52.154731 3761 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:58:52.163851 3758 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:52.163993 3758 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:52.164373 3758 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:52.165172 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:58:52.165351 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:58:52.165443 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:52.165634 3758 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:52.313585 3758 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:58:52.313755 3758 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:58:52.314249 3758 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:58:52.315074 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:58:52.315214 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:58:52.315256 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:52.315414 3758 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:54.915827 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:54.915946 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:58:56.163882 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 56: this message will repeat every 5th retry.
W20260317 20:58:56.191313 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 56: this message will repeat every 5th retry.
W20260317 20:58:56.452862 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 56: this message will repeat every 5th retry.
W20260317 20:58:56.476531 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 56: this message will repeat every 5th retry.
W20260317 20:58:57.081620 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 56: this message will repeat every 5th retry.
I20260317 20:58:58.753798 3780 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:58:58.753975 3780 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:58:58.754595 3780 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:58:58.755451 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:58:58.755661 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:58:58.755714 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:58:58.755916 3770 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:58:59.918416 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:58:59.918581 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:59:00.698380 3800 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:59:00.698516 3800 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:59:00.699024 3800 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:59:00.699805 3306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 20:59:00.700614 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:59:00.700862 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:59:00.700946 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:59:00.701095 3800 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 20:59:00.981850 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 61: this message will repeat every 5th retry.
I20260317 20:59:01.132223 3787 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:01.132372 3787 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:01.132908 3787 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:01.133697 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:59:01.133841 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:59:01.133883 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:01.134025 3787 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:01.186101 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 61: this message will repeat every 5th retry.
W20260317 20:59:01.536069 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 61: this message will repeat every 5th retry.
I20260317 20:59:01.576882 3799 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:01.577064 3799 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:59:01.577521 3799 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:01.578418 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:59:01.578620 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:59:01.578699 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:01.578846 3799 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:01.763453 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 61: this message will repeat every 5th retry.
I20260317 20:59:01.798671 3780 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:01.798803 3780 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:01.799261 3780 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:01.799922 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:59:01.800055 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:59:01.800110 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:01.800276 3780 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:01.899433 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 61: this message will repeat every 5th retry.
I20260317 20:59:03.307492 3799 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:03.307638 3799 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:03.308130 3799 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:03.308918 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:59:03.309042 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:59:03.309082 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:03.309343 3799 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:04.920419 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:04.920531 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:59:05.343108 3824 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:05.343312 3824 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:59:05.343801 3824 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:05.344651 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:59:05.344802 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:59:05.344866 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:05.345093 3824 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:05.779362 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 66: this message will repeat every 5th retry.
W20260317 20:59:06.155048 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 66: this message will repeat every 5th retry.
W20260317 20:59:06.268066 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 66: this message will repeat every 5th retry.
W20260317 20:59:07.208338 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 66: this message will repeat every 5th retry.
W20260317 20:59:07.210408 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 66: this message will repeat every 5th retry.
I20260317 20:59:09.922545 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:09.922677 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:59:10.629129 3839 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:10.629316 3839 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:10.629830 3839 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:10.630787 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:59:10.631033 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:59:10.631103 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:10.631289 3839 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:10.787092 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 71: this message will repeat every 5th retry.
W20260317 20:59:10.982443 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 71: this message will repeat every 5th retry.
W20260317 20:59:11.478839 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 71: this message will repeat every 5th retry.
W20260317 20:59:11.768638 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 71: this message will repeat every 5th retry.
W20260317 20:59:12.195855 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 71: this message will repeat every 5th retry.
I20260317 20:59:13.250710 3839 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:13.250856 3839 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:13.251220 3839 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:13.252036 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:59:13.252226 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:59:13.252290 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:13.252437 3839 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:14.925048 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:14.925170 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:15.672366 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 76: this message will repeat every 5th retry.
W20260317 20:59:15.715536 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 76: this message will repeat every 5th retry.
W20260317 20:59:16.388343 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 76: this message will repeat every 5th retry.
W20260317 20:59:16.625826 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 76: this message will repeat every 5th retry.
I20260317 20:59:17.081207 3861 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:17.081379 3861 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:17.081962 3861 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:17.082917 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:59:17.083042 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:59:17.083082 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:17.083241 3861 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:17.190919 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 76: this message will repeat every 5th retry.
I20260317 20:59:18.765533 3884 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:18.765700 3884 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:18.766167 3884 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:18.766994 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:59:18.767174 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:59:18.767239 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:18.767438 3884 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:19.617419 3892 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:59:19.617573 3892 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:59:19.618160 3892 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:59:19.618724 3306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 20:59:19.619433 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 20:59:19.619578 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 20:59:19.619649 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:59:19.619783 3892 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:59:19.790961 3890 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:19.791113 3890 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:19.791530 3890 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:19.792515 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:59:19.792696 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:59:19.792768 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:19.792948 3890 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:19.927073 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:19.927222 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:20.432211 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 81: this message will repeat every 5th retry.
W20260317 20:59:20.642787 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 81: this message will repeat every 5th retry.
W20260317 20:59:21.516209 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 81: this message will repeat every 5th retry.
W20260317 20:59:21.985167 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 81: this message will repeat every 5th retry.
W20260317 20:59:22.119414 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 81: this message will repeat every 5th retry.
I20260317 20:59:24.287042 3917 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:24.287200 3917 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:59:24.287680 3917 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:24.288599 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:59:24.288755 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:59:24.288822 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:24.289023 3917 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:24.929417 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:24.929541 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:25.430200 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 86: this message will repeat every 5th retry.
I20260317 20:59:25.521107 3908 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:25.521283 3908 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:25.521802 3908 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:25.522709 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:59:25.522858 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:59:25.522925 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:25.523114 3908 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:25.845520 3908 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:25.845742 3908 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:25.846339 3908 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:25.847204 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:59:25.847379 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:59:25.847470 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:25.847680 3908 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:25.915891 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 86: this message will repeat every 5th retry.
W20260317 20:59:26.516054 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 86: this message will repeat every 5th retry.
W20260317 20:59:26.930272 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 86: this message will repeat every 5th retry.
W20260317 20:59:27.076414 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 86: this message will repeat every 5th retry.
I20260317 20:59:28.432284 3942 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:59:28.432403 3942 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:59:28.432910 3942 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:59:28.433389 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 20:59:28.434139 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:59:28.434212 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:59:28.434263 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:59:28.434418 3942 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:59:28.963986 3948 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:28.964149 3948 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:28.964617 3948 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:28.965451 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:59:28.965693 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:59:28.965822 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:28.966099 3948 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:29.931733 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:29.931890 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:30.224849 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 91: this message will repeat every 5th retry.
W20260317 20:59:30.970085 1109 heartbeater.cc:646] Failed to heartbeat to 127.0.102.253:38969 (208 consecutive failures): Network error: Failed to ping master at 127.0.102.253:38969: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:59:31.082304 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 91: this message will repeat every 5th retry.
W20260317 20:59:31.467072 1380 heartbeater.cc:646] Failed to heartbeat to 127.0.102.252:34639 (724 consecutive failures): Network error: Failed to ping master at 127.0.102.252:34639: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 20:59:31.490535 1246 heartbeater.cc:646] Failed to heartbeat to 127.0.102.253:38969 (294 consecutive failures): Network error: Failed to ping master at 127.0.102.253:38969: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:59:31.610509 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 91: this message will repeat every 5th retry.
I20260317 20:59:31.898164 3965 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:31.898290 3965 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:59:31.898762 3965 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:31.899416 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:59:31.899591 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:59:31.899659 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:31.899804 3965 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:32.050700 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 91: this message will repeat every 5th retry.
W20260317 20:59:32.097699 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 91: this message will repeat every 5th retry.
I20260317 20:59:32.133225 3965 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:32.133364 3965 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:32.133939 3965 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:32.134845 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:59:32.135010 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:59:32.135074 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:32.135264 3965 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:34.904987 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 96: this message will repeat every 5th retry.
I20260317 20:59:34.934108 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:34.934232 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:35.591557 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 96: this message will repeat every 5th retry.
W20260317 20:59:36.230139 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 96: this message will repeat every 5th retry.
W20260317 20:59:37.015470 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 96: this message will repeat every 5th retry.
W20260317 20:59:37.148723 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 96: this message will repeat every 5th retry.
I20260317 20:59:37.391732 3995 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:37.391889 3995 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:59:37.392369 3995 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:37.392962 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:59:37.393121 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:59:37.393208 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:37.393376 3995 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:38.280290 4003 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:59:38.280462 4003 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:59:38.281004 4003 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:59:38.281656 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 20:59:38.282534 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:59:38.282632 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:59:38.282725 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:59:38.282876 4003 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:59:39.936543 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:39.936671 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:40.283862 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 101: this message will repeat every 5th retry.
I20260317 20:59:40.290167 4018 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:40.290333 4018 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:40.290766 4018 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:40.291464 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:59:40.291663 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:59:40.291735 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:40.291905 4018 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:40.731104 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 101: this message will repeat every 5th retry.
W20260317 20:59:41.257901 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 101: this message will repeat every 5th retry.
W20260317 20:59:41.658821 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 101: this message will repeat every 5th retry.
W20260317 20:59:42.337999 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 101: this message will repeat every 5th retry.
I20260317 20:59:44.939049 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:44.939190 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:44.985741 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 106: this message will repeat every 5th retry.
W20260317 20:59:45.956384 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 106: this message will repeat every 5th retry.
W20260317 20:59:46.386454 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 106: this message will repeat every 5th retry.
W20260317 20:59:46.860205 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 106: this message will repeat every 5th retry.
I20260317 20:59:47.076207 4057 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:47.076424 4057 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:59:47.076900 4057 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:47.077708 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:59:47.077891 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:59:47.077961 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:47.078163 4057 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:47.262455 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 106: this message will repeat every 5th retry.
I20260317 20:59:47.492564 4058 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:47.492740 4058 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:47.493270 4058 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:47.494158 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:59:47.494304 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:59:47.494359 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:47.494568 4058 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:48.027355 4058 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:48.027537 4058 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:48.028002 4058 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:48.028828 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:59:48.029007 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:59:48.029078 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:48.029279 4058 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:49.550467 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 111: this message will repeat every 5th retry.
I20260317 20:59:49.941409 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:49.941540 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:51.120402 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 111: this message will repeat every 5th retry.
W20260317 20:59:51.700765 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 111: this message will repeat every 5th retry.
W20260317 20:59:51.799758 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 111: this message will repeat every 5th retry.
W20260317 20:59:51.989446 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 111: this message will repeat every 5th retry.
I20260317 20:59:52.343325 4050 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:52.343466 4050 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:52.343948 4050 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:52.344756 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:59:52.344902 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:59:52.344967 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:52.345134 4050 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:54.888517 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 116: this message will repeat every 5th retry.
I20260317 20:59:54.943831 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:54.943970 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 20:59:55.519361 4086 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:55.519527 4086 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:55.520005 4086 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:55.520928 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:59:55.521126 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:59:55.521179 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:55.521337 4086 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:55.658841 4086 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:55.659001 4086 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 20:59:55.659605 4086 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:55.660382 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 20:59:55.660557 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 20:59:55.660624 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:55.660809 4086 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 20:59:56.089483 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 116: this message will repeat every 5th retry.
W20260317 20:59:56.615796 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 116: this message will repeat every 5th retry.
W20260317 20:59:56.808087 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 116: this message will repeat every 5th retry.
W20260317 20:59:56.855487 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 116: this message will repeat every 5th retry.
I20260317 20:59:56.920361 4101 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 20:59:56.920543 4101 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 20:59:56.921160 4101 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 20:59:56.921708 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 20:59:56.922516 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 20:59:56.922626 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 20:59:56.922715 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 20:59:56.922925 4101 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 20:59:57.281137 4100 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:57.281268 4100 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:57.281738 4100 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:57.282588 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:59:57.282765 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:59:57.282847 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:57.282996 4100 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:58.304450 4109 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:58.304611 4109 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:58.305157 4109 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:58.305794 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 20:59:58.305996 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 20:59:58.306087 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:58.306267 4109 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:58.532338 4109 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 20:59:58.532516 4109 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:58.532963 4109 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 20:59:58.533725 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 20:59:58.533942 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 20:59:58.534358 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:58.534503 4100 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:59.189647 4109 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 20:59:59.189783 4109 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 20:59:59.190310 4109 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 20:59:59.191066 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 20:59:59.191192 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 20:59:59.191246 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 20:59:59.191386 4109 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 20:59:59.871111 3310 maintenance_manager.cc:419] P 5022d9ddb45c41faa9f114e2a0a31fc3: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033334
I20260317 20:59:59.911038 3309 maintenance_manager.cc:643] P 5022d9ddb45c41faa9f114e2a0a31fc3: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.039s user 0.019s sys 0.004s Metrics: {"bytes_written":46032,"cfile_init":1,"dirs.queue_time_us":216,"dirs.run_cpu_time_us":192,"dirs.run_wall_time_us":873,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":553,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":130,"thread_start_us":187,"threads_started":2,"wal-append.queue_time_us":163}
I20260317 20:59:59.911944 3310 maintenance_manager.cc:419] P 5022d9ddb45c41faa9f114e2a0a31fc3: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10956 bytes on disk
I20260317 20:59:59.912487 3309 maintenance_manager.cc:643] P 5022d9ddb45c41faa9f114e2a0a31fc3: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4}
I20260317 20:59:59.948028 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 20:59:59.948159 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 20:59:59.953697 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 121: this message will repeat every 5th retry.
I20260317 21:00:00.240530 4123 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:00.240677 4123 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:00.241080 4123 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:00.241693 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:00:00.241843 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:00:00.241892 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:00.242080 4123 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:00.779485 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 121: this message will repeat every 5th retry.
W20260317 21:00:01.522315 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 121: this message will repeat every 5th retry.
W20260317 21:00:01.773031 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 121: this message will repeat every 5th retry.
W20260317 21:00:02.073835 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 121: this message will repeat every 5th retry.
W20260317 21:00:04.787696 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 126: this message will repeat every 5th retry.
I20260317 21:00:04.950420 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:04.950577 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 21:00:04.956744 4135 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:04.956907 4135 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:04.957535 4135 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:04.958390 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:00:04.958577 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:00:04.958642 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:04.958859 4135 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:00:05.246999 4145 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:05.247175 4145 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:05.247634 4145 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:05.248520 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:00:05.248728 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:00:05.248816 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:05.249006 4145 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:05.929330 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 126: this message will repeat every 5th retry.
W20260317 21:00:06.620864 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 126: this message will repeat every 5th retry.
W20260317 21:00:07.042716 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 126: this message will repeat every 5th retry.
W20260317 21:00:07.179347 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 126: this message will repeat every 5th retry.
W20260317 21:00:09.715946 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 131: this message will repeat every 5th retry.
I20260317 21:00:09.952777 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:09.952939 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:00:10.836134 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 131: this message will repeat every 5th retry.
W20260317 21:00:11.626718 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 131: this message will repeat every 5th retry.
W20260317 21:00:11.684403 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 131: this message will repeat every 5th retry.
W20260317 21:00:12.128747 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 131: this message will repeat every 5th retry.
I20260317 21:00:14.206822 4225 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:14.206983 4225 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:00:14.207471 4225 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:14.208434 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:00:14.208559 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:00:14.208593 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:14.208751 4225 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:14.858860 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 136: this message will repeat every 5th retry.
I20260317 21:00:14.955283 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:14.955425 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:00:15.652359 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 136: this message will repeat every 5th retry.
I20260317 21:00:16.283027 4254 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:00:16.283226 4254 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:00:16.283840 4254 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:00:16.284472 3306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:00:16.285233 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:00:16.285363 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 21:00:16.285439 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:00:16.285580 4254 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 21:00:16.577615 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 136: this message will repeat every 5th retry.
W20260317 21:00:16.747288 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 136: this message will repeat every 5th retry.
W20260317 21:00:16.933076 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 136: this message will repeat every 5th retry.
I20260317 21:00:19.481205 4262 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:19.481362 4262 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:19.481928 4262 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:19.482810 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:00:19.482973 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:00:19.483034 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:19.483201 4262 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:19.757102 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 141: this message will repeat every 5th retry.
I20260317 21:00:19.957587 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:19.957743 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:00:20.862236 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 141: this message will repeat every 5th retry.
W20260317 21:00:21.183017 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 141: this message will repeat every 5th retry.
W20260317 21:00:21.956130 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 141: this message will repeat every 5th retry.
I20260317 21:00:22.157785 4299 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:22.157961 4299 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:22.158640 4299 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:22.159327 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:00:22.159497 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:00:22.159554 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:22.159709 4299 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:22.299590 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 141: this message will repeat every 5th retry.
I20260317 21:00:24.025867 4315 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:24.026014 4315 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:24.026551 4315 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:24.027355 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:00:24.027644 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:00:24.027734 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:24.027891 4315 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:00:24.752115 4325 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:24.752281 4325 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:24.752684 4325 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:24.753309 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:00:24.754211 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:00:24.754310 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:24.754483 4325 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:24.810413 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 146: this message will repeat every 5th retry.
I20260317 21:00:24.959964 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:24.960103 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 21:00:25.758694 4325 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:25.758877 4325 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:25.759339 4325 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:25.760180 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:00:25.760350 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:00:25.760437 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:25.760600 4325 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:26.178928 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 146: this message will repeat every 5th retry.
W20260317 21:00:26.188050 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 146: this message will repeat every 5th retry.
W20260317 21:00:26.521677 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 146: this message will repeat every 5th retry.
I20260317 21:00:27.239249 4349 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:27.239411 4349 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:27.239920 4349 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:27.240844 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:00:27.241009 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:00:27.241082 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:27.241230 4349 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:00:27.412451 4352 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:00:27.412595 4352 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:00:27.413169 4352 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:00:27.413738 3306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:00:27.414465 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:00:27.414584 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 21:00:27.414649 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:00:27.414791 4352 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 21:00:27.499971 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 146: this message will repeat every 5th retry.
I20260317 21:00:28.530987 4361 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:28.531154 4361 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:00:28.531610 4361 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:28.532485 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:00:28.532711 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:00:28.532789 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:28.533010 4361 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:29.868453 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 151: this message will repeat every 5th retry.
I20260317 21:00:29.962358 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:29.962469 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:00:31.092213 1109 heartbeater.cc:646] Failed to heartbeat to 127.0.102.253:38969 (328 consecutive failures): Network error: Failed to ping master at 127.0.102.253:38969: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:00:31.139911 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 151: this message will repeat every 5th retry.
W20260317 21:00:31.278259 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 151: this message will repeat every 5th retry.
W20260317 21:00:31.640777 1244 heartbeater.cc:646] Failed to heartbeat to 127.0.102.252:34639 (444 consecutive failures): Network error: Failed to ping master at 127.0.102.252:34639: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:00:31.699698 1382 heartbeater.cc:646] Failed to heartbeat to 127.0.102.253:38969 (1233 consecutive failures): Network error: Failed to ping master at 127.0.102.253:38969: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:00:31.699755 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 151: this message will repeat every 5th retry.
I20260317 21:00:32.119730 4390 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:32.119918 4390 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:32.120349 4390 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:32.121230 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:00:32.121402 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:00:32.121467 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:32.121659 4390 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:32.463443 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 151: this message will repeat every 5th retry.
W20260317 21:00:34.799975 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 156: this message will repeat every 5th retry.
I20260317 21:00:34.964849 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:34.964986 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:00:36.191907 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 156: this message will repeat every 5th retry.
W20260317 21:00:36.497104 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 156: this message will repeat every 5th retry.
W20260317 21:00:36.537794 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 156: this message will repeat every 5th retry.
W20260317 21:00:37.407908 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 156: this message will repeat every 5th retry.
I20260317 21:00:38.792393 4482 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:00:38.792583 4482 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:00:38.792969 4482 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:00:38.793501 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:00:38.794278 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:00:38.794509 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 21:00:38.794585 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:00:38.794723 4482 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 21:00:39.679306 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 161: this message will repeat every 5th retry.
I20260317 21:00:39.801934 4489 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:39.802115 4489 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:00:39.802650 4489 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:39.803395 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:00:39.803548 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:00:39.803627 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:39.803804 4489 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:00:39.967061 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:39.967224 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:00:41.098009 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 161: this message will repeat every 5th retry.
W20260317 21:00:41.253113 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 161: this message will repeat every 5th retry.
W20260317 21:00:41.253325 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 161: this message will repeat every 5th retry.
W20260317 21:00:42.440963 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 161: this message will repeat every 5th retry.
I20260317 21:00:43.322711 4551 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:43.322878 4551 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:43.323411 4551 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:43.324316 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:00:43.324496 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:00:43.324559 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:43.324756 4551 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:44.943990 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 166: this message will repeat every 5th retry.
I20260317 21:00:44.969431 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:44.969610 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:00:45.938866 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 166: this message will repeat every 5th retry.
W20260317 21:00:46.015575 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 166: this message will repeat every 5th retry.
W20260317 21:00:46.213225 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 166: this message will repeat every 5th retry.
I20260317 21:00:46.223572 4566 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:46.223692 4566 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:46.224035 4566 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:46.224650 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:00:46.224776 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:00:46.224819 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:46.224936 4566 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:00:46.598611 4581 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:46.598804 4581 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:46.599258 4581 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:46.600066 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:00:46.600240 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:00:46.600319 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:46.600523 4581 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:47.459821 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 166: this message will repeat every 5th retry.
I20260317 21:00:49.598912 4622 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:49.599063 4622 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:49.599534 4622 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:49.600366 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:00:49.600556 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:00:49.600632 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:49.600775 4622 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:49.811312 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 171: this message will repeat every 5th retry.
I20260317 21:00:49.972194 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:49.972328 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 21:00:50.029387 4622 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:50.029547 4622 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:50.030022 4622 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:50.030761 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:00:50.030937 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:00:50.030989 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:50.031107 4622 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:50.825304 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 171: this message will repeat every 5th retry.
W20260317 21:00:50.958482 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 171: this message will repeat every 5th retry.
W20260317 21:00:51.192286 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 171: this message will repeat every 5th retry.
W20260317 21:00:52.535959 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 171: this message will repeat every 5th retry.
W20260317 21:00:54.897771 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 176: this message will repeat every 5th retry.
I20260317 21:00:54.974445 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:54.974601 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:00:56.086678 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 176: this message will repeat every 5th retry.
W20260317 21:00:56.131634 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 176: this message will repeat every 5th retry.
W20260317 21:00:56.381091 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 176: this message will repeat every 5th retry.
I20260317 21:00:56.434698 4710 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:56.434864 4710 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:00:56.435511 4710 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:00:56.436406 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:00:56.436580 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:00:56.436642 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:56.436851 4710 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:00:56.482213 4719 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:00:56.482558 4719 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:00:56.483161 4719 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:00:56.483819 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:00:56.484539 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:00:56.484637 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 21:00:56.484719 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:00:56.484891 4719 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 21:00:57.580760 4737 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:00:57.580921 4737 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:57.581446 4737 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:57.582317 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:00:57.582505 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:00:57.582571 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:57.582741 4737 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:00:57.673545 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 176: this message will repeat every 5th retry.
I20260317 21:00:57.925048 4741 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:00:57.925172 4741 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:00:57.925634 4741 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:00:57.926820 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:00:57.926982 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 21:00:57.927049 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:00:57.927192 4741 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 21:00:59.767642 4767 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:00:59.767827 4767 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:00:59.768299 4767 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:00:59.769312 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:00:59.769481 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:00:59.769526 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:00:59.769706 4767 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:00:59.976850 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:00:59.976967 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:00.038800 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 181: this message will repeat every 5th retry.
W20260317 21:01:01.056386 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 181: this message will repeat every 5th retry.
W20260317 21:01:01.065403 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 181: this message will repeat every 5th retry.
W20260317 21:01:01.463977 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 181: this message will repeat every 5th retry.
I20260317 21:01:02.212011 4776 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:02.212229 4776 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:01:02.212757 4776 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:02.213694 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:01:02.213878 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:01:02.213948 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:02.214151 4776 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:02.559813 4806 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:02.559964 4806 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:02.560520 4806 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:02.561367 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:01:02.561553 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:01:02.561612 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:02.561822 4806 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:02.972469 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 181: this message will repeat every 5th retry.
I20260317 21:01:04.979252 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:04.979393 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:05.235169 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 186: this message will repeat every 5th retry.
W20260317 21:01:06.125406 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 186: this message will repeat every 5th retry.
W20260317 21:01:06.368281 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 186: this message will repeat every 5th retry.
W20260317 21:01:06.501127 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 186: this message will repeat every 5th retry.
I20260317 21:01:06.823841 4863 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:06.824004 4863 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:06.824395 4863 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:06.825227 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:01:06.825376 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:01:06.825435 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:06.825595 4863 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:07.669795 4875 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:07.669966 4875 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:07.670423 4875 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:07.671166 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:01:07.671291 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:01:07.671324 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:07.671465 4875 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:07.852866 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 186: this message will repeat every 5th retry.
I20260317 21:01:09.707231 4900 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:01:09.707391 4900 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:01:09.707993 4900 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:01:09.708628 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260317 21:01:09.709595 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:01:09.709703 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 21:01:09.709759 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:01:09.709896 4900 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 21:01:09.981717 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:09.981897 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:10.693344 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 191: this message will repeat every 5th retry.
W20260317 21:01:11.155705 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 191: this message will repeat every 5th retry.
W20260317 21:01:11.224115 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 191: this message will repeat every 5th retry.
W20260317 21:01:11.589468 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 191: this message will repeat every 5th retry.
I20260317 21:01:11.835909 4926 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:11.836045 4926 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:01:11.836639 4926 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:11.837283 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:01:11.837426 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:01:11.837507 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:11.837704 4926 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:12.804935 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 191: this message will repeat every 5th retry.
I20260317 21:01:13.268764 4926 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:13.268895 4926 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:13.269268 4926 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:13.269934 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:01:13.270123 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:01:13.270181 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:13.270325 4926 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:14.984366 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:14.984473 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 21:01:14.985126 4954 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:14.985237 4954 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:01:14.985713 4954 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:14.986498 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:01:14.986616 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:01:14.986701 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:14.986886 4954 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:15.588145 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 196: this message will repeat every 5th retry.
W20260317 21:01:16.016415 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 196: this message will repeat every 5th retry.
I20260317 21:01:16.154811 4959 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:16.154978 4959 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:16.155426 4959 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:16.156226 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:01:16.156369 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:01:16.156445 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:16.156602 4959 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:16.268388 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 196: this message will repeat every 5th retry.
W20260317 21:01:16.354238 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 196: this message will repeat every 5th retry.
I20260317 21:01:16.785243 4985 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:01:16.785396 4985 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:01:16.785827 4985 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:01:16.786401 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:01:16.787112 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:01:16.787249 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 21:01:16.787328 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:01:16.787449 4985 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 21:01:18.363268 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 196: this message will repeat every 5th retry.
I20260317 21:01:19.986964 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:19.987092 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:20.450229 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 201: this message will repeat every 5th retry.
W20260317 21:01:21.306324 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 201: this message will repeat every 5th retry.
W20260317 21:01:21.387228 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 201: this message will repeat every 5th retry.
W20260317 21:01:21.408939 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 201: this message will repeat every 5th retry.
W20260317 21:01:23.399207 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 201: this message will repeat every 5th retry.
I20260317 21:01:23.438657 5082 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:01:23.438787 5082 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:01:23.439227 5082 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:01:23.439827 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:01:23.440621 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:01:23.440864 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 21:01:23.440932 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:01:23.441125 5082 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 21:01:23.676052 5070 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:23.676226 5070 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:23.676671 5070 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:23.677330 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:01:23.677479 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:01:23.677543 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:23.677703 5070 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:24.989380 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:24.989548 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:25.875056 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 206: this message will repeat every 5th retry.
W20260317 21:01:26.449853 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 206: this message will repeat every 5th retry.
W20260317 21:01:26.475282 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 206: this message will repeat every 5th retry.
W20260317 21:01:26.595542 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 206: this message will repeat every 5th retry.
W20260317 21:01:28.166992 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 206: this message will repeat every 5th retry.
I20260317 21:01:29.068552 5127 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:29.068733 5127 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:29.069386 5127 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:29.070116 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:01:29.070290 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:01:29.070356 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:29.070499 5127 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:29.991847 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:29.992025 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:31.039259 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 211: this message will repeat every 5th retry.
W20260317 21:01:31.224462 1107 heartbeater.cc:646] Failed to heartbeat to 127.0.102.252:34639 (420 consecutive failures): Network error: Failed to ping master at 127.0.102.252:34639: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:01:31.339286 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 211: this message will repeat every 5th retry.
W20260317 21:01:31.605002 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 211: this message will repeat every 5th retry.
W20260317 21:01:31.776069 1380 heartbeater.cc:646] Failed to heartbeat to 127.0.102.252:34639 (1682 consecutive failures): Network error: Failed to ping master at 127.0.102.252:34639: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:01:31.858155 1244 heartbeater.cc:646] Failed to heartbeat to 127.0.102.252:34639 (625 consecutive failures): Network error: Failed to ping master at 127.0.102.252:34639: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:01:31.972635 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 211: this message will repeat every 5th retry.
I20260317 21:01:32.287523 5176 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:32.287710 5176 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:32.288172 5176 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:32.288938 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:01:32.289109 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:01:32.289173 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:32.289325 5176 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:33.184342 5204 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:33.184518 5204 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:01:33.184957 5204 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:33.185714 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:01:33.185889 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:01:33.185958 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:33.186209 5204 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:33.255856 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 211: this message will repeat every 5th retry.
I20260317 21:01:34.995250 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:34.995412 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:35.960877 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 216: this message will repeat every 5th retry.
W20260317 21:01:36.225332 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 216: this message will repeat every 5th retry.
W20260317 21:01:36.517014 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 216: this message will repeat every 5th retry.
I20260317 21:01:37.080696 5224 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:37.080880 5224 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:37.081331 5224 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:37.082358 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:01:37.082516 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:01:37.082587 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:37.082774 5224 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:37.203253 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 216: this message will repeat every 5th retry.
W20260317 21:01:38.261384 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 216: this message will repeat every 5th retry.
I20260317 21:01:38.778730 5274 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:01:38.778864 5274 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:01:38.779351 5274 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:01:38.779932 3306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:01:38.780622 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:01:38.780812 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 21:01:38.780884 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:01:38.781030 5274 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 21:01:39.997808 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:39.997920 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 21:01:40.967407 5264 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:40.967581 5264 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:01:40.967988 5264 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:40.968842 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:01:40.969018 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:01:40.969094 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:40.969277 5264 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:41.237672 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 221: this message will repeat every 5th retry.
W20260317 21:01:41.285430 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 221: this message will repeat every 5th retry.
W20260317 21:01:41.879957 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 221: this message will repeat every 5th retry.
W20260317 21:01:42.200475 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 221: this message will repeat every 5th retry.
I20260317 21:01:42.417670 5264 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:42.417830 5264 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:42.418330 5264 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:42.419204 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:01:42.419325 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:01:42.419366 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:42.419508 5264 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:43.328595 5333 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:01:43.328738 5333 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:01:43.329149 5333 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:01:43.330623 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:01:43.330798 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 21:01:43.330863 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:01:43.330994 5333 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 21:01:43.454967 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 221: this message will repeat every 5th retry.
I20260317 21:01:45.000070 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:45.000174 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:46.053478 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 226: this message will repeat every 5th retry.
W20260317 21:01:46.252990 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 226: this message will repeat every 5th retry.
I20260317 21:01:46.834895 5359 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:46.835060 5359 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:46.835686 5359 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:46.836454 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:01:46.836638 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:01:46.836704 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:46.836889 5359 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:46.959317 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 226: this message will repeat every 5th retry.
W20260317 21:01:47.151087 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 226: this message will repeat every 5th retry.
W20260317 21:01:48.128572 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 226: this message will repeat every 5th retry.
I20260317 21:01:48.768046 5385 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:48.768168 5385 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:48.768625 5385 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:48.769197 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:01:48.769357 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:01:48.769423 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:48.769586 5385 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:49.010854 5404 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:49.011042 5404 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:01:49.011595 5404 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:49.012539 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:01:49.012742 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:01:49.012812 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:49.012995 5404 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:49.227837 5407 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:01:49.228109 5407 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:01:49.228682 5407 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:01:49.229225 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260317 21:01:49.229933 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:01:49.230099 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 21:01:49.230168 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:01:49.230300 5407 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 21:01:50.002367 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:50.002491 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:50.735224 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 231: this message will repeat every 5th retry.
W20260317 21:01:51.495165 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 231: this message will repeat every 5th retry.
I20260317 21:01:51.622555 5379 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:01:51.622725 5379 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:51.623236 5379 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:51.624033 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:01:51.624302 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:01:51.624372 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:51.624512 5379 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:01:51.899564 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 231: this message will repeat every 5th retry.
W20260317 21:01:52.368402 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 231: this message will repeat every 5th retry.
W20260317 21:01:52.810200 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 231: this message will repeat every 5th retry.
I20260317 21:01:53.496712 5465 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:53.496855 5465 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:53.497292 5465 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:01:53.498108 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:01:53.498364 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:01:53.498451 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:53.498610 5465 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:54.322588 5465 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:01:54.322739 5465 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:01:54.323213 5465 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:01:54.324015 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:01:54.324200 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:01:54.324261 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:01:54.324456 5465 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:01:55.004534 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:01:55.004649 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:01:55.450171 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 236: this message will repeat every 5th retry.
W20260317 21:01:56.539762 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 236: this message will repeat every 5th retry.
W20260317 21:01:57.023588 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 236: this message will repeat every 5th retry.
W20260317 21:01:57.074227 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 236: this message will repeat every 5th retry.
W20260317 21:01:57.738933 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 236: this message will repeat every 5th retry.
I20260317 21:02:00.006754 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:02:00.006908 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:02:00.536983 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 241: this message will repeat every 5th retry.
W20260317 21:02:01.250540 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 241: this message will repeat every 5th retry.
W20260317 21:02:02.333290 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 241: this message will repeat every 5th retry.
W20260317 21:02:02.365943 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 241: this message will repeat every 5th retry.
W20260317 21:02:02.497334 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 241: this message will repeat every 5th retry.
I20260317 21:02:05.009259 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:02:05.009421 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:02:05.393375 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 246: this message will repeat every 5th retry.
I20260317 21:02:06.170509 5577 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:02:06.170863 5577 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:02:06.171479 5577 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:02:06.172493 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:02:06.172641 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:02:06.172684 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:06.172827 5577 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:02:06.604825 5631 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:02:06.605002 5631 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:02:06.605561 5631 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:02:06.606273 3306 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:02:06.607059 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:02:06.607148 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 21:02:06.607232 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:02:06.607395 5631 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 21:02:06.622020 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 246: this message will repeat every 5th retry.
W20260317 21:02:07.266847 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 246: this message will repeat every 5th retry.
W20260317 21:02:07.481640 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 246: this message will repeat every 5th retry.
W20260317 21:02:07.650980 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 246: this message will repeat every 5th retry.
I20260317 21:02:10.011651 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:02:10.011801 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 21:02:10.123172 5647 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:02:10.123368 5647 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:02:10.123821 5647 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:02:10.124733 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:02:10.124915 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:02:10.124984 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:10.125190 5647 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:02:10.461966 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 251: this message will repeat every 5th retry.
W20260317 21:02:11.335654 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 251: this message will repeat every 5th retry.
I20260317 21:02:11.438856 5682 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:02:11.439040 5682 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:02:11.439492 5682 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:02:11.440270 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:02:11.440428 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:02:11.440491 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:11.440629 5682 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:02:11.934630 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 251: this message will repeat every 5th retry.
W20260317 21:02:12.285280 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 251: this message will repeat every 5th retry.
I20260317 21:02:12.455271 5682 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:02:12.455430 5682 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:02:12.455986 5682 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:02:12.457118 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:02:12.457304 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:02:12.457372 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:12.457571 5682 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:02:12.794337 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 251: this message will repeat every 5th retry.
I20260317 21:02:12.955343 5682 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:02:12.955495 5682 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:02:12.955945 5682 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:02:12.956758 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:02:12.956923 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:02:12.956988 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:12.957192 5709 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:02:14.953553 5736 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:02:14.953747 5736 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:02:14.954267 5736 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:02:14.955143 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:02:14.955336 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:02:14.955390 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:14.955595 5736 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:02:15.014110 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:02:15.014235 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:02:15.304865 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 256: this message will repeat every 5th retry.
W20260317 21:02:15.896442 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 256: this message will repeat every 5th retry.
W20260317 21:02:16.416455 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 256: this message will repeat every 5th retry.
W20260317 21:02:17.160346 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 256: this message will repeat every 5th retry.
W20260317 21:02:17.707885 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 256: this message will repeat every 5th retry.
I20260317 21:02:17.961192 5768 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:02:17.961333 5768 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:02:17.961875 5768 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:02:17.962433 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:02:17.963155 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:02:17.963325 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
I20260317 21:02:17.963414 3306 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:02:17.963575 5768 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260317 21:02:19.934945 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 261: this message will repeat every 5th retry.
I20260317 21:02:20.016147 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:02:20.016249 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260317 21:02:20.753522 5747 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:02:20.753665 5747 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:02:20.754201 5747 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:02:20.755026 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:02:20.755165 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:02:20.755213 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:20.755357 5747 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:02:20.920488 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 261: this message will repeat every 5th retry.
I20260317 21:02:21.020591 5776 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:02:21.020747 5776 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:02:21.021287 5776 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:02:21.022106 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:02:21.022249 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:02:21.022292 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:21.022426 5776 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:02:21.442595 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 261: this message will repeat every 5th retry.
W20260317 21:02:21.926623 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 261: this message will repeat every 5th retry.
I20260317 21:02:22.015359 5807 raft_consensus.cc:493] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:02:22.015604 5807 raft_consensus.cc:515] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:02:22.016149 5807 leader_election.cc:290] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:02:22.017071 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
W20260317 21:02:22.017207 1133 leader_election.cc:343] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 3958625929884f3397edf4c3aee3260e
I20260317 21:02:22.017241 1133 leader_election.cc:304] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:22.017416 5807 raft_consensus.cc:2749] T 3958625929884f3397edf4c3aee3260e P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260317 21:02:22.116402 5807 raft_consensus.cc:493] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:02:22.116542 5807 raft_consensus.cc:515] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:02:22.116865 5807 leader_election.cc:290] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847), 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743)
W20260317 21:02:22.117568 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
W20260317 21:02:22.117735 1133 leader_election.cc:343] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: dcc244fe79aa45e18427da2be335636a
I20260317 21:02:22.117797 1133 leader_election.cc:304] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:22.117940 5807 raft_consensus.cc:2749] T dcc244fe79aa45e18427da2be335636a P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:02:22.781265 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 261: this message will repeat every 5th retry.
W20260317 21:02:24.898234 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 266: this message will repeat every 5th retry.
I20260317 21:02:24.997027 5856 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 15a5313a52eb40a3ab5d14d0d8be52f7)
I20260317 21:02:24.997180 5856 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5022d9ddb45c41faa9f114e2a0a31fc3" member_type: VOTER last_known_addr { host: "127.0.102.254" port: 45865 } } peers { permanent_uuid: "db5e708fd6404c0daa842bfc7e8f4806" member_type: VOTER last_known_addr { host: "127.0.102.253" port: 38969 } } peers { permanent_uuid: "15a5313a52eb40a3ab5d14d0d8be52f7" member_type: VOTER last_known_addr { host: "127.0.102.252" port: 34639 } }
I20260317 21:02:24.997663 5856 leader_election.cc:290] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969), 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639)
W20260317 21:02:24.998391 3307 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260317 21:02:24.999236 3306 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 15a5313a52eb40a3ab5d14d0d8be52f7 (127.0.102.252:34639): Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:02:24.999403 3307 leader_election.cc:336] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer db5e708fd6404c0daa842bfc7e8f4806 (127.0.102.253:38969): Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
I20260317 21:02:24.999486 3307 leader_election.cc:304] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5022d9ddb45c41faa9f114e2a0a31fc3; no voters: 15a5313a52eb40a3ab5d14d0d8be52f7, db5e708fd6404c0daa842bfc7e8f4806
I20260317 21:02:24.999671 5856 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 5022d9ddb45c41faa9f114e2a0a31fc3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260317 21:02:25.018646 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:02:25.018821 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:02:26.136324 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 266: this message will repeat every 5th retry.
W20260317 21:02:26.613734 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 266: this message will repeat every 5th retry.
W20260317 21:02:27.018978 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 266: this message will repeat every 5th retry.
W20260317 21:02:27.774219 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 266: this message will repeat every 5th retry.
I20260317 21:02:30.021184 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:02:30.021349 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:02:30.406270 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 271: this message will repeat every 5th retry.
W20260317 21:02:31.078055 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 271: this message will repeat every 5th retry.
W20260317 21:02:31.354863 1107 heartbeater.cc:646] Failed to heartbeat to 127.0.102.252:34639 (540 consecutive failures): Network error: Failed to ping master at 127.0.102.252:34639: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:02:31.587507 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 271: this message will repeat every 5th retry.
W20260317 21:02:31.860878 1382 heartbeater.cc:646] Failed to heartbeat to 127.0.102.253:38969 (2192 consecutive failures): Network error: Failed to ping master at 127.0.102.253:38969: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111)
W20260317 21:02:31.963815 1244 heartbeater.cc:646] Failed to heartbeat to 127.0.102.252:34639 (801 consecutive failures): Network error: Failed to ping master at 127.0.102.252:34639: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:02:31.999002 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 271: this message will repeat every 5th retry.
I20260317 21:02:32.381625 5934 raft_consensus.cc:493] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 92d68c1a3a2642cca908f2c7e9d7e13a)
I20260317 21:02:32.381775 5934 raft_consensus.cc:515] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } } peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } }
I20260317 21:02:32.382231 5934 leader_election.cc:290] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:02:32.382886 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
W20260317 21:02:32.383049 1133 leader_election.cc:343] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 6d152d8bcdb544bd80c998d9dd0a8cbd
I20260317 21:02:32.383122 1133 leader_election.cc:304] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:32.383261 5934 raft_consensus.cc:2749] T 6d152d8bcdb544bd80c998d9dd0a8cbd P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:02:32.733330 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 271: this message will repeat every 5th retry.
I20260317 21:02:35.023909 3284 master_runner.cc:186] Error getting master registration for 127.0.102.253:38969: Network error: Client connection negotiation failed: client connection to 127.0.102.253:38969: connect: Connection refused (error 111),
I20260317 21:02:35.024024 3284 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260317 21:02:35.269150 1269 consensus_peers.cc:597] T fc76f8e8a4af47aba2a64bd60fc6941f P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc76f8e8a4af47aba2a64bd60fc6941f. This is attempt 276: this message will repeat every 5th retry.
I20260317 21:02:36.151044 5963 raft_consensus.cc:493] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 630e777e97c141a69e35660f32b26f6d)
I20260317 21:02:36.151196 5963 raft_consensus.cc:515] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "35518b51259b46d1b9b5e82b6841057b" member_type: VOTER last_known_addr { host: "127.0.102.194" port: 40679 } } peers { permanent_uuid: "92d68c1a3a2642cca908f2c7e9d7e13a" member_type: VOTER last_known_addr { host: "127.0.102.193" port: 34743 } } peers { permanent_uuid: "630e777e97c141a69e35660f32b26f6d" member_type: VOTER last_known_addr { host: "127.0.102.195" port: 46847 } }
I20260317 21:02:36.151690 5963 leader_election.cc:290] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743), 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847)
W20260317 21:02:36.152503 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
W20260317 21:02:36.152679 1133 leader_election.cc:343] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 630e777e97c141a69e35660f32b26f6d (127.0.102.195:46847): Not found: Tablet not found: 0d7946629e25418c9c23d09363e305b8
I20260317 21:02:36.152750 1133 leader_election.cc:304] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35518b51259b46d1b9b5e82b6841057b; no voters: 630e777e97c141a69e35660f32b26f6d, 92d68c1a3a2642cca908f2c7e9d7e13a
I20260317 21:02:36.152981 5963 raft_consensus.cc:2749] T 0d7946629e25418c9c23d09363e305b8 P 35518b51259b46d1b9b5e82b6841057b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260317 21:02:36.302601 1269 consensus_peers.cc:597] T aa23ce23d4b0465baf378859e9ad018c P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa23ce23d4b0465baf378859e9ad018c. This is attempt 276: this message will repeat every 5th retry.
W20260317 21:02:36.676520 1269 consensus_peers.cc:597] T e4124783269f438c803d4fb68f223d20 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4124783269f438c803d4fb68f223d20. This is attempt 276: this message will repeat every 5th retry.
W20260317 21:02:36.911389 1133 consensus_peers.cc:597] T 1106c838e4bc4e0d91905b7d61e8584a P 35518b51259b46d1b9b5e82b6841057b -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1106c838e4bc4e0d91905b7d61e8584a. This is attempt 276: this message will repeat every 5th retry.
W20260317 21:02:37.905468 1390 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:02:37.905675 1390 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:02:37.905757 1390 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
W20260317 21:02:37.905879 1390 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
F20260317 21:02:37.916404 1405 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1773781357 (unix time) try "date -d @1773781357" if you are using GNU date ***
W20260317 21:02:37.917671 1388 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.0.102.252:34639)
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20260317 21:02:37.918571 1388 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.0.102.252:34639)
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.919356 1412 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.919356 1412 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.921566 1408 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.919356 1412 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.921566 1408 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923111 1406 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** SIGABRT (@0x3e80000019b) received by PID 411 (TID 0x7f00c5b45700) from PID 411; stack trace: ***
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.919356 1412 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.921566 1408 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923111 1406 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923300 1410 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.919356 1412 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.921566 1408 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923111 1406 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923300 1410 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923318 1399 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f3bf180436c74527a1909f1af367814e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20260317 21:02:37.923471 1388 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.0.102.252:34639)
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.919356 1412 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.921566 1408 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923111 1406 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923300 1410 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923318 1399 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f3bf180436c74527a1909f1af367814e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.924491 1414 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.919356 1412 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.921566 1408 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923111 1406 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923300 1410 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923318 1399 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f3bf180436c74527a1909f1af367814e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.924491 1414 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.924628 1411 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7f00de9ae980 (unknown) at ??:0
F20260317 21:02:37.918229 1400 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6bacc979980f45f3bff68d78ea0c114d on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.918855 1409 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.919356 1412 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.921566 1408 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923111 1406 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923300 1410 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.923318 1399 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_f3bf180436c74527a1909f1af367814e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.924491 1414 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.924628 1411 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)F20260317 21:02:37.926179 1404 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_6215ae4e2f8745489185062d37f72f06 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.0.102.254:45865,127.0.102.253:38969,127.0.102.252:34639, num_attempts: 741) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.0.102.252:34639: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20260317 21:02:37.926841 1388 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.0.102.252:34639)
@ 0x7f00dc514e87 gsignal at ??:0
@ 0x7f00dc5167f1 abort at ??:0
@ 0x7f00dd37ddcd google::LogMessage::Fail() at ??:0
@ 0x7f00dd381b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f00dd37d7cc google::LogMessage::Flush() at ??:0
W20260317 21:02:37.941009 1269 consensus_peers.cc:597] T 44eb25147f54448997a7147be3de6518 P 630e777e97c141a69e35660f32b26f6d -> Peer 92d68c1a3a2642cca908f2c7e9d7e13a (127.0.102.193:34743): Couldn't send request to peer 92d68c1a3a2642cca908f2c7e9d7e13a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44eb25147f54448997a7147be3de6518. This is attempt 276: this message will repeat every 5th retry.
@ 0x7f00dd37ef59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x5574be79fff7 kudu::MasterStressTest::AlterTableThread() at ??:0
@ 0x5574be7b26d4 std::__invoke_impl<>() at ??:0
@ 0x5574be7b0410 std::__invoke<>() at ??:0
@ 0x5574be7b7a61 _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x5574be7b6a65 std::thread::_Invoker<>::operator()() at ??:0
@ 0x5574be7b57e2 std::thread::_State_impl<>::_M_run() at ??:0
@ 0x7f00dcb9c6df (unknown) at ??:0
@ 0x7f00de9a36db start_thread at ??:0
@ 0x7f00dc5f761f clone at ??:0