Note: This is test shard 3 of 3.
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/2
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251213 09:04:42.980434 16212 test_util.cc:276] Using random seed: -1422732224
2025-12-13T09:04:42Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-13T09:04:42Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskyiO_0l/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskyiO_0l/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/security.properties
2025-12-13 09:04:49: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskyiO_0l/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskyiO_0l/thirdparty/src/hadoop-3.4.1/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20251213 09:04:57.091814 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.62:42117
--webserver_interface=127.15.213.62
--webserver_port=0
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251213 09:04:57.195762 16454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:04:57.195986 16454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:04:57.196024 16454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:04:57.199201 16454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:04:57.199250 16454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:04:57.199270 16454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:04:57.199288 16454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:04:57.202772 16454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.62:42117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.213.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:04:57.203781 16454 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:04:57.204829 16454 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:04:57.210618 16460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:57.210660 16459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:57.210739 16454 server_base.cc:1047] running on GCE node
W20251213 09:04:57.210660 16462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:57.211381 16454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:04:57.212252 16454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:04:57.213397 16454 hybrid_clock.cc:648] HybridClock initialized: now 1765616697213386 us; error 27 us; skew 500 ppm
I20251213 09:04:57.215070 16454 webserver.cc:492] Webserver started at http://127.15.213.62:43541/ using document root <none> and password file <none>
I20251213 09:04:57.215685 16454 fs_manager.cc:362] Metadata directory not provided
I20251213 09:04:57.215740 16454 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:04:57.215911 16454 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251213 09:04:57.217384 16454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/instance:
uuid: "8fe04e8d31ac4cd9bca8f96335ff1982"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.217828 16454 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal/instance:
uuid: "8fe04e8d31ac4cd9bca8f96335ff1982"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.220978 16454 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20251213 09:04:57.223032 16468 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:57.224050 16454 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251213 09:04:57.224167 16454 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
uuid: "8fe04e8d31ac4cd9bca8f96335ff1982"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.224246 16454 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:04:57.253345 16454 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:04:57.254083 16454 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:04:57.254262 16454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:04:57.261535 16454 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.62:42117
I20251213 09:04:57.261575 16521 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.62:42117 every 8 connection(s)
I20251213 09:04:57.262581 16454 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
I20251213 09:04:57.265686 16522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:57.267954 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 16454
I20251213 09:04:57.268121 16212 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal/instance
I20251213 09:04:57.270027 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--webserver_interface=127.15.213.61
--webserver_port=0
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251213 09:04:57.270251 16522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } has no permanent_uuid. Determining permanent_uuid...
I20251213 09:04:57.282449 16522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } has no permanent_uuid. Determining permanent_uuid...
W20251213 09:04:57.283344 16471 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
W20251213 09:04:57.284327 16522 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.213.61:38171: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:04:57.333570 16522 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } attempt: 1
W20251213 09:04:57.335104 16522 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.213.61:38171: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
W20251213 09:04:57.383678 16523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:04:57.383900 16523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:04:57.383945 16523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:04:57.387137 16523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:04:57.387187 16523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:04:57.387207 16523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:04:57.387225 16523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:04:57.390874 16523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.213.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:04:57.391937 16523 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:04:57.393059 16523 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:04:57.398715 16534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:57.398699 16532 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:57.398829 16523 server_base.cc:1047] running on GCE node
W20251213 09:04:57.398766 16531 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:57.399454 16523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:04:57.400290 16523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:04:57.401433 16523 hybrid_clock.cc:648] HybridClock initialized: now 1765616697401425 us; error 27 us; skew 500 ppm
I20251213 09:04:57.403014 16523 webserver.cc:492] Webserver started at http://127.15.213.61:46495/ using document root <none> and password file <none>
I20251213 09:04:57.403327 16522 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } attempt: 2
I20251213 09:04:57.403620 16523 fs_manager.cc:362] Metadata directory not provided
I20251213 09:04:57.403688 16523 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:04:57.403892 16523 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
W20251213 09:04:57.404699 16522 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.213.61:38171: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:04:57.405520 16523 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/instance:
uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.405936 16523 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal/instance:
uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.409135 16523 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251213 09:04:57.411155 16540 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:57.412127 16523 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:04:57.412233 16523 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.412312 16523 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:04:57.425951 16523 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:04:57.426580 16523 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:04:57.426782 16523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:04:57.433867 16523 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.61:38171
I20251213 09:04:57.433871 16592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.61:38171 every 8 connection(s)
I20251213 09:04:57.434837 16523 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
I20251213 09:04:57.435967 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 16523
I20251213 09:04:57.436074 16212 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal/instance
I20251213 09:04:57.436796 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.60:37605
--webserver_interface=127.15.213.60
--webserver_port=0
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251213 09:04:57.438279 16593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:57.441809 16593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } has no permanent_uuid. Determining permanent_uuid...
I20251213 09:04:57.450667 16593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } has no permanent_uuid. Determining permanent_uuid...
I20251213 09:04:57.456144 16593 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } has no permanent_uuid. Determining permanent_uuid...
W20251213 09:04:57.456776 16544 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:04:57.457552 16593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.213.60:37605: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:04:57.495885 16522 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } attempt: 3
I20251213 09:04:57.500250 16522 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } has no permanent_uuid. Determining permanent_uuid...
W20251213 09:04:57.503913 16522 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.213.60:37605: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:04:57.506752 16593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } attempt: 1
W20251213 09:04:57.507871 16593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.213.60:37605: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:04:57.535082 16522 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } attempt: 1
W20251213 09:04:57.536398 16522 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.213.60:37605: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:04:57.540633 16594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:04:57.540827 16594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:04:57.540906 16594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:04:57.543980 16594 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:04:57.544031 16594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:04:57.544064 16594 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:04:57.544109 16594 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:04:57.547693 16594 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.60:37605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.213.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:04:57.548609 16594 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:04:57.549535 16594 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:04:57.554435 16604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:57.554435 16603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:57.554440 16606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:57.554718 16594 server_base.cc:1047] running on GCE node
I20251213 09:04:57.555222 16594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:04:57.555972 16594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:04:57.557116 16594 hybrid_clock.cc:648] HybridClock initialized: now 1765616697557101 us; error 27 us; skew 500 ppm
I20251213 09:04:57.558703 16594 webserver.cc:492] Webserver started at http://127.15.213.60:39639/ using document root <none> and password file <none>
I20251213 09:04:57.559244 16594 fs_manager.cc:362] Metadata directory not provided
I20251213 09:04:57.559302 16594 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:04:57.559478 16594 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251213 09:04:57.560873 16594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/instance:
uuid: "d7f61ccb4ffd4066babfa94938e28b87"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.561285 16594 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal/instance:
uuid: "d7f61ccb4ffd4066babfa94938e28b87"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.564271 16594 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251213 09:04:57.566179 16612 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:57.567059 16594 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:04:57.567200 16594 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
uuid: "d7f61ccb4ffd4066babfa94938e28b87"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:57.567274 16594 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:04:57.576035 16593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } attempt: 2
W20251213 09:04:57.577247 16593 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.213.60:37605: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:04:57.578368 16594 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:04:57.578874 16594 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:04:57.579015 16594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:04:57.585675 16664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.60:37605 every 8 connection(s)
I20251213 09:04:57.585680 16594 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.60:37605
I20251213 09:04:57.586484 16594 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
I20251213 09:04:57.589018 16665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:57.592136 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 16594
I20251213 09:04:57.592235 16212 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal/instance
I20251213 09:04:57.592165 16665 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } has no permanent_uuid. Determining permanent_uuid...
I20251213 09:04:57.600558 16665 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } has no permanent_uuid. Determining permanent_uuid...
I20251213 09:04:57.604743 16665 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } has no permanent_uuid. Determining permanent_uuid...
I20251213 09:04:57.610881 16665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Bootstrap starting.
I20251213 09:04:57.611528 16522 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } attempt: 2
I20251213 09:04:57.612950 16665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:57.613634 16665 log.cc:826] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Log is configured to *not* fsync() on all Append() calls
I20251213 09:04:57.615622 16665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: No bootstrap required, opened a new log
I20251213 09:04:57.616778 16522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap starting.
I20251213 09:04:57.618317 16665 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:57.618535 16665 raft_consensus.cc:385] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:57.618621 16665 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7f61ccb4ffd4066babfa94938e28b87, State: Initialized, Role: FOLLOWER
I20251213 09:04:57.618970 16522 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:57.619078 16665 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:57.619513 16673 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.619624 16673 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:57.619822 16522 log.cc:826] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Log is configured to *not* fsync() on all Append() calls
I20251213 09:04:57.620098 16665 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:04:57.621255 16522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: No bootstrap required, opened a new log
I20251213 09:04:57.624601 16522 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:57.624853 16522 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:57.624953 16522 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe04e8d31ac4cd9bca8f96335ff1982, State: Initialized, Role: FOLLOWER
I20251213 09:04:57.625717 16522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
W20251213 09:04:57.626005 16688 catalog_manager.cc:1568] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251213 09:04:57.626133 16688 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251213 09:04:57.624271 16594 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: OK, instance_id { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" instance_seqno: 1765616697259399 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20251213 09:04:57.626518 16594 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:04:57.626930 16522 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:04:57.627640 16690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.627830 16690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:57.632828 16454 master_runner.cc:186] Error getting master registration for 127.15.213.61:38171: OK, instance_id { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" instance_seqno: 1765616697431865 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20251213 09:04:57.634409 16454 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:04:57.634405 16705 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251213 09:04:57.634514 16705 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251213 09:04:57.668383 16593 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } attempt: 3
I20251213 09:04:57.676643 16593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap starting.
I20251213 09:04:57.679225 16593 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:57.680069 16593 log.cc:826] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Log is configured to *not* fsync() on all Append() calls
I20251213 09:04:57.681871 16593 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: No bootstrap required, opened a new log
I20251213 09:04:57.685334 16593 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:57.685503 16593 raft_consensus.cc:385] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:57.685551 16593 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Initialized, Role: FOLLOWER
I20251213 09:04:57.686156 16593 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:57.687462 16593 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:04:57.695819 16709 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.695976 16709 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:57.696354 16523 master_runner.cc:263] No leader master found from master f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:04:57.696417 16523 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:04:57.703339 16723 catalog_manager.cc:1568] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251213 09:04:57.703487 16723 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20251213 09:04:57.755717 16474 tablet.cc:2378] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251213 09:04:57.759649 16690 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:57.759814 16690 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:57.760902 16690 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:04:57.761462 16639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87" is_pre_election: true
I20251213 09:04:57.761736 16639 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 0.
I20251213 09:04:57.761837 16567 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" is_pre_election: true
I20251213 09:04:57.762058 16567 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 0.
I20251213 09:04:57.762380 16472 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87; no voters:
I20251213 09:04:57.762846 16690 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:57.762912 16690 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:57.762950 16690 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:57.764066 16690 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:57.764439 16690 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 1 election: Requested vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:04:57.765273 16567 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
I20251213 09:04:57.765394 16567 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:57.766546 16567 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 1.
I20251213 09:04:57.766923 16471 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters:
I20251213 09:04:57.767243 16639 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87"
I20251213 09:04:57.767361 16639 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:57.768429 16639 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 1.
I20251213 09:04:57.768960 16690 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:57.769207 16690 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 1 LEADER]: Becoming Leader. State: Replica: 8fe04e8d31ac4cd9bca8f96335ff1982, State: Running, Role: LEADER
I20251213 09:04:57.769572 16690 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:57.771950 16690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.772131 16690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:04:57.778676 16728 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:04:57.779826 16728 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:04:57.794719 16567 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Refusing update from remote peer 8fe04e8d31ac4cd9bca8f96335ff1982: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:04:57.795476 16639 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 1 FOLLOWER]: Refusing update from remote peer 8fe04e8d31ac4cd9bca8f96335ff1982: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:04:57.796679 16690 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:57.797093 16690 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:57.801545 16673 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.801676 16673 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:57.805797 16709 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.805933 16709 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:57.816098 16726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.816229 16726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:04:57.816985 16690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.817093 16690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:04:57.818207 16709 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.818313 16709 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:57.819376 16732 mvcc.cc:204] Tried to move back new op lower bound from 7231965994159579136 to 7231965994067894272. Current Snapshot: MvccSnapshot[applied={T|T < 7231965994159579136}]
I20251213 09:04:57.819322 16673 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:57.819509 16673 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:57.820114 16728 catalog_manager.cc:1357] Generated new cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:04:57.820174 16728 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:04:57.820219 16734 mvcc.cc:204] Tried to move back new op lower bound from 7231965994159579136 to 7231965994067894272. Current Snapshot: MvccSnapshot[applied={T|T < 7231965994159579136}]
I20251213 09:04:57.883495 16728 catalog_manager.cc:1380] Generated new certificate authority record
I20251213 09:04:57.884814 16728 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:04:57.904107 16728 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Generated new TSK 0
I20251213 09:04:57.904911 16728 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:04:57.905557 16728 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:04:57.906019 16728 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: -1
I20251213 09:04:57.932458 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.213.1:0
--local_ip_for_outbound_sockets=127.15.213.1
--webserver_interface=127.15.213.1
--webserver_port=0
--tserver_master_addrs=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20251213 09:04:58.042292 16739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:04:58.042521 16739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:04:58.042608 16739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:04:58.045954 16739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:04:58.046126 16739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.213.1
I20251213 09:04:58.049881 16739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.213.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.15.213.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--never_fsync=true
--heap_profile_path=/tmp/kudu.16739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.213.1
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:04:58.050977 16739 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:04:58.052158 16739 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:04:58.058713 16745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:58.058797 16744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:58.058729 16747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:58.058781 16739 server_base.cc:1047] running on GCE node
I20251213 09:04:58.059307 16739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:04:58.059844 16739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:04:58.061010 16739 hybrid_clock.cc:648] HybridClock initialized: now 1765616698061000 us; error 30 us; skew 500 ppm
I20251213 09:04:58.062796 16739 webserver.cc:492] Webserver started at http://127.15.213.1:33145/ using document root <none> and password file <none>
I20251213 09:04:58.063422 16739 fs_manager.cc:362] Metadata directory not provided
I20251213 09:04:58.063493 16739 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:04:58.063695 16739 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251213 09:04:58.065208 16739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/data/instance:
uuid: "42c0ccabbfc1460685086e58e05cd152"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.065699 16739 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/instance:
uuid: "42c0ccabbfc1460685086e58e05cd152"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.069140 16739 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251213 09:04:58.071424 16753 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.072446 16739 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251213 09:04:58.072548 16739 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal
uuid: "42c0ccabbfc1460685086e58e05cd152"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.072646 16739 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:04:58.086041 16739 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:04:58.086619 16739 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:04:58.086771 16739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:04:58.087347 16739 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251213 09:04:58.088347 16739 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251213 09:04:58.088395 16739 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.088439 16739 ts_tablet_manager.cc:616] Registered 0 tablets
I20251213 09:04:58.088469 16739 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.096724 16739 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.1:45147
I20251213 09:04:58.096781 16867 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.1:45147 every 8 connection(s)
I20251213 09:04:58.097651 16739 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/data/info.pb
I20251213 09:04:58.098006 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 16739
I20251213 09:04:58.098120 16212 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/instance
I20251213 09:04:58.101673 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.213.2:0
--local_ip_for_outbound_sockets=127.15.213.2
--webserver_interface=127.15.213.2
--webserver_port=0
--tserver_master_addrs=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20251213 09:04:58.108429 16870 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:04:58.108636 16868 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:04:58.108669 16870 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.108719 16868 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.109107 16869 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:04:58.109174 16869 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.109316 16869 heartbeater.cc:507] Master 127.15.213.62:42117 requested a full tablet report, sending...
I20251213 09:04:58.109277 16870 heartbeater.cc:507] Master 127.15.213.61:38171 requested a full tablet report, sending...
I20251213 09:04:58.109277 16868 heartbeater.cc:507] Master 127.15.213.60:37605 requested a full tablet report, sending...
I20251213 09:04:58.110682 16629 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:04:58.110682 16485 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:04:58.111023 16557 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:04:58.112128 16485 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.213.1:48185
W20251213 09:04:58.212836 16876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:04:58.213055 16876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:04:58.213130 16876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:04:58.216320 16876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:04:58.216459 16876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.213.2
I20251213 09:04:58.220532 16876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.213.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.15.213.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--never_fsync=true
--heap_profile_path=/tmp/kudu.16876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.213.2
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:04:58.221627 16876 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:04:58.222671 16876 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:04:58.229074 16884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:58.229094 16881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:58.229080 16882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:58.229389 16876 server_base.cc:1047] running on GCE node
I20251213 09:04:58.229847 16876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:04:58.230338 16876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:04:58.231477 16876 hybrid_clock.cc:648] HybridClock initialized: now 1765616698231461 us; error 30 us; skew 500 ppm
I20251213 09:04:58.233099 16876 webserver.cc:492] Webserver started at http://127.15.213.2:36821/ using document root <none> and password file <none>
I20251213 09:04:58.233619 16876 fs_manager.cc:362] Metadata directory not provided
I20251213 09:04:58.233672 16876 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:04:58.233829 16876 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251213 09:04:58.235361 16876 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/data/instance:
uuid: "ba49ca51d8eb4be288091d19e7114792"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.235802 16876 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/instance:
uuid: "ba49ca51d8eb4be288091d19e7114792"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.239040 16876 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20251213 09:04:58.241171 16890 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.242125 16876 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:04:58.242225 16876 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal
uuid: "ba49ca51d8eb4be288091d19e7114792"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.242300 16876 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:04:58.276799 16876 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:04:58.277657 16876 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:04:58.277834 16876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:04:58.278375 16876 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251213 09:04:58.279385 16876 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251213 09:04:58.279439 16876 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.279480 16876 ts_tablet_manager.cc:616] Registered 0 tablets
I20251213 09:04:58.279495 16876 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.288386 16876 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.2:38345
I20251213 09:04:58.288429 17003 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.2:38345 every 8 connection(s)
I20251213 09:04:58.289441 16876 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/data/info.pb
I20251213 09:04:58.298668 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 16876
I20251213 09:04:58.298774 16212 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/instance
I20251213 09:04:58.298956 17006 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:04:58.298982 17004 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:04:58.299208 17005 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:04:58.299259 17006 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.299293 17005 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.299259 17004 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.299917 17005 heartbeater.cc:507] Master 127.15.213.62:42117 requested a full tablet report, sending...
I20251213 09:04:58.299918 17006 heartbeater.cc:507] Master 127.15.213.61:38171 requested a full tablet report, sending...
I20251213 09:04:58.299918 17004 heartbeater.cc:507] Master 127.15.213.60:37605 requested a full tablet report, sending...
I20251213 09:04:58.301061 16628 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:58.301438 16485 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:58.302086 16485 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.213.2:38131
I20251213 09:04:58.302433 16557 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:58.302826 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.15.213.3:0
--local_ip_for_outbound_sockets=127.15.213.3
--webserver_interface=127.15.213.3
--webserver_port=0
--tserver_master_addrs=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20251213 09:04:58.410702 17011 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:04:58.410934 17011 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:04:58.411011 17011 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:04:58.414192 17011 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:04:58.414324 17011 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.213.3
I20251213 09:04:58.417861 17011 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.15.213.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.15.213.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--never_fsync=true
--heap_profile_path=/tmp/kudu.17011
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.15.213.3
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:04:58.418804 17011 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:04:58.419853 17011 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:04:58.426465 17016 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:58.426520 17011 server_base.cc:1047] running on GCE node
W20251213 09:04:58.426465 17017 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:58.426494 17019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:58.426985 17011 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:04:58.427481 17011 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:04:58.428630 17011 hybrid_clock.cc:648] HybridClock initialized: now 1765616698428608 us; error 35 us; skew 500 ppm
I20251213 09:04:58.430159 17011 webserver.cc:492] Webserver started at http://127.15.213.3:33253/ using document root <none> and password file <none>
I20251213 09:04:58.430711 17011 fs_manager.cc:362] Metadata directory not provided
I20251213 09:04:58.430760 17011 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:04:58.430896 17011 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251213 09:04:58.432307 17011 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/data/instance:
uuid: "9714e48438da4ed8b629934850b1f7ce"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.432708 17011 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/instance:
uuid: "9714e48438da4ed8b629934850b1f7ce"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.435942 17011 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251213 09:04:58.437983 17025 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.438897 17011 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:04:58.438987 17011 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal
uuid: "9714e48438da4ed8b629934850b1f7ce"
format_stamp: "Formatted at 2025-12-13 09:04:58 on dist-test-slave-rpq5"
I20251213 09:04:58.439056 17011 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:04:58.448971 17011 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:04:58.449565 17011 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:04:58.449726 17011 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:04:58.450237 17011 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251213 09:04:58.451257 17011 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251213 09:04:58.451309 17011 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.451370 17011 ts_tablet_manager.cc:616] Registered 0 tablets
I20251213 09:04:58.451402 17011 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:58.460158 17011 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.3:40367
I20251213 09:04:58.460306 17138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.3:40367 every 8 connection(s)
I20251213 09:04:58.461220 17011 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/data/info.pb
I20251213 09:04:58.468361 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 17011
I20251213 09:04:58.468497 16212 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/instance
I20251213 09:04:58.470733 17141 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:04:58.470773 17140 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:04:58.470981 17140 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.471242 17139 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:04:58.471316 17139 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.471674 17139 heartbeater.cc:507] Master 127.15.213.60:37605 requested a full tablet report, sending...
I20251213 09:04:58.471674 17140 heartbeater.cc:507] Master 127.15.213.62:42117 requested a full tablet report, sending...
I20251213 09:04:58.470981 17141 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:58.471949 17141 heartbeater.cc:507] Master 127.15.213.61:38171 requested a full tablet report, sending...
I20251213 09:04:58.472728 16485 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:58.472764 16557 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:58.472878 16628 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:58.473479 16485 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.15.213.3:42005
I20251213 09:04:58.486961 16212 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251213 09:04:58.500627 16212 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu with pid 16523
I20251213 09:04:58.504225 16482 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_09f90194fbf44cf0b08c91cebff82558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.504524 16478 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_5003d762cb904c4e89d7f2640365a0e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.504801 16481 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_41f7effcd98d46dfb108ac0039d2d37d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.504840 16477 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_cd97e84e8af44577b495cce860493273"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.505066 16480 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_2a5c2b913d7940e191e58e3896de02fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.507357 16479 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_b29e3e8850284e0887299b7aa5868189"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.507606 16476 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_aafe4f0475054e60b2069240902f63ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.504318 16483 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_6a60e92df30c4d2d82969065613768d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.503968 16485 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_1c53c9ca376f4d3fb0db870f9fb12452"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:58.504258 16484 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_094df91e4bb1472a9b3ba69cdf32f14a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251213 09:04:58.538815 16478 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_5003d762cb904c4e89d7f2640365a0e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:04:58.613833 16869 heartbeater.cc:499] Master 127.15.213.62:42117 was elected leader, sending a full tablet report...
W20251213 09:04:58.614550 16870 heartbeater.cc:646] Failed to heartbeat to 127.15.213.61:38171 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:04:58.627822 16688 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:04:58.627920 16688 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: loading cluster ID for follower catalog manager: success
I20251213 09:04:58.630568 16688 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: acquiring CA information for follower catalog manager: success
I20251213 09:04:58.632496 16688 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20251213 09:04:58.787648 16471 consensus_peers.cc:597] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 -> Peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Couldn't send request to peer f0ef4ffe02ab44248dc97cb1c5cceac1. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20251213 09:04:58.803717 17006 heartbeater.cc:646] Failed to heartbeat to 127.15.213.61:38171 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:04:58.804188 17005 heartbeater.cc:499] Master 127.15.213.62:42117 was elected leader, sending a full tablet report...
I20251213 09:04:58.953917 16478 catalog_manager.cc:2174] created HMS catalog entry for table [id=4ec61addd21c4307bce7a9891a6983ee]
W20251213 09:04:58.956593 16481 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_41f7effcd98d46dfb108ac0039d2d37d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:58.956584 16479 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b29e3e8850284e0887299b7aa5868189 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:58.956779 16484 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_094df91e4bb1472a9b3ba69cdf32f14a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:58.957453 16477 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cd97e84e8af44577b495cce860493273 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:58.957494 16485 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1c53c9ca376f4d3fb0db870f9fb12452 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:58.957763 16483 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6a60e92df30c4d2d82969065613768d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:58.958245 16480 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2a5c2b913d7940e191e58e3896de02fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:58.958335 16476 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_aafe4f0475054e60b2069240902f63ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:58.958974 16482 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_09f90194fbf44cf0b08c91cebff82558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:04:58.969686 16478 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_5003d762cb904c4e89d7f2640365a0e3" } new_table_name: "default.Table_36b3468fc09644f19f0e34101ca664a7" modify_external_catalogs: true
W20251213 09:04:58.974615 17141 heartbeater.cc:646] Failed to heartbeat to 127.15.213.61:38171 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:04:58.975272 17140 heartbeater.cc:499] Master 127.15.213.62:42117 was elected leader, sending a full tablet report...
I20251213 09:04:58.987969 16938 tablet_service.cc:1505] Processing CreateTablet for tablet bb335d16237044f89012d203aef40ef2 (DEFAULT_TABLE table=default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:58.988564 16801 tablet_service.cc:1505] Processing CreateTablet for tablet bb335d16237044f89012d203aef40ef2 (DEFAULT_TABLE table=default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:58.989068 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb335d16237044f89012d203aef40ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:58.989518 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb335d16237044f89012d203aef40ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:58.996029 17202 tablet_bootstrap.cc:492] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:58.996449 17201 tablet_bootstrap.cc:492] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:58.998845 17201 tablet_bootstrap.cc:654] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:58.999176 17202 tablet_bootstrap.cc:654] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:58.999845 17201 log.cc:826] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Log is configured to *not* fsync() on all Append() calls
I20251213 09:04:58.999511 17073 tablet_service.cc:1505] Processing CreateTablet for tablet bb335d16237044f89012d203aef40ef2 (DEFAULT_TABLE table=default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:58.999910 17202 log.cc:826] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: Log is configured to *not* fsync() on all Append() calls
I20251213 09:04:59.000608 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb335d16237044f89012d203aef40ef2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.001639 17202 tablet_bootstrap.cc:492] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.001641 17201 tablet_bootstrap.cc:492] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.001828 17201 ts_tablet_manager.cc:1403] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20251213 09:04:59.001828 17202 ts_tablet_manager.cc:1403] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20251213 09:04:59.005069 17202 raft_consensus.cc:359] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.005291 17202 raft_consensus.cc:385] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.005337 17202 raft_consensus.cc:740] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.005393 17201 raft_consensus.cc:359] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.005566 17201 raft_consensus.cc:385] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.005610 17201 raft_consensus.cc:740] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.005847 17202 consensus_queue.cc:260] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.006059 17201 consensus_queue.cc:260] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.006793 17202 ts_tablet_manager.cc:1434] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20251213 09:04:59.006793 17201 ts_tablet_manager.cc:1434] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20251213 09:04:59.009229 17207 tablet_bootstrap.cc:492] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.009940 16481 catalog_manager.cc:2174] created HMS catalog entry for table [id=36adcbe9600b45698aaf15dcc1bb56fb]
I20251213 09:04:59.012490 17207 tablet_bootstrap.cc:654] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.013428 17207 log.cc:826] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: Log is configured to *not* fsync() on all Append() calls
I20251213 09:04:59.017412 17207 tablet_bootstrap.cc:492] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.017591 17207 ts_tablet_manager.cc:1403] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20251213 09:04:59.020331 17072 tablet_service.cc:1505] Processing CreateTablet for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c (DEFAULT_TABLE table=default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.020622 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.021024 16481 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_41f7effcd98d46dfb108ac0039d2d37d" } new_table_name: "default.Table_cfed201f26564767a4a57c58382df9b9" modify_external_catalogs: true
I20251213 09:04:59.021888 16801 tablet_service.cc:1505] Processing CreateTablet for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c (DEFAULT_TABLE table=default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.022159 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.023355 16938 tablet_service.cc:1505] Processing CreateTablet for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c (DEFAULT_TABLE table=default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.023597 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.023499 17207 raft_consensus.cc:359] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.023689 17207 raft_consensus.cc:385] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.023741 17207 raft_consensus.cc:740] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.024180 17207 consensus_queue.cc:260] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.024281 17202 tablet_bootstrap.cc:492] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.025095 17207 ts_tablet_manager.cc:1434] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20251213 09:04:59.025543 17202 tablet_bootstrap.cc:654] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.025786 17201 tablet_bootstrap.cc:492] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.026800 17201 tablet_bootstrap.cc:654] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.027597 17202 tablet_bootstrap.cc:492] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.027673 17202 ts_tablet_manager.cc:1403] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:04:59.028283 17202 raft_consensus.cc:359] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.028374 17202 raft_consensus.cc:385] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.028417 17202 raft_consensus.cc:740] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.028518 17202 consensus_queue.cc:260] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.028861 17202 ts_tablet_manager.cc:1434] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.031188 17207 tablet_bootstrap.cc:492] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.032146 17207 tablet_bootstrap.cc:654] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.033004 17201 tablet_bootstrap.cc:492] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.033099 17201 ts_tablet_manager.cc:1403] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20251213 09:04:59.033646 17201 raft_consensus.cc:359] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.033748 17201 raft_consensus.cc:385] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.033788 17201 raft_consensus.cc:740] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.033916 17201 consensus_queue.cc:260] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.034198 17201 ts_tablet_manager.cc:1434] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.036522 17207 tablet_bootstrap.cc:492] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.036612 17207 ts_tablet_manager.cc:1403] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:04:59.037210 17207 raft_consensus.cc:359] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.037319 17207 raft_consensus.cc:385] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.037365 17207 raft_consensus.cc:740] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.037513 17207 consensus_queue.cc:260] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.037776 17207 ts_tablet_manager.cc:1434] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251213 09:04:59.041469 17007 tablet.cc:2378] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251213 09:04:59.054524 16484 catalog_manager.cc:2174] created HMS catalog entry for table [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:04:59.056051 17205 raft_consensus.cc:493] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.056223 17205 raft_consensus.cc:515] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.057541 17205 leader_election.cc:290] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.062455 16484 master_service.cc:954] ReplaceTablet: received request to replace tablet bb335d16237044f89012d203aef40ef2 from {username='slave'} at 127.0.0.1:51496
I20251213 09:04:59.062419 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcbac9f274fe4dd7bbf9abb48c49bd5c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.062713 17093 raft_consensus.cc:2468] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:04:59.063194 16757 leader_election.cc:304] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.063478 17205 raft_consensus.cc:2804] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.063568 17205 raft_consensus.cc:493] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.063614 17205 raft_consensus.cc:3060] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.064703 17205 raft_consensus.cc:515] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.065042 17205 leader_election.cc:290] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.065582 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcbac9f274fe4dd7bbf9abb48c49bd5c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.065717 17093 raft_consensus.cc:3060] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.066859 17093 raft_consensus.cc:2468] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:04:59.067260 16757 leader_election.cc:304] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.067483 17205 raft_consensus.cc:2804] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.067737 17205 raft_consensus.cc:697] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:04:59.068522 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcbac9f274fe4dd7bbf9abb48c49bd5c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:04:59.068799 16958 raft_consensus.cc:2468] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:04:59.069078 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dcbac9f274fe4dd7bbf9abb48c49bd5c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:04:59.069182 16957 raft_consensus.cc:3060] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.070223 16957 raft_consensus.cc:2468] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:04:59.070840 16484 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet bb335d16237044f89012d203aef40ef2
I20251213 09:04:59.068128 17205 consensus_queue.cc:237] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.071264 16484 catalog_manager.cc:6724] ReplaceTablet: tablet bb335d16237044f89012d203aef40ef2 deleted and replaced by tablet 6e4693a4e4fb456ebf977edf2ae8399b
I20251213 09:04:59.071564 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet bb335d16237044f89012d203aef40ef2 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e4693a4e4fb456ebf977edf2ae8399b) from {username='slave'} at 127.0.0.1:49302
I20251213 09:04:59.072469 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet bb335d16237044f89012d203aef40ef2 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e4693a4e4fb456ebf977edf2ae8399b) from {username='slave'} at 127.0.0.1:51868
I20251213 09:04:59.072674 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet bb335d16237044f89012d203aef40ef2 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e4693a4e4fb456ebf977edf2ae8399b) from {username='slave'} at 127.0.0.1:38044
I20251213 09:04:59.074709 17217 tablet_replica.cc:333] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:04:59.075057 17217 raft_consensus.cc:2243] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Raft consensus shutting down.
I20251213 09:04:59.075394 17217 raft_consensus.cc:2272] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.075927 17216 tablet_replica.cc:333] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:04:59.076164 17216 raft_consensus.cc:2243] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251213 09:04:59.076337 17216 raft_consensus.cc:2272] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.076969 17217 ts_tablet_manager.cc:1916] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.078016 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 521d6a129d6a445eba83dcaed7a47449 (DEFAULT_TABLE table=default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.078244 17215 tablet_replica.cc:333] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:04:59.078260 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521d6a129d6a445eba83dcaed7a47449. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.078851 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 521d6a129d6a445eba83dcaed7a47449 (DEFAULT_TABLE table=default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.079108 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521d6a129d6a445eba83dcaed7a47449. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.079190 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 521d6a129d6a445eba83dcaed7a47449 (DEFAULT_TABLE table=default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.079419 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 521d6a129d6a445eba83dcaed7a47449. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.081270 17207 tablet_bootstrap.cc:492] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.081434 17201 tablet_bootstrap.cc:492] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.082307 17207 tablet_bootstrap.cc:654] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.082458 17201 tablet_bootstrap.cc:654] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.083238 17202 tablet_bootstrap.cc:492] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.078559 17215 raft_consensus.cc:2243] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251213 09:04:59.083492 17215 raft_consensus.cc:2272] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.084190 17202 tablet_bootstrap.cc:654] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.084509 17215 ts_tablet_manager.cc:1916] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.086616 17215 ts_tablet_manager.cc:1929] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:04:59.086706 17215 log.cc:1199] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/bb335d16237044f89012d203aef40ef2
I20251213 09:04:59.089476 17217 ts_tablet_manager.cc:1929] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:04:59.090051 16484 master_service.cc:954] ReplaceTablet: received request to replace tablet dcbac9f274fe4dd7bbf9abb48c49bd5c from {username='slave'} at 127.0.0.1:51496
I20251213 09:04:59.090179 17207 tablet_bootstrap.cc:492] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.090296 17207 ts_tablet_manager.cc:1403] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:04:59.090655 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 6e4693a4e4fb456ebf977edf2ae8399b (DEFAULT_TABLE table=default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.090749 17207 raft_consensus.cc:359] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.090845 17207 raft_consensus.cc:385] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.090863 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e4693a4e4fb456ebf977edf2ae8399b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.090873 17207 raft_consensus.cc:740] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.091046 17207 consensus_queue.cc:260] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.091462 17207 ts_tablet_manager.cc:1434] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.092478 17217 log.cc:1199] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/bb335d16237044f89012d203aef40ef2
I20251213 09:04:59.092670 17207 tablet_bootstrap.cc:492] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.093885 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 6e4693a4e4fb456ebf977edf2ae8399b (DEFAULT_TABLE table=default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.094020 17207 tablet_bootstrap.cc:654] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.094120 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e4693a4e4fb456ebf977edf2ae8399b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.094833 17217 ts_tablet_manager.cc:1950] T bb335d16237044f89012d203aef40ef2 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:04:59.096257 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet bb335d16237044f89012d203aef40ef2 (table default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:04:59.096570 17202 tablet_bootstrap.cc:492] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.096650 17202 ts_tablet_manager.cc:1403] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251213 09:04:59.097179 16484 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet dcbac9f274fe4dd7bbf9abb48c49bd5c
I20251213 09:04:59.097333 17202 raft_consensus.cc:359] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.097455 17202 raft_consensus.cc:385] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.097489 17202 raft_consensus.cc:740] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.097599 17202 consensus_queue.cc:260] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.097833 17202 ts_tablet_manager.cc:1434] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.097992 16484 catalog_manager.cc:6724] ReplaceTablet: tablet dcbac9f274fe4dd7bbf9abb48c49bd5c deleted and replaced by tablet ae4b3ae0e6cb4169861d12d90756c401
I20251213 09:04:59.099609 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c with delete_type TABLET_DATA_DELETED (replaced by tablet ae4b3ae0e6cb4169861d12d90756c401) from {username='slave'} at 127.0.0.1:38044
I20251213 09:04:59.099960 17202 tablet_bootstrap.cc:492] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
W20251213 09:04:59.100078 16871 tablet.cc:2378] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251213 09:04:59.100893 17202 tablet_bootstrap.cc:654] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.101912 17216 ts_tablet_manager.cc:1916] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.102532 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c with delete_type TABLET_DATA_DELETED (replaced by tablet ae4b3ae0e6cb4169861d12d90756c401) from {username='slave'} at 127.0.0.1:51868
I20251213 09:04:59.089354 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 6e4693a4e4fb456ebf977edf2ae8399b (DEFAULT_TABLE table=default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.102893 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e4693a4e4fb456ebf977edf2ae8399b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.102950 17215 ts_tablet_manager.cc:1950] T bb335d16237044f89012d203aef40ef2 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:04:59.104115 17217 tablet_replica.cc:333] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:04:59.104218 17217 raft_consensus.cc:2243] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:04:59.104331 17217 raft_consensus.cc:2272] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.097738 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet dcbac9f274fe4dd7bbf9abb48c49bd5c with delete_type TABLET_DATA_DELETED (replaced by tablet ae4b3ae0e6cb4169861d12d90756c401) from {username='slave'} at 127.0.0.1:49302
I20251213 09:04:59.105080 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet bb335d16237044f89012d203aef40ef2 (table default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:04:59.106652 17216 ts_tablet_manager.cc:1929] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:04:59.106984 16937 tablet_service.cc:1505] Processing CreateTablet for tablet ae4b3ae0e6cb4169861d12d90756c401 (DEFAULT_TABLE table=default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.107259 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4b3ae0e6cb4169861d12d90756c401. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.107271 17073 tablet_service.cc:1505] Processing CreateTablet for tablet ae4b3ae0e6cb4169861d12d90756c401 (DEFAULT_TABLE table=default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.107493 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4b3ae0e6cb4169861d12d90756c401. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.109601 17217 ts_tablet_manager.cc:1916] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.111477 17217 ts_tablet_manager.cc:1929] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:04:59.111640 17215 tablet_replica.cc:333] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:04:59.107249 16801 tablet_service.cc:1505] Processing CreateTablet for tablet ae4b3ae0e6cb4169861d12d90756c401 (DEFAULT_TABLE table=default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.111929 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae4b3ae0e6cb4169861d12d90756c401. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.112509 16484 master_service.cc:954] ReplaceTablet: received request to replace tablet dcbac9f274fe4dd7bbf9abb48c49bd5c from {username='slave'} at 127.0.0.1:51496
I20251213 09:04:59.112810 16484 master_service.cc:954] ReplaceTablet: received request to replace tablet dcbac9f274fe4dd7bbf9abb48c49bd5c from {username='slave'} at 127.0.0.1:51496
I20251213 09:04:59.113072 16484 master_service.cc:954] ReplaceTablet: received request to replace tablet bb335d16237044f89012d203aef40ef2 from {username='slave'} at 127.0.0.1:51496
I20251213 09:04:59.113358 16484 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_094df91e4bb1472a9b3ba69cdf32f14a" } new_table_name: "default.Table_d884ba72f14242f19c59cb34de4b7f36" modify_external_catalogs: true
I20251213 09:04:59.114115 17202 tablet_bootstrap.cc:492] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.114215 17202 ts_tablet_manager.cc:1403] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251213 09:04:59.114722 17202 raft_consensus.cc:359] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.114840 17202 raft_consensus.cc:385] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.114883 17202 raft_consensus.cc:740] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.115010 17202 consensus_queue.cc:260] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.115324 17202 ts_tablet_manager.cc:1434] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.115367 16479 catalog_manager.cc:2174] created HMS catalog entry for table [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:04:59.117278 17202 tablet_bootstrap.cc:492] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.118237 17202 tablet_bootstrap.cc:654] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.119395 17215 raft_consensus.cc:2243] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:04:59.119526 17216 log.cc:1199] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/bb335d16237044f89012d203aef40ef2
I20251213 09:04:59.119903 17216 ts_tablet_manager.cc:1950] T bb335d16237044f89012d203aef40ef2 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:04:59.120070 17215 raft_consensus.cc:2272] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.120613 17215 ts_tablet_manager.cc:1916] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.120646 17202 tablet_bootstrap.cc:492] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.120860 17202 ts_tablet_manager.cc:1403] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:04:59.120939 16479 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_b29e3e8850284e0887299b7aa5868189" } new_table_name: "default.Table_63ce7db97320462daf62f4af78345483" modify_external_catalogs: true
I20251213 09:04:59.121448 17202 raft_consensus.cc:359] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.121603 17202 raft_consensus.cc:385] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.121685 17202 raft_consensus.cc:740] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.121852 17202 consensus_queue.cc:260] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.123521 17202 ts_tablet_manager.cc:1434] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:04:59.124122 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet bb335d16237044f89012d203aef40ef2 (table default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:04:59.124399 17216 tablet_replica.cc:333] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:04:59.116326 17207 tablet_bootstrap.cc:492] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.124590 17207 ts_tablet_manager.cc:1403] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20251213 09:04:59.125133 17207 raft_consensus.cc:359] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.125234 17207 raft_consensus.cc:385] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.125272 17207 raft_consensus.cc:740] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.125404 17207 consensus_queue.cc:260] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.125669 17207 ts_tablet_manager.cc:1434] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.125881 17207 tablet_bootstrap.cc:492] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.126870 17207 tablet_bootstrap.cc:654] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.129537 17217 log.cc:1199] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/dcbac9f274fe4dd7bbf9abb48c49bd5c
I20251213 09:04:59.129757 17216 raft_consensus.cc:2243] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:04:59.130036 17216 pending_rounds.cc:70] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Trying to abort 1 pending ops.
I20251213 09:04:59.130126 16937 tablet_service.cc:1505] Processing CreateTablet for tablet c8276392af2740258e804f72f7529d16 (DEFAULT_TABLE table=default.table_b29e3e8850284e0887299b7aa5868189 [id=57463d6c4bc24d45ab54ddf180a102cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.130172 17216 pending_rounds.cc:77] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231965999401213952 op_type: NO_OP noop_request { }
I20251213 09:04:59.130270 17216 raft_consensus.cc:2889] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251213 09:04:59.130434 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8276392af2740258e804f72f7529d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.130586 17217 ts_tablet_manager.cc:1950] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:04:59.131218 17216 raft_consensus.cc:2272] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.131306 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet dcbac9f274fe4dd7bbf9abb48c49bd5c (table default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:04:59.131873 17215 ts_tablet_manager.cc:1929] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:04:59.131932 17215 log.cc:1199] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/dcbac9f274fe4dd7bbf9abb48c49bd5c
I20251213 09:04:59.132134 17215 ts_tablet_manager.cc:1950] T dcbac9f274fe4dd7bbf9abb48c49bd5c P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:04:59.133163 17216 ts_tablet_manager.cc:1916] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.133769 16801 tablet_service.cc:1505] Processing CreateTablet for tablet c8276392af2740258e804f72f7529d16 (DEFAULT_TABLE table=default.table_b29e3e8850284e0887299b7aa5868189 [id=57463d6c4bc24d45ab54ddf180a102cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.133996 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8276392af2740258e804f72f7529d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.133960 17073 tablet_service.cc:1505] Processing CreateTablet for tablet c8276392af2740258e804f72f7529d16 (DEFAULT_TABLE table=default.table_b29e3e8850284e0887299b7aa5868189 [id=57463d6c4bc24d45ab54ddf180a102cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.134231 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8276392af2740258e804f72f7529d16. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.136337 17202 tablet_bootstrap.cc:492] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.137321 17202 tablet_bootstrap.cc:654] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.139470 17216 ts_tablet_manager.cc:1929] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:04:59.140626 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet dcbac9f274fe4dd7bbf9abb48c49bd5c (table default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:04:59.140844 17207 tablet_bootstrap.cc:492] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.140944 17207 ts_tablet_manager.cc:1403] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20251213 09:04:59.141376 17207 raft_consensus.cc:359] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.141474 17207 raft_consensus.cc:385] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.141510 17207 raft_consensus.cc:740] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.141654 17207 consensus_queue.cc:260] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.141889 17207 ts_tablet_manager.cc:1434] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.142079 17207 tablet_bootstrap.cc:492] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.143007 17207 tablet_bootstrap.cc:654] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.144083 17216 log.cc:1199] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/dcbac9f274fe4dd7bbf9abb48c49bd5c
I20251213 09:04:59.144392 17216 ts_tablet_manager.cc:1950] T dcbac9f274fe4dd7bbf9abb48c49bd5c P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:04:59.139918 17202 tablet_bootstrap.cc:492] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.144544 17207 tablet_bootstrap.cc:492] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.144621 17207 ts_tablet_manager.cc:1403] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:04:59.144634 17202 ts_tablet_manager.cc:1403] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251213 09:04:59.145032 17207 raft_consensus.cc:359] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.145032 17202 raft_consensus.cc:359] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.145135 17207 raft_consensus.cc:385] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.145138 17202 raft_consensus.cc:385] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.145172 17207 raft_consensus.cc:740] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.145172 17202 raft_consensus.cc:740] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.145295 17207 consensus_queue.cc:260] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.145326 17202 consensus_queue.cc:260] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.145581 17207 ts_tablet_manager.cc:1434] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:04:59.146040 17202 ts_tablet_manager.cc:1434] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.147346 17201 tablet_bootstrap.cc:492] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.147418 17201 ts_tablet_manager.cc:1403] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.066s user 0.001s sys 0.001s
I20251213 09:04:59.147909 17201 raft_consensus.cc:359] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.148017 17201 raft_consensus.cc:385] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.148051 17201 raft_consensus.cc:740] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.148190 17201 consensus_queue.cc:260] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.148473 17201 ts_tablet_manager.cc:1434] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.148653 17201 tablet_bootstrap.cc:492] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.149655 17201 tablet_bootstrap.cc:654] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.150506 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet dcbac9f274fe4dd7bbf9abb48c49bd5c (table default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:04:59.151340 17201 tablet_bootstrap.cc:492] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.151427 17201 ts_tablet_manager.cc:1403] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:04:59.151763 17201 raft_consensus.cc:359] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.151844 17201 raft_consensus.cc:385] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.151880 17201 raft_consensus.cc:740] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.151988 17201 consensus_queue.cc:260] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.152194 17201 ts_tablet_manager.cc:1434] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.152372 17201 tablet_bootstrap.cc:492] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.153239 17201 tablet_bootstrap.cc:654] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.154126 17201 tablet_bootstrap.cc:492] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.154202 17201 ts_tablet_manager.cc:1403] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251213 09:04:59.154742 17201 raft_consensus.cc:359] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.154843 17201 raft_consensus.cc:385] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.154877 17201 raft_consensus.cc:740] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.155002 17201 consensus_queue.cc:260] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.155256 17201 ts_tablet_manager.cc:1434] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.155467 17201 tablet_bootstrap.cc:492] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.156641 17201 tablet_bootstrap.cc:654] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.157835 17201 tablet_bootstrap.cc:492] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.157956 17201 ts_tablet_manager.cc:1403] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251213 09:04:59.158392 17201 raft_consensus.cc:359] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.158541 17201 raft_consensus.cc:385] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.158614 17201 raft_consensus.cc:740] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.158789 17201 consensus_queue.cc:260] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.160701 17201 ts_tablet_manager.cc:1434] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:04:59.168476 16477 catalog_manager.cc:2174] created HMS catalog entry for table [id=b710aa4328c74aa3a83cb63bb8a55a68]
I20251213 09:04:59.176173 17206 raft_consensus.cc:493] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.176292 17206 raft_consensus.cc:515] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.177611 17206 leader_election.cc:290] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.177850 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 9d4afab5a05d4bc2b442a338b777adce (DEFAULT_TABLE table=default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.178160 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4afab5a05d4bc2b442a338b777adce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.180367 17202 tablet_bootstrap.cc:492] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.181092 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 9d4afab5a05d4bc2b442a338b777adce (DEFAULT_TABLE table=default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.181334 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4afab5a05d4bc2b442a338b777adce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.181370 17202 tablet_bootstrap.cc:654] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.182449 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 9d4afab5a05d4bc2b442a338b777adce (DEFAULT_TABLE table=default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.182724 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d4afab5a05d4bc2b442a338b777adce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.184813 17207 tablet_bootstrap.cc:492] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.185846 17207 tablet_bootstrap.cc:654] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.186960 16477 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_233a6a0146384e14bd0d8ff512419278"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:59.187927 17202 tablet_bootstrap.cc:492] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.188026 17202 ts_tablet_manager.cc:1403] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251213 09:04:59.188519 17202 raft_consensus.cc:359] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.188617 17202 raft_consensus.cc:385] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.188653 17202 raft_consensus.cc:740] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.188771 17202 consensus_queue.cc:260] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.189052 17202 ts_tablet_manager.cc:1434] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.191701 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8276392af2740258e804f72f7529d16" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.191885 16821 raft_consensus.cc:2468] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.192370 17207 tablet_bootstrap.cc:492] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.192438 17207 ts_tablet_manager.cc:1403] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251213 09:04:59.192850 17207 raft_consensus.cc:359] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.192958 17207 raft_consensus.cc:385] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.192987 17207 raft_consensus.cc:740] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.193133 17207 consensus_queue.cc:260] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.193379 17207 ts_tablet_manager.cc:1434] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.194996 17222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:59.195151 17222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:04:59.195806 16891 leader_election.cc:304] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.197299 17206 raft_consensus.cc:2804] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.197394 17206 raft_consensus.cc:493] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.197448 17206 raft_consensus.cc:3060] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.197873 17209 raft_consensus.cc:493] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.197965 17209 raft_consensus.cc:515] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.198421 17206 raft_consensus.cc:515] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.198745 17206 leader_election.cc:290] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.198912 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8276392af2740258e804f72f7529d16" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.199002 17093 raft_consensus.cc:2468] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.199095 17209 leader_election.cc:290] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:59.200134 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8276392af2740258e804f72f7529d16" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.200249 16821 raft_consensus.cc:3060] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.201040 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8276392af2740258e804f72f7529d16" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.201130 17093 raft_consensus.cc:3060] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.201306 16821 raft_consensus.cc:2468] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.201960 17093 raft_consensus.cc:2468] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.203809 16891 leader_election.cc:304] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.204000 17206 raft_consensus.cc:2804] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.204221 17206 raft_consensus.cc:697] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:04:59.204478 17206 consensus_queue.cc:237] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.206427 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e4693a4e4fb456ebf977edf2ae8399b" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:04:59.206538 16957 raft_consensus.cc:2468] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:04:59.206897 17028 leader_election.cc:304] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.207190 17209 raft_consensus.cc:2804] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.207245 17209 raft_consensus.cc:493] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.207279 17209 raft_consensus.cc:3060] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.208214 17209 raft_consensus.cc:515] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.208557 17209 leader_election.cc:290] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:59.208730 17201 tablet_bootstrap.cc:492] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.209024 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e4693a4e4fb456ebf977edf2ae8399b" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:04:59.209123 16957 raft_consensus.cc:3060] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.209887 16957 raft_consensus.cc:2468] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:04:59.210196 17028 leader_election.cc:304] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.210408 17209 raft_consensus.cc:2804] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.210590 17209 raft_consensus.cc:697] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:04:59.210824 17209 consensus_queue.cc:237] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.211226 17201 tablet_bootstrap.cc:654] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
W20251213 09:04:59.213202 17142 tablet.cc:2378] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251213 09:04:59.215927 17201 tablet_bootstrap.cc:492] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.216086 17201 ts_tablet_manager.cc:1403] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251213 09:04:59.216902 17201 raft_consensus.cc:359] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.217065 17201 raft_consensus.cc:385] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.217144 17201 raft_consensus.cc:740] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.217326 17201 consensus_queue.cc:260] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.218011 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e4693a4e4fb456ebf977edf2ae8399b" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.218159 16821 raft_consensus.cc:2468] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:04:59.218398 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e4693a4e4fb456ebf977edf2ae8399b" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.218487 16820 raft_consensus.cc:3060] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.219955 17201 ts_tablet_manager.cc:1434] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251213 09:04:59.219990 16820 raft_consensus.cc:2468] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:04:59.227674 16485 catalog_manager.cc:2174] created HMS catalog entry for table [id=76b019b500b54894a7cc86f8c1239727]
I20251213 09:04:59.240155 16801 tablet_service.cc:1505] Processing CreateTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 (DEFAULT_TABLE table=default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.240310 16937 tablet_service.cc:1505] Processing CreateTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 (DEFAULT_TABLE table=default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.240437 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f77966ed8c42f09ac6ea8154ad7165. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.240520 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f77966ed8c42f09ac6ea8154ad7165. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.242478 17202 tablet_bootstrap.cc:492] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.242770 16485 catalog_manager.cc:5654] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:04:59.243419 17202 tablet_bootstrap.cc:654] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.245052 17073 tablet_service.cc:1505] Processing CreateTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 (DEFAULT_TABLE table=default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.245343 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f77966ed8c42f09ac6ea8154ad7165. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.247606 17207 tablet_bootstrap.cc:492] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.248476 16485 catalog_manager.cc:5654] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:04:59.248760 17207 tablet_bootstrap.cc:654] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.249089 17201 tablet_bootstrap.cc:492] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.250094 17201 tablet_bootstrap.cc:654] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.251281 17202 tablet_bootstrap.cc:492] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.251386 17202 ts_tablet_manager.cc:1403] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251213 09:04:59.251895 17202 raft_consensus.cc:359] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.252010 17202 raft_consensus.cc:385] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.252044 17202 raft_consensus.cc:740] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.252163 17202 consensus_queue.cc:260] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.252447 17202 ts_tablet_manager.cc:1434] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.255666 17207 tablet_bootstrap.cc:492] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.255755 17207 ts_tablet_manager.cc:1403] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251213 09:04:59.256278 17207 raft_consensus.cc:359] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.256392 17207 raft_consensus.cc:385] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.256428 17207 raft_consensus.cc:740] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.256558 17207 consensus_queue.cc:260] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.256837 17207 ts_tablet_manager.cc:1434] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:04:59.257787 16483 catalog_manager.cc:2174] created HMS catalog entry for table [id=f57307f860a84afe95f647e0e492ae68]
I20251213 09:04:59.260394 16485 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_cd97e84e8af44577b495cce860493273" } new_table_name: "default.Table_924224088c604b9682478db9e1bbe741" modify_external_catalogs: true
I20251213 09:04:59.261277 17201 tablet_bootstrap.cc:492] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.261374 17201 ts_tablet_manager.cc:1403] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20251213 09:04:59.261960 17201 raft_consensus.cc:359] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.262072 17201 raft_consensus.cc:385] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.262110 17201 raft_consensus.cc:740] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.262292 17201 consensus_queue.cc:260] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.263926 16483 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_d6d6d9a459ff460f97765707846c32ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:59.265144 17201 ts_tablet_manager.cc:1434] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:04:59.270212 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 91176a6c085d43adab389621b96b1da7 (DEFAULT_TABLE table=default.table_6a60e92df30c4d2d82969065613768d5 [id=f57307f860a84afe95f647e0e492ae68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.270468 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91176a6c085d43adab389621b96b1da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.272671 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 91176a6c085d43adab389621b96b1da7 (DEFAULT_TABLE table=default.table_6a60e92df30c4d2d82969065613768d5 [id=f57307f860a84afe95f647e0e492ae68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.272972 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91176a6c085d43adab389621b96b1da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.275094 17207 tablet_bootstrap.cc:492] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.276175 17207 tablet_bootstrap.cc:654] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.276916 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 91176a6c085d43adab389621b96b1da7 (DEFAULT_TABLE table=default.table_6a60e92df30c4d2d82969065613768d5 [id=f57307f860a84afe95f647e0e492ae68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.277148 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91176a6c085d43adab389621b96b1da7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.278632 17202 tablet_bootstrap.cc:492] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.278954 17201 tablet_bootstrap.cc:492] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.279704 17202 tablet_bootstrap.cc:654] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.280086 17201 tablet_bootstrap.cc:654] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.281170 17202 tablet_bootstrap.cc:492] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.281172 17201 tablet_bootstrap.cc:492] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.281412 17202 ts_tablet_manager.cc:1403] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251213 09:04:59.281543 17201 ts_tablet_manager.cc:1403] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:04:59.282008 17202 raft_consensus.cc:359] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.282032 17201 raft_consensus.cc:359] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.282153 17202 raft_consensus.cc:385] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.282194 17202 raft_consensus.cc:740] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.282307 17201 raft_consensus.cc:385] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.282334 17202 consensus_queue.cc:260] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.282387 17201 raft_consensus.cc:740] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.282649 17202 ts_tablet_manager.cc:1434] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251213 09:04:59.282646 17201 consensus_queue.cc:260] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.283028 17201 ts_tablet_manager.cc:1434] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.287721 17207 tablet_bootstrap.cc:492] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.287858 17207 ts_tablet_manager.cc:1403] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251213 09:04:59.288460 17207 raft_consensus.cc:359] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.288581 17207 raft_consensus.cc:385] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.288612 17207 raft_consensus.cc:740] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.288745 17207 consensus_queue.cc:260] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.289016 17207 ts_tablet_manager.cc:1434] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.295243 16476 catalog_manager.cc:2174] created HMS catalog entry for table [id=42fe64ec82d444a89520ce173f7f1792]
I20251213 09:04:59.305529 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 07824c32051a4b7d99dc01951a27c0f6 (DEFAULT_TABLE table=default.table_aafe4f0475054e60b2069240902f63ca [id=42fe64ec82d444a89520ce173f7f1792]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.305858 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07824c32051a4b7d99dc01951a27c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.308216 17201 tablet_bootstrap.cc:492] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.309132 17201 tablet_bootstrap.cc:654] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.309214 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 07824c32051a4b7d99dc01951a27c0f6 (DEFAULT_TABLE table=default.table_aafe4f0475054e60b2069240902f63ca [id=42fe64ec82d444a89520ce173f7f1792]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.309517 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07824c32051a4b7d99dc01951a27c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.312390 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 07824c32051a4b7d99dc01951a27c0f6 (DEFAULT_TABLE table=default.table_aafe4f0475054e60b2069240902f63ca [id=42fe64ec82d444a89520ce173f7f1792]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.312675 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07824c32051a4b7d99dc01951a27c0f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.315017 17202 tablet_bootstrap.cc:492] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.316113 17202 tablet_bootstrap.cc:654] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.317739 17237 raft_consensus.cc:493] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.317836 17237 raft_consensus.cc:515] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.318253 17237 leader_election.cc:290] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.318557 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91176a6c085d43adab389621b96b1da7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.318701 17201 tablet_bootstrap.cc:492] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.318691 16820 raft_consensus.cc:2468] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.318701 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91176a6c085d43adab389621b96b1da7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.318776 17201 ts_tablet_manager.cc:1403] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251213 09:04:59.318814 17093 raft_consensus.cc:2468] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.318982 16891 leader_election.cc:304] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.319200 17202 tablet_bootstrap.cc:492] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.319216 17237 raft_consensus.cc:2804] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.319259 17237 raft_consensus.cc:493] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.319279 17202 ts_tablet_manager.cc:1403] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:04:59.319299 17237 raft_consensus.cc:3060] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.319757 17202 raft_consensus.cc:359] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.320225 17237 raft_consensus.cc:515] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.319851 17202 raft_consensus.cc:385] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.320480 17202 raft_consensus.cc:740] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.320578 17237 leader_election.cc:290] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.320691 17202 consensus_queue.cc:260] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.320951 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91176a6c085d43adab389621b96b1da7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.321033 16820 raft_consensus.cc:3060] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.321563 16476 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_1c53c9ca376f4d3fb0db870f9fb12452" } modify_external_catalogs: true
I20251213 09:04:59.321695 16476 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_1c53c9ca376f4d3fb0db870f9fb12452" } modify_external_catalogs: true
I20251213 09:04:59.321832 16820 raft_consensus.cc:2468] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.322082 16891 leader_election.cc:304] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.322434 17201 raft_consensus.cc:359] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.322521 17201 raft_consensus.cc:385] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.322558 17201 raft_consensus.cc:740] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.322659 17201 consensus_queue.cc:260] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.322928 17201 ts_tablet_manager.cc:1434] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:04:59.322979 17202 ts_tablet_manager.cc:1434] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:04:59.323091 17206 raft_consensus.cc:2804] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.323412 17206 raft_consensus.cc:697] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:04:59.323544 17206 consensus_queue.cc:237] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.325503 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91176a6c085d43adab389621b96b1da7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.325619 17093 raft_consensus.cc:3060] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.326531 17093 raft_consensus.cc:2468] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.327831 17207 tablet_bootstrap.cc:492] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.328794 17207 tablet_bootstrap.cc:654] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.329980 17207 tablet_bootstrap.cc:492] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.330058 17207 ts_tablet_manager.cc:1403] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251213 09:04:59.330447 17207 raft_consensus.cc:359] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.330529 17207 raft_consensus.cc:385] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.330571 17207 raft_consensus.cc:740] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.330690 17207 consensus_queue.cc:260] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.330947 17207 ts_tablet_manager.cc:1434] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.333724 17239 raft_consensus.cc:493] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.333820 17239 raft_consensus.cc:515] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.334151 17239 leader_election.cc:290] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:04:59.334460 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d4afab5a05d4bc2b442a338b777adce" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:04:59.334506 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d4afab5a05d4bc2b442a338b777adce" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.334568 16957 raft_consensus.cc:2468] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:04:59.334600 16820 raft_consensus.cc:2468] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:04:59.334837 16480 catalog_manager.cc:2174] created HMS catalog entry for table [id=0b651bb014924526b0c76609312aac24]
I20251213 09:04:59.334883 17026 leader_election.cc:304] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.335042 17239 raft_consensus.cc:2804] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.335098 17239 raft_consensus.cc:493] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.335170 17239 raft_consensus.cc:3060] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.335646 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--webserver_interface=127.15.213.61
--webserver_port=46495
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251213 09:04:59.336258 17239 raft_consensus.cc:515] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.336616 17239 leader_election.cc:290] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:04:59.337301 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d4afab5a05d4bc2b442a338b777adce" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.337395 16820 raft_consensus.cc:3060] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.337726 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d4afab5a05d4bc2b442a338b777adce" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:04:59.337814 16957 raft_consensus.cc:3060] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.338275 16820 raft_consensus.cc:2468] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:04:59.338538 17026 leader_election.cc:304] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.338748 16957 raft_consensus.cc:2468] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:04:59.339255 17239 raft_consensus.cc:2804] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.339349 17239 raft_consensus.cc:697] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:04:59.339486 17239 consensus_queue.cc:237] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.351540 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 41ccb58d3de9424c929c6e21e47d931e (DEFAULT_TABLE table=default.table_2a5c2b913d7940e191e58e3896de02fc [id=0b651bb014924526b0c76609312aac24]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.351859 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ccb58d3de9424c929c6e21e47d931e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.351927 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 41ccb58d3de9424c929c6e21e47d931e (DEFAULT_TABLE table=default.table_2a5c2b913d7940e191e58e3896de02fc [id=0b651bb014924526b0c76609312aac24]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.352183 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ccb58d3de9424c929c6e21e47d931e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.352190 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 41ccb58d3de9424c929c6e21e47d931e (DEFAULT_TABLE table=default.table_2a5c2b913d7940e191e58e3896de02fc [id=0b651bb014924526b0c76609312aac24]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.352313 16480 catalog_manager.cc:5654] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:04:59.352454 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41ccb58d3de9424c929c6e21e47d931e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.354681 17201 tablet_bootstrap.cc:492] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.355779 17201 tablet_bootstrap.cc:654] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.356504 17207 tablet_bootstrap.cc:492] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.357542 17207 tablet_bootstrap.cc:654] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.358315 17201 tablet_bootstrap.cc:492] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.358407 17201 ts_tablet_manager.cc:1403] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:04:59.358522 17202 tablet_bootstrap.cc:492] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.358845 17201 raft_consensus.cc:359] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.358952 17201 raft_consensus.cc:385] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.358982 17201 raft_consensus.cc:740] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.359098 17201 consensus_queue.cc:260] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.359628 17202 tablet_bootstrap.cc:654] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.361564 17201 ts_tablet_manager.cc:1434] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:04:59.362681 16480 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_1eb38c19e2ee4d43bce7ee0f6617f5d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:04:59.362845 17239 raft_consensus.cc:493] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.362929 17239 raft_consensus.cc:515] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.363313 17239 leader_election.cc:290] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:59.363751 17207 tablet_bootstrap.cc:492] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.363713 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "521d6a129d6a445eba83dcaed7a47449" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:04:59.363826 17207 ts_tablet_manager.cc:1403] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20251213 09:04:59.363826 16957 raft_consensus.cc:2468] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:04:59.364104 17028 leader_election.cc:304] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.364259 17239 raft_consensus.cc:2804] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.364313 17239 raft_consensus.cc:493] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.364362 17239 raft_consensus.cc:3060] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.364933 17207 raft_consensus.cc:359] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.365020 17207 raft_consensus.cc:385] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.365058 17207 raft_consensus.cc:740] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.365190 17207 consensus_queue.cc:260] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.365340 17239 raft_consensus.cc:515] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.365655 17239 leader_election.cc:290] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:59.366010 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "521d6a129d6a445eba83dcaed7a47449" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:04:59.366017 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "521d6a129d6a445eba83dcaed7a47449" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.366119 16957 raft_consensus.cc:3060] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.366151 16820 raft_consensus.cc:2468] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:04:59.366956 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "521d6a129d6a445eba83dcaed7a47449" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.367066 16820 raft_consensus.cc:3060] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.367072 16957 raft_consensus.cc:2468] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:04:59.367343 17028 leader_election.cc:304] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.367558 17207 ts_tablet_manager.cc:1434] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:04:59.367580 17239 raft_consensus.cc:2804] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.367655 17239 raft_consensus.cc:697] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:04:59.367774 17239 consensus_queue.cc:237] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.368046 16820 raft_consensus.cc:2468] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:04:59.372983 17239 raft_consensus.cc:493] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.373070 17239 raft_consensus.cc:515] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.373391 17239 leader_election.cc:290] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:59.373910 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4b3ae0e6cb4169861d12d90756c401" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.374022 16820 raft_consensus.cc:2468] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:04:59.374446 17026 leader_election.cc:304] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.374878 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4b3ae0e6cb4169861d12d90756c401" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:04:59.374998 16957 raft_consensus.cc:2468] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:04:59.375464 17239 raft_consensus.cc:2804] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.375522 17239 raft_consensus.cc:493] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.375566 17239 raft_consensus.cc:3060] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.375612 17202 tablet_bootstrap.cc:492] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.375702 17202 ts_tablet_manager.cc:1403] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.002s
I20251213 09:04:59.376191 17202 raft_consensus.cc:359] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.376288 17202 raft_consensus.cc:385] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.376319 17202 raft_consensus.cc:740] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.376441 17202 consensus_queue.cc:260] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.376636 17239 raft_consensus.cc:515] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.376736 17202 ts_tablet_manager.cc:1434] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.377292 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4b3ae0e6cb4169861d12d90756c401" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.377399 16820 raft_consensus.cc:3060] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.378271 16820 raft_consensus.cc:2468] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:04:59.378585 17026 leader_election.cc:304] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.378752 17209 raft_consensus.cc:2804] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.378937 17209 raft_consensus.cc:697] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:04:59.379083 17209 consensus_queue.cc:237] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.381074 16482 catalog_manager.cc:2174] created HMS catalog entry for table [id=c38ae9af9154460b93e3daaf2a32f4ca]
I20251213 09:04:59.382973 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae4b3ae0e6cb4169861d12d90756c401" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:04:59.383096 16957 raft_consensus.cc:3060] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.384097 16957 raft_consensus.cc:2468] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:04:59.384441 17239 leader_election.cc:290] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:59.390359 16482 catalog_manager.cc:5654] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } }
I20251213 09:04:59.391039 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 621515f0f52e4378a5bd09989a72a06c (DEFAULT_TABLE table=default.table_09f90194fbf44cf0b08c91cebff82558 [id=c38ae9af9154460b93e3daaf2a32f4ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.391045 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 621515f0f52e4378a5bd09989a72a06c (DEFAULT_TABLE table=default.table_09f90194fbf44cf0b08c91cebff82558 [id=c38ae9af9154460b93e3daaf2a32f4ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.391315 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621515f0f52e4378a5bd09989a72a06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.391335 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621515f0f52e4378a5bd09989a72a06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.393391 17201 tablet_bootstrap.cc:492] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.393947 17202 tablet_bootstrap.cc:492] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.394541 17201 tablet_bootstrap.cc:654] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.394883 17202 tablet_bootstrap.cc:654] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.396840 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 621515f0f52e4378a5bd09989a72a06c (DEFAULT_TABLE table=default.table_09f90194fbf44cf0b08c91cebff82558 [id=c38ae9af9154460b93e3daaf2a32f4ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.397114 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 621515f0f52e4378a5bd09989a72a06c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.399080 17207 tablet_bootstrap.cc:492] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.400060 17207 tablet_bootstrap.cc:654] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.400851 17201 tablet_bootstrap.cc:492] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.400940 17201 ts_tablet_manager.cc:1403] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251213 09:04:59.401381 17201 raft_consensus.cc:359] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.401485 17201 raft_consensus.cc:385] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.401525 17201 raft_consensus.cc:740] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.401638 17201 consensus_queue.cc:260] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.401885 17201 ts_tablet_manager.cc:1434] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.403468 16482 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_6a60e92df30c4d2d82969065613768d5" } modify_external_catalogs: true
I20251213 09:04:59.403522 17202 tablet_bootstrap.cc:492] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.403599 17207 tablet_bootstrap.cc:492] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.403597 16482 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_6a60e92df30c4d2d82969065613768d5" } modify_external_catalogs: true
I20251213 09:04:59.403626 17202 ts_tablet_manager.cc:1403] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.001s
I20251213 09:04:59.403672 17207 ts_tablet_manager.cc:1403] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:04:59.404078 17207 raft_consensus.cc:359] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.404100 17202 raft_consensus.cc:359] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.404176 17207 raft_consensus.cc:385] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.404207 17207 raft_consensus.cc:740] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.404213 17202 raft_consensus.cc:385] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.404246 17202 raft_consensus.cc:740] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.404322 17207 consensus_queue.cc:260] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.404366 17202 consensus_queue.cc:260] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.404608 17207 ts_tablet_manager.cc:1434] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.404660 17202 ts_tablet_manager.cc:1434] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.475549 17214 raft_consensus.cc:493] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.475696 17214 raft_consensus.cc:515] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.476204 17214 leader_election.cc:290] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.476276 17250 raft_consensus.cc:493] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.476380 17250 raft_consensus.cc:515] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.476810 17250 leader_election.cc:290] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.477036 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07824c32051a4b7d99dc01951a27c0f6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:04:59.477164 16957 raft_consensus.cc:2468] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:04:59.477262 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07824c32051a4b7d99dc01951a27c0f6" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.477385 17093 raft_consensus.cc:2468] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.477568 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07824c32051a4b7d99dc01951a27c0f6" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.477679 16820 raft_consensus.cc:2468] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.477726 16894 leader_election.cc:304] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.477881 17250 raft_consensus.cc:2804] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.477924 17250 raft_consensus.cc:493] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.477955 17250 raft_consensus.cc:3060] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.478711 16756 leader_election.cc:304] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.479017 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07824c32051a4b7d99dc01951a27c0f6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.479099 17250 raft_consensus.cc:515] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.479168 17093 raft_consensus.cc:2468] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:04:59.479493 17250 leader_election.cc:290] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.479795 17214 raft_consensus.cc:2804] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.479858 17214 raft_consensus.cc:493] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.479899 17214 raft_consensus.cc:3060] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.480918 17214 raft_consensus.cc:515] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.481266 17214 leader_election.cc:290] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.481596 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07824c32051a4b7d99dc01951a27c0f6" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.481758 16820 raft_consensus.cc:2393] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba49ca51d8eb4be288091d19e7114792 in current term 1: Already voted for candidate 42c0ccabbfc1460685086e58e05cd152 in this term.
I20251213 09:04:59.482712 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07824c32051a4b7d99dc01951a27c0f6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.482824 17092 raft_consensus.cc:3060] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.483934 17092 raft_consensus.cc:2468] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:04:59.484238 16757 leader_election.cc:304] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.484537 17214 raft_consensus.cc:2804] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.484530 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07824c32051a4b7d99dc01951a27c0f6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:04:59.484615 17214 raft_consensus.cc:697] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:04:59.484694 16957 raft_consensus.cc:2393] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 42c0ccabbfc1460685086e58e05cd152 in current term 1: Already voted for candidate ba49ca51d8eb4be288091d19e7114792 in this term.
I20251213 09:04:59.484750 17214 consensus_queue.cc:237] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.484961 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07824c32051a4b7d99dc01951a27c0f6" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.485111 17093 raft_consensus.cc:2393] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ba49ca51d8eb4be288091d19e7114792 in current term 1: Already voted for candidate 42c0ccabbfc1460685086e58e05cd152 in this term.
I20251213 09:04:59.485507 16894 leader_election.cc:304] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ba49ca51d8eb4be288091d19e7114792; no voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce
I20251213 09:04:59.485729 17250 raft_consensus.cc:2749] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251213 09:04:59.517015 17214 raft_consensus.cc:493] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.517153 17214 raft_consensus.cc:515] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.517621 17214 leader_election.cc:290] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.518339 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41ccb58d3de9424c929c6e21e47d931e" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.518489 17093 raft_consensus.cc:2468] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:04:59.518808 16757 leader_election.cc:304] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.519106 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41ccb58d3de9424c929c6e21e47d931e" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:04:59.519224 17214 raft_consensus.cc:2804] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.519253 16957 raft_consensus.cc:2468] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:04:59.519276 17214 raft_consensus.cc:493] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.519312 17214 raft_consensus.cc:3060] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
W20251213 09:04:59.519917 17253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:04:59.520185 17253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:04:59.520249 17253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20251213 09:04:59.520188 17214 raft_consensus.cc:515] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:04:59.520537 17214 leader_election.cc:290] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.520907 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41ccb58d3de9424c929c6e21e47d931e" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:04:59.521059 16957 raft_consensus.cc:3060] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.522023 16957 raft_consensus.cc:2468] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:04:59.522320 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41ccb58d3de9424c929c6e21e47d931e" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.522440 17093 raft_consensus.cc:3060] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.523434 17093 raft_consensus.cc:2468] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:04:59.523746 16757 leader_election.cc:304] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:04:59.523954 17214 raft_consensus.cc:2804] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.524031 17214 raft_consensus.cc:697] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:04:59.524164 17214 consensus_queue.cc:237] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
W20251213 09:04:59.525096 17253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:04:59.525151 17253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:04:59.525178 17253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:04:59.525204 17253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:04:59.531337 17253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.213.61
--webserver_port=46495
--never_fsync=true
--heap_profile_path=/tmp/kudu.17253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:04:59.532958 17253 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:04:59.534403 17253 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:04:59.541332 17273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:59.542256 17271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:04:59.543342 17270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:04:59.543778 17253 server_base.cc:1047] running on GCE node
I20251213 09:04:59.544510 17253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:04:59.545545 17253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:04:59.546828 17253 hybrid_clock.cc:648] HybridClock initialized: now 1765616699546803 us; error 42 us; skew 500 ppm
I20251213 09:04:59.548553 17253 webserver.cc:492] Webserver started at http://127.15.213.61:46495/ using document root <none> and password file <none>
I20251213 09:04:59.549136 17253 fs_manager.cc:362] Metadata directory not provided
I20251213 09:04:59.549216 17253 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:04:59.552541 17253 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20251213 09:04:59.554396 17279 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:04:59.555375 17253 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251213 09:04:59.555481 17253 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:04:59.555912 17253 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:04:59.573601 17253 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:04:59.574250 17253 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:04:59.574424 17253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:04:59.581916 17250 raft_consensus.cc:493] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.582042 17250 raft_consensus.cc:515] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.582540 17250 leader_election.cc:290] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.583894 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f77966ed8c42f09ac6ea8154ad7165" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.584054 16820 raft_consensus.cc:2468] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.584342 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f77966ed8c42f09ac6ea8154ad7165" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.584481 17093 raft_consensus.cc:2468] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.584946 16894 leader_election.cc:304] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.585439 17250 raft_consensus.cc:2804] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.585497 17250 raft_consensus.cc:493] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.585536 17250 raft_consensus.cc:3060] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.586659 17250 raft_consensus.cc:515] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.587039 17250 leader_election.cc:290] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.588550 17331 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.61:38171 every 8 connection(s)
I20251213 09:04:59.588563 17253 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.61:38171
I20251213 09:04:59.589980 17253 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
I20251213 09:04:59.591925 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f77966ed8c42f09ac6ea8154ad7165" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.592054 17093 raft_consensus.cc:3060] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.593037 17093 raft_consensus.cc:2468] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.593393 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d7f77966ed8c42f09ac6ea8154ad7165" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.593525 16820 raft_consensus.cc:3060] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.594491 16820 raft_consensus.cc:2468] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.594815 16894 leader_election.cc:304] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.595341 17250 raft_consensus.cc:2804] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.595326 17259 consensus_queue.cc:1048] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.595431 17250 raft_consensus.cc:697] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:04:59.595566 17250 consensus_queue.cc:237] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.599267 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 17253
I20251213 09:04:59.600728 17239 consensus_queue.cc:1048] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.612237 17006 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:04:59.612397 17141 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:04:59.618302 16870 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:04:59.619382 17332 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:04:59.621491 17332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap starting.
I20251213 09:04:59.629202 17332 log.cc:826] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Log is configured to *not* fsync() on all Append() calls
I20251213 09:04:59.636735 17332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251213 09:04:59.637365 17332 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap complete.
I20251213 09:04:59.641361 17332 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:59.641743 17332 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.642282 17332 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:04:59.643602 17332 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:04:59.647456 17250 raft_consensus.cc:493] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.647576 17250 raft_consensus.cc:515] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.648028 17250 leader_election.cc:290] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.648967 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621515f0f52e4378a5bd09989a72a06c" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.649102 16820 raft_consensus.cc:2468] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.649374 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621515f0f52e4378a5bd09989a72a06c" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.649493 17093 raft_consensus.cc:2468] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.649892 16894 leader_election.cc:304] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.650372 17250 raft_consensus.cc:2804] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.650430 17250 raft_consensus.cc:493] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.650465 17250 raft_consensus.cc:3060] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.651520 17250 raft_consensus.cc:515] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.651603 17359 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:04:59.651639 17359 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: loading cluster ID for follower catalog manager: success
I20251213 09:04:59.651872 17250 leader_election.cc:290] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.652626 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621515f0f52e4378a5bd09989a72a06c" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.652736 17093 raft_consensus.cc:3060] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.653638 17093 raft_consensus.cc:2468] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.653923 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "621515f0f52e4378a5bd09989a72a06c" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.654037 16820 raft_consensus.cc:3060] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.654187 17359 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: acquiring CA information for follower catalog manager: success
I20251213 09:04:59.654912 16820 raft_consensus.cc:2468] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.655342 16894 leader_election.cc:304] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.655630 17345 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:59.655766 17345 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:59.655985 17250 raft_consensus.cc:2804] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.656062 17250 raft_consensus.cc:697] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:04:59.656198 17250 consensus_queue.cc:237] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.656426 17359 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:04:59.659281 17294 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:46469; Asking this server to re-register.
I20251213 09:04:59.660159 17006 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:59.661718 17294 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:04:59.686051 17250 consensus_queue.cc:1048] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.688732 17294 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:50563; Asking this server to re-register.
I20251213 09:04:59.689392 16870 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:59.689529 16478 catalog_manager.cc:3485] renamed table default.table_5003d762cb904c4e89d7f2640365a0e3 [id=4ec61addd21c4307bce7a9891a6983ee] in HMS: new name default.table_36b3468fc09644f19f0e34101ca664a7
I20251213 09:04:59.690572 17294 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
W20251213 09:04:59.692759 16480 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:59.693507 16477 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_233a6a0146384e14bd0d8ff512419278 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:04:59.692773 16483 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d6d6d9a459ff460f97765707846c32ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:04:59.698997 17206 consensus_queue.cc:1048] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.705591 16478 catalog_manager.cc:5654] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:04:59.705937 16478 catalog_manager.cc:5654] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:04:59.707095 17294 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:39915; Asking this server to re-register.
I20251213 09:04:59.709012 17141 heartbeater.cc:461] Registering TS with master...
I20251213 09:04:59.710194 17294 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.718678 16478 catalog_manager.cc:5654] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:04:59.719259 16478 catalog_manager.cc:5654] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:04:59.719563 16478 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 6e4693a4e4fb456ebf977edf2ae8399b (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:04:59.719182 17368 tablet.cc:1722] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:04:59.725283 16478 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 6e4693a4e4fb456ebf977edf2ae8399b (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:04:59.726471 16478 catalog_manager.cc:5654] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:04:59.726712 16478 catalog_manager.cc:5654] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } }
I20251213 09:04:59.726920 16478 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 6e4693a4e4fb456ebf977edf2ae8399b (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:04:59.735340 17367 tablet.cc:1722] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:04:59.739933 17369 tablet.cc:1722] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:04:59.742583 16478 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee] alter complete (version 1)
I20251213 09:04:59.746366 16478 master_service.cc:954] ReplaceTablet: received request to replace tablet 9d4afab5a05d4bc2b442a338b777adce from {username='slave'} at 127.0.0.1:51496
I20251213 09:04:59.752599 16478 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 9d4afab5a05d4bc2b442a338b777adce
I20251213 09:04:59.753288 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 9d4afab5a05d4bc2b442a338b777adce with delete_type TABLET_DATA_DELETED (replaced by tablet d735ff6da0d24a1d902e50ac154c5d26) from {username='slave'} at 127.0.0.1:49302
I20251213 09:04:59.754043 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 9d4afab5a05d4bc2b442a338b777adce with delete_type TABLET_DATA_DELETED (replaced by tablet d735ff6da0d24a1d902e50ac154c5d26) from {username='slave'} at 127.0.0.1:38044
I20251213 09:04:59.754809 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 9d4afab5a05d4bc2b442a338b777adce with delete_type TABLET_DATA_DELETED (replaced by tablet d735ff6da0d24a1d902e50ac154c5d26) from {username='slave'} at 127.0.0.1:51868
I20251213 09:04:59.755376 17370 tablet_replica.cc:333] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:04:59.757922 16478 catalog_manager.cc:6724] ReplaceTablet: tablet 9d4afab5a05d4bc2b442a338b777adce deleted and replaced by tablet d735ff6da0d24a1d902e50ac154c5d26
I20251213 09:04:59.755530 17370 raft_consensus.cc:2243] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:04:59.759824 17370 raft_consensus.cc:2272] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.760926 16937 tablet_service.cc:1505] Processing CreateTablet for tablet d735ff6da0d24a1d902e50ac154c5d26 (DEFAULT_TABLE table=default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.761216 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d735ff6da0d24a1d902e50ac154c5d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.761647 17371 tablet_replica.cc:333] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:04:59.761783 17371 raft_consensus.cc:2243] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:04:59.762071 17371 pending_rounds.cc:70] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Trying to abort 1 pending ops.
I20251213 09:04:59.762195 17371 pending_rounds.cc:77] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231966000499511296 op_type: NO_OP noop_request { }
I20251213 09:04:59.762643 17370 ts_tablet_manager.cc:1916] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.763533 17201 tablet_bootstrap.cc:492] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.764628 17201 tablet_bootstrap.cc:654] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.764925 17370 ts_tablet_manager.cc:1929] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:04:59.764994 17370 log.cc:1199] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/9d4afab5a05d4bc2b442a338b777adce
I20251213 09:04:59.765225 17370 ts_tablet_manager.cc:1950] T 9d4afab5a05d4bc2b442a338b777adce P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:04:59.765906 17372 tablet_replica.cc:333] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:04:59.766048 17372 raft_consensus.cc:2243] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:04:59.766002 16801 tablet_service.cc:1505] Processing CreateTablet for tablet d735ff6da0d24a1d902e50ac154c5d26 (DEFAULT_TABLE table=default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.766158 17372 raft_consensus.cc:2272] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.766294 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d735ff6da0d24a1d902e50ac154c5d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.766518 17372 ts_tablet_manager.cc:1916] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.762282 17371 raft_consensus.cc:2889] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251213 09:04:59.767259 17371 raft_consensus.cc:2272] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.768051 17371 ts_tablet_manager.cc:1916] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.768550 17202 tablet_bootstrap.cc:492] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.769647 17202 tablet_bootstrap.cc:654] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.770748 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 9d4afab5a05d4bc2b442a338b777adce (table default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:04:59.771587 17073 tablet_service.cc:1505] Processing CreateTablet for tablet d735ff6da0d24a1d902e50ac154c5d26 (DEFAULT_TABLE table=default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.771847 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d735ff6da0d24a1d902e50ac154c5d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.773936 17207 tablet_bootstrap.cc:492] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.774370 16481 catalog_manager.cc:3485] renamed table default.table_41f7effcd98d46dfb108ac0039d2d37d [id=36adcbe9600b45698aaf15dcc1bb56fb] in HMS: new name default.table_cfed201f26564767a4a57c58382df9b9
I20251213 09:04:59.774993 17207 tablet_bootstrap.cc:654] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.779170 16478 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_aafe4f0475054e60b2069240902f63ca" } modify_external_catalogs: true
I20251213 09:04:59.779402 16478 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_aafe4f0475054e60b2069240902f63ca" } modify_external_catalogs: true
I20251213 09:04:59.780543 17202 tablet_bootstrap.cc:492] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.780637 17202 ts_tablet_manager.cc:1403] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20251213 09:04:59.781153 17202 raft_consensus.cc:359] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.781260 17202 raft_consensus.cc:385] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.781313 17202 raft_consensus.cc:740] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.781455 17202 consensus_queue.cc:260] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.781782 17202 ts_tablet_manager.cc:1434] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.783366 17201 tablet_bootstrap.cc:492] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.783468 17201 ts_tablet_manager.cc:1403] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251213 09:04:59.783957 17201 raft_consensus.cc:359] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.784145 17201 raft_consensus.cc:385] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.784184 17201 raft_consensus.cc:740] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.784327 17201 consensus_queue.cc:260] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.784642 17201 ts_tablet_manager.cc:1434] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.789319 17371 ts_tablet_manager.cc:1929] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:04:59.790953 17372 ts_tablet_manager.cc:1929] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:04:59.790999 17207 tablet_bootstrap.cc:492] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.791265 17207 ts_tablet_manager.cc:1403] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251213 09:04:59.791812 17207 raft_consensus.cc:359] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.791920 17207 raft_consensus.cc:385] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.791958 17207 raft_consensus.cc:740] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.792104 17207 consensus_queue.cc:260] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.792407 17207 ts_tablet_manager.cc:1434] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.795301 17371 log.cc:1199] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/9d4afab5a05d4bc2b442a338b777adce
I20251213 09:04:59.795667 17371 ts_tablet_manager.cc:1950] T 9d4afab5a05d4bc2b442a338b777adce P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:04:59.795796 17372 log.cc:1199] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/9d4afab5a05d4bc2b442a338b777adce
I20251213 09:04:59.796079 17372 ts_tablet_manager.cc:1950] T 9d4afab5a05d4bc2b442a338b777adce P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:04:59.796895 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 9d4afab5a05d4bc2b442a338b777adce (table default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:04:59.797731 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 9d4afab5a05d4bc2b442a338b777adce (table default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:04:59.806712 17206 consensus_queue.cc:1048] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.814278 17250 consensus_queue.cc:1048] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.822252 17239 consensus_queue.cc:1048] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.829458 17345 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:59.829623 17345 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:04:59.834336 17250 raft_consensus.cc:493] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:04:59.834448 17250 raft_consensus.cc:515] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.834862 17250 leader_election.cc:290] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.835495 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d735ff6da0d24a1d902e50ac154c5d26" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:04:59.835659 16821 raft_consensus.cc:2468] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.836676 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d735ff6da0d24a1d902e50ac154c5d26" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:04:59.836802 17092 raft_consensus.cc:2468] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:04:59.837196 16891 leader_election.cc:304] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.838356 17250 raft_consensus.cc:2804] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:04:59.838418 17250 raft_consensus.cc:493] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:04:59.838456 17250 raft_consensus.cc:3060] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.840000 17250 raft_consensus.cc:515] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.840385 17250 leader_election.cc:290] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:04:59.840873 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d735ff6da0d24a1d902e50ac154c5d26" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:04:59.840992 17092 raft_consensus.cc:3060] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.841991 17092 raft_consensus.cc:2468] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.842687 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d735ff6da0d24a1d902e50ac154c5d26" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:04:59.842808 16821 raft_consensus.cc:3060] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:04:59.843845 16821 raft_consensus.cc:2468] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:04:59.844291 16894 leader_election.cc:304] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:04:59.844677 17250 raft_consensus.cc:2804] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:04:59.844769 17250 raft_consensus.cc:697] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:04:59.844902 17250 consensus_queue.cc:237] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.849781 16484 catalog_manager.cc:3485] renamed table default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c] in HMS: new name default.table_d884ba72f14242f19c59cb34de4b7f36
I20251213 09:04:59.855646 17209 consensus_queue.cc:1048] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.912114 16479 catalog_manager.cc:3485] renamed table default.table_b29e3e8850284e0887299b7aa5868189 [id=57463d6c4bc24d45ab54ddf180a102cd] in HMS: new name default.table_63ce7db97320462daf62f4af78345483
I20251213 09:04:59.940865 16480 catalog_manager.cc:2174] created HMS catalog entry for table [id=f0f07fd6e72744a18f77618b42da106f]
I20251213 09:04:59.942565 17222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:04:59.942700 17222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:04:59.959803 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 41c1a0b4450842fda55296abeea8dfae (DEFAULT_TABLE table=default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.959836 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 41c1a0b4450842fda55296abeea8dfae (DEFAULT_TABLE table=default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.960122 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c1a0b4450842fda55296abeea8dfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.960156 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c1a0b4450842fda55296abeea8dfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.962215 17207 tablet_bootstrap.cc:492] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:04:59.962369 17202 tablet_bootstrap.cc:492] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:04:59.963217 17207 tablet_bootstrap.cc:654] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.963380 17202 tablet_bootstrap.cc:654] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.965268 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 41c1a0b4450842fda55296abeea8dfae (DEFAULT_TABLE table=default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:04:59.965570 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c1a0b4450842fda55296abeea8dfae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:04:59.968061 17201 tablet_bootstrap.cc:492] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:04:59.969455 17201 tablet_bootstrap.cc:654] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:04:59.970943 17207 tablet_bootstrap.cc:492] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:04:59.971036 17207 ts_tablet_manager.cc:1403] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20251213 09:04:59.971540 17207 raft_consensus.cc:359] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.971647 17207 raft_consensus.cc:385] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.971671 17207 raft_consensus.cc:740] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.971787 17207 consensus_queue.cc:260] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.972029 17207 ts_tablet_manager.cc:1434] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:04:59.972535 16480 master_service.cc:954] ReplaceTablet: received request to replace tablet 6e4693a4e4fb456ebf977edf2ae8399b from {username='slave'} at 127.0.0.1:51496
I20251213 09:04:59.975883 17205 consensus_queue.cc:1048] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.978340 17250 consensus_queue.cc:1048] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.986665 17214 consensus_queue.cc:1048] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.987881 17201 tablet_bootstrap.cc:492] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:04:59.988003 17201 ts_tablet_manager.cc:1403] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.000s
I20251213 09:04:59.988597 17202 tablet_bootstrap.cc:492] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:04:59.988606 17201 raft_consensus.cc:359] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.988698 17202 ts_tablet_manager.cc:1403] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20251213 09:04:59.988725 17201 raft_consensus.cc:385] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.988765 17201 raft_consensus.cc:740] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.988920 17201 consensus_queue.cc:260] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.989111 17202 raft_consensus.cc:359] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.989214 17202 raft_consensus.cc:385] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:04:59.989246 17202 raft_consensus.cc:740] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:04:59.989370 17202 consensus_queue.cc:260] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:04:59.989637 17202 ts_tablet_manager.cc:1434] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:04:59.990684 17201 ts_tablet_manager.cc:1434] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:04:59.991609 17209 consensus_queue.cc:1048] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.994097 16480 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 6e4693a4e4fb456ebf977edf2ae8399b
I20251213 09:04:59.994469 16480 catalog_manager.cc:6724] ReplaceTablet: tablet 6e4693a4e4fb456ebf977edf2ae8399b deleted and replaced by tablet a883a3870b05405baec92e54ed13c64d
I20251213 09:04:59.994875 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e4693a4e4fb456ebf977edf2ae8399b with delete_type TABLET_DATA_DELETED (replaced by tablet a883a3870b05405baec92e54ed13c64d) from {username='slave'} at 127.0.0.1:38044
I20251213 09:04:59.995093 17371 tablet_replica.cc:333] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:04:59.995180 17237 consensus_queue.cc:1048] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.995260 17371 raft_consensus.cc:2243] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:04:59.995538 17371 raft_consensus.cc:2272] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:04:59.996361 17371 ts_tablet_manager.cc:1916] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:04:59.997658 17209 consensus_queue.cc:1048] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:04:59.997850 16480 catalog_manager.cc:5654] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:04:59.998785 17371 ts_tablet_manager.cc:1929] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:04:59.998864 17371 log.cc:1199] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/6e4693a4e4fb456ebf977edf2ae8399b
I20251213 09:05:00.005461 17214 consensus_queue.cc:1048] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.007565 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e4693a4e4fb456ebf977edf2ae8399b with delete_type TABLET_DATA_DELETED (replaced by tablet a883a3870b05405baec92e54ed13c64d) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:00.007740 17371 ts_tablet_manager.cc:1950] T 6e4693a4e4fb456ebf977edf2ae8399b P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:00.007771 17372 tablet_replica.cc:333] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:00.007896 17372 raft_consensus.cc:2243] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.008054 17372 raft_consensus.cc:2272] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.008617 17372 ts_tablet_manager.cc:1916] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.008877 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 6e4693a4e4fb456ebf977edf2ae8399b (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:05:00.010696 17372 ts_tablet_manager.cc:1929] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:00.010763 17372 log.cc:1199] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/6e4693a4e4fb456ebf977edf2ae8399b
I20251213 09:05:00.011008 17372 ts_tablet_manager.cc:1950] T 6e4693a4e4fb456ebf977edf2ae8399b P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:00.012341 16480 master_service.cc:954] ReplaceTablet: received request to replace tablet d7f77966ed8c42f09ac6ea8154ad7165 from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:00.014452 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 6e4693a4e4fb456ebf977edf2ae8399b (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:05:00.018782 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e4693a4e4fb456ebf977edf2ae8399b with delete_type TABLET_DATA_DELETED (replaced by tablet a883a3870b05405baec92e54ed13c64d) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:00.018941 17370 tablet_replica.cc:333] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:00.019074 17370 raft_consensus.cc:2243] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.019246 17370 raft_consensus.cc:2272] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.019984 17370 ts_tablet_manager.cc:1916] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.022210 17370 ts_tablet_manager.cc:1929] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:00.022267 17370 log.cc:1199] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/6e4693a4e4fb456ebf977edf2ae8399b
I20251213 09:05:00.022487 17370 ts_tablet_manager.cc:1950] T 6e4693a4e4fb456ebf977edf2ae8399b P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:00.023890 17073 tablet_service.cc:1505] Processing CreateTablet for tablet a883a3870b05405baec92e54ed13c64d (DEFAULT_TABLE table=default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.024183 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a883a3870b05405baec92e54ed13c64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.024947 17214 consensus_queue.cc:1048] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.026417 17207 tablet_bootstrap.cc:492] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:00.027585 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 6e4693a4e4fb456ebf977edf2ae8399b (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:05:00.027645 17207 tablet_bootstrap.cc:654] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.028231 16938 tablet_service.cc:1505] Processing CreateTablet for tablet a883a3870b05405baec92e54ed13c64d (DEFAULT_TABLE table=default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.028470 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a883a3870b05405baec92e54ed13c64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.028971 16801 tablet_service.cc:1505] Processing CreateTablet for tablet a883a3870b05405baec92e54ed13c64d (DEFAULT_TABLE table=default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.029253 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a883a3870b05405baec92e54ed13c64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.031935 17201 tablet_bootstrap.cc:492] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:00.032980 17201 tablet_bootstrap.cc:654] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.034705 17207 tablet_bootstrap.cc:492] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:00.034794 17207 ts_tablet_manager.cc:1403] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s
I20251213 09:05:00.035324 17207 raft_consensus.cc:359] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.035430 17207 raft_consensus.cc:385] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.035465 17207 raft_consensus.cc:740] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.035588 17207 consensus_queue.cc:260] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.036767 17201 tablet_bootstrap.cc:492] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:00.036877 17201 ts_tablet_manager.cc:1403] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:00.037328 17201 raft_consensus.cc:359] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.037497 17201 raft_consensus.cc:385] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.037578 17201 raft_consensus.cc:740] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.037783 17201 consensus_queue.cc:260] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.039098 17237 raft_consensus.cc:493] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:00.039265 17237 raft_consensus.cc:515] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.039426 17207 ts_tablet_manager.cc:1434] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251213 09:05:00.039567 17237 leader_election.cc:290] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.040426 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a883a3870b05405baec92e54ed13c64d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:00.040527 17093 raft_consensus.cc:2468] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
W20251213 09:05:00.040925 16891 leader_election.cc:343] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: a883a3870b05405baec92e54ed13c64d
I20251213 09:05:00.041139 16894 leader_election.cc:304] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters: 42c0ccabbfc1460685086e58e05cd152
I20251213 09:05:00.042165 17237 raft_consensus.cc:2804] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:00.042215 17237 raft_consensus.cc:493] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:00.042249 17237 raft_consensus.cc:3060] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.043159 17237 raft_consensus.cc:515] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.043216 17202 tablet_bootstrap.cc:492] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:00.043453 17237 leader_election.cc:290] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.044456 17202 tablet_bootstrap.cc:654] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.044711 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a883a3870b05405baec92e54ed13c64d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
W20251213 09:05:00.045166 16891 leader_election.cc:343] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Illegal state: must be running to vote when last-logged opid is not known
I20251213 09:05:00.045564 16480 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet d7f77966ed8c42f09ac6ea8154ad7165
I20251213 09:05:00.045578 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a883a3870b05405baec92e54ed13c64d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:00.045683 17093 raft_consensus.cc:3060] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.046279 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:00.046440 17372 tablet_replica.cc:333] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:00.046542 17093 raft_consensus.cc:2468] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:00.046553 17372 raft_consensus.cc:2243] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.046658 17372 raft_consensus.cc:2272] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.046962 16894 leader_election.cc:304] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters: 42c0ccabbfc1460685086e58e05cd152
I20251213 09:05:00.047302 17372 ts_tablet_manager.cc:1916] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.047328 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:00.047693 17201 ts_tablet_manager.cc:1434] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20251213 09:05:00.049348 17372 ts_tablet_manager.cc:1929] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.049476 17372 log.cc:1199] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/d7f77966ed8c42f09ac6ea8154ad7165
I20251213 09:05:00.049727 17372 ts_tablet_manager.cc:1950] T d7f77966ed8c42f09ac6ea8154ad7165 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:00.050330 17370 tablet_replica.cc:333] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:00.050434 17370 raft_consensus.cc:2243] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:00.050444 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet d7f77966ed8c42f09ac6ea8154ad7165 (table default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]) successfully deleted
I20251213 09:05:00.050649 17370 raft_consensus.cc:2272] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.051083 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:00.051242 17237 raft_consensus.cc:2804] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:00.051282 17370 ts_tablet_manager.cc:1916] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.051330 17237 raft_consensus.cc:697] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:00.051385 17371 tablet_replica.cc:333] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:00.051453 17237 consensus_queue.cc:237] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.051522 17371 raft_consensus.cc:2243] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.051635 17371 raft_consensus.cc:2272] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.051780 16480 catalog_manager.cc:6724] ReplaceTablet: tablet d7f77966ed8c42f09ac6ea8154ad7165 deleted and replaced by tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f
I20251213 09:05:00.053207 17202 tablet_bootstrap.cc:492] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:00.053313 17202 ts_tablet_manager.cc:1403] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251213 09:05:00.053339 17370 ts_tablet_manager.cc:1929] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.053416 17370 log.cc:1199] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/d7f77966ed8c42f09ac6ea8154ad7165
I20251213 09:05:00.053668 17370 ts_tablet_manager.cc:1950] T d7f77966ed8c42f09ac6ea8154ad7165 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:00.053902 17202 raft_consensus.cc:359] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.054011 17202 raft_consensus.cc:385] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.054049 17202 raft_consensus.cc:740] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.054204 17202 consensus_queue.cc:260] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.055226 17202 ts_tablet_manager.cc:1434] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:00.056424 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet d7f77966ed8c42f09ac6ea8154ad7165 (table default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]) successfully deleted
I20251213 09:05:00.059940 17371 ts_tablet_manager.cc:1916] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.062055 17371 ts_tablet_manager.cc:1929] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.062121 17371 log.cc:1199] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/d7f77966ed8c42f09ac6ea8154ad7165
I20251213 09:05:00.062352 17371 ts_tablet_manager.cc:1950] T d7f77966ed8c42f09ac6ea8154ad7165 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:00.063203 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet d7f77966ed8c42f09ac6ea8154ad7165 (table default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]) successfully deleted
I20251213 09:05:00.067973 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f) from {username='slave'} at 127.0.0.1:49302
W20251213 09:05:00.068634 16471 catalog_manager.cc:4952] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): delete failed for tablet d7f77966ed8c42f09ac6ea8154ad7165 because the tablet was not found. No further retry: Not found: Tablet not found: d7f77966ed8c42f09ac6ea8154ad7165
I20251213 09:05:00.071020 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f) from {username='slave'} at 127.0.0.1:38044
W20251213 09:05:00.071671 16472 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet d7f77966ed8c42f09ac6ea8154ad7165 because the tablet was not found. No further retry: Not found: Tablet not found: d7f77966ed8c42f09ac6ea8154ad7165
I20251213 09:05:00.071656 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f (DEFAULT_TABLE table=default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.071924 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.073619 17202 tablet_bootstrap.cc:492] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:00.074220 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet d7f77966ed8c42f09ac6ea8154ad7165 with delete_type TABLET_DATA_DELETED (replaced by tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:00.074527 17202 tablet_bootstrap.cc:654] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
W20251213 09:05:00.075230 16469 catalog_manager.cc:4952] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): delete failed for tablet d7f77966ed8c42f09ac6ea8154ad7165 because the tablet was not found. No further retry: Not found: Tablet not found: d7f77966ed8c42f09ac6ea8154ad7165
I20251213 09:05:00.075511 17202 tablet_bootstrap.cc:492] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:00.075598 17202 ts_tablet_manager.cc:1403] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:00.075599 16480 catalog_manager.cc:5654] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:00.075793 16480 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet a883a3870b05405baec92e54ed13c64d (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:00.076041 17202 raft_consensus.cc:359] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.076131 17202 raft_consensus.cc:385] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.076164 17202 raft_consensus.cc:740] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.076277 17202 consensus_queue.cc:260] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.076591 17202 ts_tablet_manager.cc:1434] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:00.076961 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f (DEFAULT_TABLE table=default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.077227 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.081048 17201 tablet_bootstrap.cc:492] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:00.082036 17201 tablet_bootstrap.cc:654] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.089329 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f (DEFAULT_TABLE table=default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.089656 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.089955 17092 raft_consensus.cc:1275] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Refusing update from remote peer ba49ca51d8eb4be288091d19e7114792: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:05:00.090401 17237 consensus_queue.cc:1048] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.090833 16820 raft_consensus.cc:3060] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.091691 17201 tablet_bootstrap.cc:492] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:00.091856 17201 ts_tablet_manager.cc:1403] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251213 09:05:00.091898 17207 tablet_bootstrap.cc:492] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:00.091892 16820 raft_consensus.cc:1275] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Refusing update from remote peer ba49ca51d8eb4be288091d19e7114792: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:05:00.092464 17201 raft_consensus.cc:359] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.092635 17201 raft_consensus.cc:385] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.092671 17201 raft_consensus.cc:740] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.092877 17207 tablet_bootstrap.cc:654] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.093684 16480 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet a883a3870b05405baec92e54ed13c64d (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:00.094434 17237 consensus_queue.cc:1048] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.094980 16480 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet a883a3870b05405baec92e54ed13c64d (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:00.095619 16480 master_service.cc:954] ReplaceTablet: received request to replace tablet 521d6a129d6a445eba83dcaed7a47449 from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:00.096416 17201 consensus_queue.cc:260] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.096789 17201 ts_tablet_manager.cc:1434] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251213 09:05:00.102051 17207 tablet_bootstrap.cc:492] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:00.102142 17207 ts_tablet_manager.cc:1403] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251213 09:05:00.103241 17207 raft_consensus.cc:359] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.103348 17207 raft_consensus.cc:385] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.103379 17207 raft_consensus.cc:740] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.103497 17207 consensus_queue.cc:260] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.103746 17207 ts_tablet_manager.cc:1434] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:00.104954 17369 tablet.cc:1722] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.105597 17336 mvcc.cc:204] Tried to move back new op lower bound from 7231966003564171264 to 7231966003411996672. Current Snapshot: MvccSnapshot[applied={T|T < 7231966003564171264}]
I20251213 09:05:00.108899 17367 tablet.cc:1722] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.109184 17334 mvcc.cc:204] Tried to move back new op lower bound from 7231966003564171264 to 7231966003411996672. Current Snapshot: MvccSnapshot[applied={T|T < 7231966003564171264}]
I20251213 09:05:00.112486 16480 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 521d6a129d6a445eba83dcaed7a47449
I20251213 09:05:00.112876 16480 catalog_manager.cc:6724] ReplaceTablet: tablet 521d6a129d6a445eba83dcaed7a47449 deleted and replaced by tablet 851541c0460f4ca09bbbaf3764ba8d5d
I20251213 09:05:00.113231 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 521d6a129d6a445eba83dcaed7a47449 with delete_type TABLET_DATA_DELETED (replaced by tablet 851541c0460f4ca09bbbaf3764ba8d5d) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:00.113425 17370 tablet_replica.cc:333] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:00.113560 17370 raft_consensus.cc:2243] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.113574 16480 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet a883a3870b05405baec92e54ed13c64d (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:00.113669 17370 raft_consensus.cc:2272] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.114091 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 521d6a129d6a445eba83dcaed7a47449 with delete_type TABLET_DATA_DELETED (replaced by tablet 851541c0460f4ca09bbbaf3764ba8d5d) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:00.114537 17370 ts_tablet_manager.cc:1916] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.114832 17368 tablet.cc:1722] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.116614 17370 ts_tablet_manager.cc:1929] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.116698 17370 log.cc:1199] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/521d6a129d6a445eba83dcaed7a47449
I20251213 09:05:00.116688 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 521d6a129d6a445eba83dcaed7a47449 with delete_type TABLET_DATA_DELETED (replaced by tablet 851541c0460f4ca09bbbaf3764ba8d5d) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:00.116852 17372 tablet_replica.cc:333] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:00.116952 17370 ts_tablet_manager.cc:1950] T 521d6a129d6a445eba83dcaed7a47449 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:00.116983 17372 raft_consensus.cc:2243] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.117110 17372 raft_consensus.cc:2272] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.117842 17372 ts_tablet_manager.cc:1916] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.119643 17372 ts_tablet_manager.cc:1929] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.119711 17372 log.cc:1199] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/521d6a129d6a445eba83dcaed7a47449
I20251213 09:05:00.119938 17372 ts_tablet_manager.cc:1950] T 521d6a129d6a445eba83dcaed7a47449 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:00.121785 16480 master_service.cc:954] ReplaceTablet: received request to replace tablet 521d6a129d6a445eba83dcaed7a47449 from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:00.122129 16480 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_00ca8030ef8d48088f07fb15e26d5bac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:00.122162 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 851541c0460f4ca09bbbaf3764ba8d5d (DEFAULT_TABLE table=default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.122416 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851541c0460f4ca09bbbaf3764ba8d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.122911 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 851541c0460f4ca09bbbaf3764ba8d5d (DEFAULT_TABLE table=default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.123198 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851541c0460f4ca09bbbaf3764ba8d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.123293 17237 raft_consensus.cc:493] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:00.123387 17237 raft_consensus.cc:515] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.123767 17237 leader_election.cc:290] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.125181 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41c1a0b4450842fda55296abeea8dfae" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:00.125291 17092 raft_consensus.cc:2468] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:00.125721 16894 leader_election.cc:304] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:00.125712 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 521d6a129d6a445eba83dcaed7a47449 (table default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:00.126046 17201 tablet_bootstrap.cc:492] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:00.126236 17237 raft_consensus.cc:2804] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:00.126291 17237 raft_consensus.cc:493] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:00.126335 17237 raft_consensus.cc:3060] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.126401 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41c1a0b4450842fda55296abeea8dfae" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:00.126508 16821 raft_consensus.cc:2468] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:00.127112 17201 tablet_bootstrap.cc:654] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.127228 17237 raft_consensus.cc:515] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.127399 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 521d6a129d6a445eba83dcaed7a47449 (table default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:00.127575 17237 leader_election.cc:290] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.128296 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41c1a0b4450842fda55296abeea8dfae" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:00.128394 17092 raft_consensus.cc:3060] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.129114 17201 tablet_bootstrap.cc:492] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:00.129189 17201 ts_tablet_manager.cc:1403] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:00.129333 17092 raft_consensus.cc:2468] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:00.129695 17201 raft_consensus.cc:359] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.129786 16894 leader_election.cc:304] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:00.129968 17237 raft_consensus.cc:2804] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:00.130048 17237 raft_consensus.cc:697] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:00.130183 17237 consensus_queue.cc:237] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.130216 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 851541c0460f4ca09bbbaf3764ba8d5d (DEFAULT_TABLE table=default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.130494 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 851541c0460f4ca09bbbaf3764ba8d5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.131268 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "41c1a0b4450842fda55296abeea8dfae" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:00.131371 16820 raft_consensus.cc:3060] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.132236 16820 raft_consensus.cc:2468] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:00.132627 17206 consensus_queue.cc:1048] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.129796 17201 raft_consensus.cc:385] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.133178 17201 raft_consensus.cc:740] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.133311 17201 consensus_queue.cc:260] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.133597 17201 ts_tablet_manager.cc:1434] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:05:00.134081 17202 tablet_bootstrap.cc:492] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:00.135106 17202 tablet_bootstrap.cc:654] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.136389 17202 tablet_bootstrap.cc:492] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:00.136472 17202 ts_tablet_manager.cc:1403] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:00.136932 17202 raft_consensus.cc:359] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.137037 17202 raft_consensus.cc:385] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.137082 17202 raft_consensus.cc:740] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.137203 17202 consensus_queue.cc:260] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.137463 17202 ts_tablet_manager.cc:1434] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:00.140066 17371 tablet_replica.cc:333] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:00.140249 17371 raft_consensus.cc:2243] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:00.140456 17371 raft_consensus.cc:2272] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.140952 17371 ts_tablet_manager.cc:1916] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.142009 17207 tablet_bootstrap.cc:492] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:00.143138 17371 ts_tablet_manager.cc:1929] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.143217 17371 log.cc:1199] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/521d6a129d6a445eba83dcaed7a47449
I20251213 09:05:00.143240 17207 tablet_bootstrap.cc:654] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.143487 17371 ts_tablet_manager.cc:1950] T 521d6a129d6a445eba83dcaed7a47449 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:00.144622 17207 tablet_bootstrap.cc:492] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:00.144707 17207 ts_tablet_manager.cc:1403] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251213 09:05:00.144740 17250 consensus_queue.cc:1048] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.144958 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 521d6a129d6a445eba83dcaed7a47449 (table default.table_094df91e4bb1472a9b3ba69cdf32f14a [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:00.145327 17207 raft_consensus.cc:359] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.145475 17207 raft_consensus.cc:385] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.145532 17207 raft_consensus.cc:740] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.145718 17207 consensus_queue.cc:260] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.146184 17207 ts_tablet_manager.cc:1434] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:00.178777 17214 raft_consensus.cc:493] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:00.178946 17214 raft_consensus.cc:515] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.179515 17214 leader_election.cc:290] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.180353 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "851541c0460f4ca09bbbaf3764ba8d5d" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:00.180538 16957 raft_consensus.cc:2468] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:00.181381 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "851541c0460f4ca09bbbaf3764ba8d5d" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:00.181550 17092 raft_consensus.cc:2468] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:00.182166 16756 leader_election.cc:304] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:00.182622 17214 raft_consensus.cc:2804] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:00.182690 17214 raft_consensus.cc:493] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:00.182734 17214 raft_consensus.cc:3060] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.184024 17214 raft_consensus.cc:515] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.184490 17214 leader_election.cc:290] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.185309 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "851541c0460f4ca09bbbaf3764ba8d5d" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:00.185446 17092 raft_consensus.cc:3060] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.186553 17092 raft_consensus.cc:2468] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:00.187397 16757 leader_election.cc:304] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:00.187763 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "851541c0460f4ca09bbbaf3764ba8d5d" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:00.187896 16957 raft_consensus.cc:3060] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.188915 16957 raft_consensus.cc:2468] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:00.189507 17214 raft_consensus.cc:2804] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:00.189625 17214 raft_consensus.cc:697] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:00.189782 17214 consensus_queue.cc:237] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.224901 17250 raft_consensus.cc:493] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:00.225061 17250 raft_consensus.cc:515] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.225621 17250 leader_election.cc:290] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.226487 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ddcecd9bbb84c4fa5f8a55efba4f12f" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:00.226667 17092 raft_consensus.cc:2468] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:00.227600 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ddcecd9bbb84c4fa5f8a55efba4f12f" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:00.227764 16820 raft_consensus.cc:2468] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:00.228361 16894 leader_election.cc:304] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:00.228843 17250 raft_consensus.cc:2804] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:00.228914 17250 raft_consensus.cc:493] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:00.228961 17250 raft_consensus.cc:3060] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.230119 17250 raft_consensus.cc:515] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.230597 17250 leader_election.cc:290] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.231468 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ddcecd9bbb84c4fa5f8a55efba4f12f" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:00.231611 17092 raft_consensus.cc:3060] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.232671 17092 raft_consensus.cc:2468] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:00.233486 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0ddcecd9bbb84c4fa5f8a55efba4f12f" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:00.233629 16820 raft_consensus.cc:3060] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.234702 16820 raft_consensus.cc:2468] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:00.235255 16891 leader_election.cc:304] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:00.235714 17250 raft_consensus.cc:2804] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:00.235821 17250 raft_consensus.cc:697] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:00.235977 17250 consensus_queue.cc:237] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.241370 17250 consensus_queue.cc:1048] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.252008 17206 consensus_queue.cc:1048] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.461328 16482 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_6a60e92df30c4d2d82969065613768d5 [id=f57307f860a84afe95f647e0e492ae68]
I20251213 09:05:00.496886 16477 catalog_manager.cc:2174] created HMS catalog entry for table [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:00.503885 16477 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 20) took 1334 ms. Trace:
I20251213 09:05:00.504011 16477 rpcz_store.cc:276] 1213 09:04:59.169749 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.186881 (+ 17132us) service_pool.cc:225] Handling call
1213 09:04:59.693580 (+506699us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:04:59.693861 (+ 281us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:00.496874 (+803013us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:00.503665 (+ 6791us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:00.503769 (+ 104us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:00.503862 (+ 93us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:00.497512 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:00.497649 (+ 137us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:00.497654 (+ 5us) write_op.cc:435] Acquired schema lock
1213 09:05:00.497655 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:00.497731 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:00.497743 (+ 12us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:00.497747 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:00.497808 (+ 61us) tablet.cc:699] Row locks acquired
1213 09:05:00.497810 (+ 2us) write_op.cc:260] PREPARE: finished
1213 09:05:00.497846 (+ 36us) write_op.cc:270] Start()
1213 09:05:00.497876 (+ 30us) write_op.cc:276] Timestamp: P: 1765616700497804 usec, L: 0
1213 09:05:00.497878 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:00.498038 (+ 160us) log.cc:844] Serialized 432 byte log entry
1213 09:05:00.503111 (+ 5073us) op_driver.cc:464] REPLICATION: finished
1213 09:05:00.503267 (+ 156us) write_op.cc:301] APPLY: starting
1213 09:05:00.503285 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:00.503317 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:00.503333 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:00.503411 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:00.503443 (+ 32us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:00.503449 (+ 6us) write_op.cc:312] APPLY: finished
1213 09:05:00.503509 (+ 60us) log.cc:844] Serialized 28 byte log entry
1213 09:05:00.503564 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.503577 (+ 13us) write_op.cc:454] Released schema lock
1213 09:05:00.503583 (+ 6us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:00.503658 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.503660 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":767404,"Hive Metastore.run_cpu_time_us":257,"Hive Metastore.run_wall_time_us":34260,"child_traces":[["op",{"apply.queue_time_us":79,"apply.run_cpu_time_us":383,"apply.run_wall_time_us":383,"num_ops":2,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":651,"prepare.run_wall_time_us":651,"raft.queue_time_us":990,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":340,"replication_time_us":5202}]]}
I20251213 09:05:00.512151 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 7751d6a8df064e9bbafee2c6310cf456 (DEFAULT_TABLE table=default.table_233a6a0146384e14bd0d8ff512419278 [id=e5096b86f1244b13ad349eb23d8a0c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.512336 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 7751d6a8df064e9bbafee2c6310cf456 (DEFAULT_TABLE table=default.table_233a6a0146384e14bd0d8ff512419278 [id=e5096b86f1244b13ad349eb23d8a0c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.512497 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7751d6a8df064e9bbafee2c6310cf456. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.512614 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7751d6a8df064e9bbafee2c6310cf456. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.514882 17201 tablet_bootstrap.cc:492] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:00.514914 17202 tablet_bootstrap.cc:492] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:00.515857 17201 tablet_bootstrap.cc:654] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.515972 17202 tablet_bootstrap.cc:654] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.517311 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 7751d6a8df064e9bbafee2c6310cf456 (DEFAULT_TABLE table=default.table_233a6a0146384e14bd0d8ff512419278 [id=e5096b86f1244b13ad349eb23d8a0c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.517608 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7751d6a8df064e9bbafee2c6310cf456. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.520018 17207 tablet_bootstrap.cc:492] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:00.520982 17207 tablet_bootstrap.cc:654] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.521489 17201 tablet_bootstrap.cc:492] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:00.521584 17201 ts_tablet_manager.cc:1403] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:00.522136 17201 raft_consensus.cc:359] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.522269 17201 raft_consensus.cc:385] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.522310 17201 raft_consensus.cc:740] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.522446 17201 consensus_queue.cc:260] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.522758 17201 ts_tablet_manager.cc:1434] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:00.528944 17207 tablet_bootstrap.cc:492] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:00.529085 17207 ts_tablet_manager.cc:1403] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20251213 09:05:00.529717 17207 raft_consensus.cc:359] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.529845 17207 raft_consensus.cc:385] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.529886 17207 raft_consensus.cc:740] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.530025 17207 consensus_queue.cc:260] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.533284 16477 catalog_manager.cc:5654] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:00.534528 17207 ts_tablet_manager.cc:1434] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251213 09:05:00.535228 17202 tablet_bootstrap.cc:492] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:00.535351 17202 ts_tablet_manager.cc:1403] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251213 09:05:00.535913 17202 raft_consensus.cc:359] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.536031 17202 raft_consensus.cc:385] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.536067 17202 raft_consensus.cc:740] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.536226 17202 consensus_queue.cc:260] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.536592 17202 ts_tablet_manager.cc:1434] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:00.546335 16477 catalog_manager.cc:5654] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:00.546854 16477 catalog_manager.cc:5654] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:00.548358 17250 raft_consensus.cc:493] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:00.548475 17250 raft_consensus.cc:515] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.548887 17250 leader_election.cc:290] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.549932 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7751d6a8df064e9bbafee2c6310cf456" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:00.550108 16820 raft_consensus.cc:2468] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:00.550499 16891 leader_election.cc:304] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:00.550684 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7751d6a8df064e9bbafee2c6310cf456" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:00.550757 17250 raft_consensus.cc:2804] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:00.550809 17250 raft_consensus.cc:493] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:00.550827 17092 raft_consensus.cc:2468] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:00.550858 17250 raft_consensus.cc:3060] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.551999 17250 raft_consensus.cc:515] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.552397 17250 leader_election.cc:290] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:00.553223 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7751d6a8df064e9bbafee2c6310cf456" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:00.553364 17092 raft_consensus.cc:3060] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.554446 17092 raft_consensus.cc:2468] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:00.554842 16894 leader_election.cc:304] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:00.555269 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7751d6a8df064e9bbafee2c6310cf456" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:00.555408 16820 raft_consensus.cc:3060] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.556432 16820 raft_consensus.cc:2468] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:00.557608 16477 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_2a5c2b913d7940e191e58e3896de02fc" } modify_external_catalogs: true
I20251213 09:05:00.557790 16477 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_2a5c2b913d7940e191e58e3896de02fc" } modify_external_catalogs: true
I20251213 09:05:00.558059 17250 raft_consensus.cc:2804] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:00.558193 17250 raft_consensus.cc:697] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:00.558346 17250 consensus_queue.cc:237] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.569337 16485 catalog_manager.cc:3485] renamed table default.table_cd97e84e8af44577b495cce860493273 [id=b710aa4328c74aa3a83cb63bb8a55a68] in HMS: new name default.table_924224088c604b9682478db9e1bbe741
I20251213 09:05:00.570865 17205 consensus_queue.cc:1048] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.579732 17214 consensus_queue.cc:1048] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.586436 17206 consensus_queue.cc:1048] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.602118 17206 consensus_queue.cc:1048] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.616005 16476 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]
I20251213 09:05:00.637060 16483 catalog_manager.cc:2174] created HMS catalog entry for table [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:00.642539 16483 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 22) took 1426 ms. Trace:
I20251213 09:05:00.642637 16483 rpcz_store.cc:276] 1213 09:04:59.216507 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.263846 (+ 47339us) service_pool.cc:225] Handling call
1213 09:04:59.693803 (+429957us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:04:59.694140 (+ 337us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:00.637046 (+942906us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:00.642352 (+ 5306us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:00.642453 (+ 101us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:00.642526 (+ 73us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:00.637624 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:00.637715 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:00.637719 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:00.637720 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:00.637775 (+ 55us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:00.637783 (+ 8us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:00.637786 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:00.637831 (+ 45us) tablet.cc:699] Row locks acquired
1213 09:05:00.637832 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:00.637858 (+ 26us) write_op.cc:270] Start()
1213 09:05:00.637882 (+ 24us) write_op.cc:276] Timestamp: P: 1765616700637806 usec, L: 0
1213 09:05:00.637883 (+ 1us) op_driver.cc:348] REPLICATION: starting
1213 09:05:00.638057 (+ 174us) log.cc:844] Serialized 432 byte log entry
1213 09:05:00.640952 (+ 2895us) op_driver.cc:464] REPLICATION: finished
1213 09:05:00.642018 (+ 1066us) write_op.cc:301] APPLY: starting
1213 09:05:00.642034 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:00.642060 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:00.642076 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:00.642160 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:00.642188 (+ 28us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:00.642193 (+ 5us) write_op.cc:312] APPLY: finished
1213 09:05:00.642240 (+ 47us) log.cc:844] Serialized 28 byte log entry
1213 09:05:00.642282 (+ 42us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.642291 (+ 9us) write_op.cc:454] Released schema lock
1213 09:05:00.642295 (+ 4us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:00.642349 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.642352 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":921764,"Hive Metastore.run_cpu_time_us":192,"Hive Metastore.run_wall_time_us":20981,"spinlock_wait_cycles":3200,"child_traces":[["op",{"apply.queue_time_us":1025,"apply.run_cpu_time_us":327,"apply.run_wall_time_us":327,"num_ops":2,"prepare.queue_time_us":45,"prepare.run_cpu_time_us":538,"prepare.run_wall_time_us":539,"raft.queue_time_us":541,"raft.run_cpu_time_us":576,"raft.run_wall_time_us":576,"replication_time_us":3046,"spinlock_wait_cycles":83712}]]}
I20251213 09:05:00.644964 17206 consensus_queue.cc:1048] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.650190 16483 catalog_manager.cc:5654] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:00.651119 17073 tablet_service.cc:1505] Processing CreateTablet for tablet a0514913a4ce4b54bd78e53b11814912 (DEFAULT_TABLE table=default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.651209 16801 tablet_service.cc:1505] Processing CreateTablet for tablet a0514913a4ce4b54bd78e53b11814912 (DEFAULT_TABLE table=default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.651455 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0514913a4ce4b54bd78e53b11814912. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.651455 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0514913a4ce4b54bd78e53b11814912. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.653618 17207 tablet_bootstrap.cc:492] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:00.653656 17202 tablet_bootstrap.cc:492] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:00.654663 17207 tablet_bootstrap.cc:654] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.654670 17202 tablet_bootstrap.cc:654] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.655875 16937 tablet_service.cc:1505] Processing CreateTablet for tablet a0514913a4ce4b54bd78e53b11814912 (DEFAULT_TABLE table=default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.656164 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0514913a4ce4b54bd78e53b11814912. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.657823 17430 tablet.cc:1722] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.658402 17201 tablet_bootstrap.cc:492] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:00.660974 16483 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 851541c0460f4ca09bbbaf3764ba8d5d (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 1 got 0
I20251213 09:05:00.661429 17201 tablet_bootstrap.cc:654] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.661854 16483 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 851541c0460f4ca09bbbaf3764ba8d5d (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 1 got 0
I20251213 09:05:00.662293 16483 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_9282d807387b4dce85db4768d872eff3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:00.663887 17237 consensus_queue.cc:1048] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.665536 16704 catalog_manager.cc:2772] Deleting table default.table_6a60e92df30c4d2d82969065613768d5 [id=f57307f860a84afe95f647e0e492ae68] in response to Hive Metastore notification log event 16
I20251213 09:05:00.665606 17430 tablet.cc:1722] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.670599 16704 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 91176a6c085d43adab389621b96b1da7
I20251213 09:05:00.671583 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 91176a6c085d43adab389621b96b1da7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:00.671808 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 91176a6c085d43adab389621b96b1da7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:00.672336 17430 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.672906 17441 tablet_replica.cc:333] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:00.673146 17441 raft_consensus.cc:2243] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.673326 17441 raft_consensus.cc:2272] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.673911 17441 ts_tablet_manager.cc:1916] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.675508 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 91176a6c085d43adab389621b96b1da7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:00.676086 17443 tablet_replica.cc:333] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:00.676244 17443 raft_consensus.cc:2243] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:00.676491 17443 raft_consensus.cc:2272] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.676529 17441 ts_tablet_manager.cc:1929] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.676764 17441 log.cc:1199] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/91176a6c085d43adab389621b96b1da7
I20251213 09:05:00.677094 17441 ts_tablet_manager.cc:1950] T 91176a6c085d43adab389621b96b1da7 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:00.677649 17443 ts_tablet_manager.cc:1916] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.677874 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 91176a6c085d43adab389621b96b1da7 (table default.table_6a60e92df30c4d2d82969065613768d5 [id=f57307f860a84afe95f647e0e492ae68]) successfully deleted
I20251213 09:05:00.678751 17207 tablet_bootstrap.cc:492] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:00.678855 17207 ts_tablet_manager.cc:1403] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20251213 09:05:00.679435 17207 raft_consensus.cc:359] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.679553 17207 raft_consensus.cc:385] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.679610 17207 raft_consensus.cc:740] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.679749 17207 consensus_queue.cc:260] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.680059 17207 ts_tablet_manager.cc:1434] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:00.680421 17201 tablet_bootstrap.cc:492] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:00.680462 17439 tablet.cc:1722] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.680506 17201 ts_tablet_manager.cc:1403] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20251213 09:05:00.680809 17434 tablet.cc:1722] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.680986 17201 raft_consensus.cc:359] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.681082 17201 raft_consensus.cc:385] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.681116 17201 raft_consensus.cc:740] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.681118 17431 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.681349 17201 consensus_queue.cc:260] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.681545 17429 tablet.cc:1722] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.681676 17201 ts_tablet_manager.cc:1434] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:00.682192 17442 tablet_replica.cc:333] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:00.682318 17442 raft_consensus.cc:2243] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.682427 17442 raft_consensus.cc:2272] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.682454 17202 tablet_bootstrap.cc:492] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:00.682528 17202 ts_tablet_manager.cc:1403] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.001s
I20251213 09:05:00.682997 16704 catalog_manager.cc:2772] Deleting table default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727] in response to Hive Metastore notification log event 19
I20251213 09:05:00.682983 17202 raft_consensus.cc:359] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.683091 17202 raft_consensus.cc:385] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.683126 17202 raft_consensus.cc:740] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.683290 17202 consensus_queue.cc:260] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.678467 17438 tablet.cc:1722] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.683569 17202 ts_tablet_manager.cc:1434] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:00.687626 17442 ts_tablet_manager.cc:1916] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.688784 17239 raft_consensus.cc:493] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:00.688867 17239 raft_consensus.cc:515] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.689224 17239 leader_election.cc:290] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:00.689612 17443 ts_tablet_manager.cc:1929] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.689625 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0514913a4ce4b54bd78e53b11814912" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:00.689735 16821 raft_consensus.cc:2468] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:00.690133 17026 leader_election.cc:304] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:00.690399 16704 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f
I20251213 09:05:00.690515 17442 ts_tablet_manager.cc:1929] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.690582 17442 log.cc:1199] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/91176a6c085d43adab389621b96b1da7
I20251213 09:05:00.690842 17442 ts_tablet_manager.cc:1950] T 91176a6c085d43adab389621b96b1da7 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:00.690830 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:00.691133 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:00.691337 17429 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.691418 17442 tablet_replica.cc:333] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:00.691506 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 91176a6c085d43adab389621b96b1da7 (table default.table_6a60e92df30c4d2d82969065613768d5 [id=f57307f860a84afe95f647e0e492ae68]) successfully deleted
I20251213 09:05:00.691537 17442 raft_consensus.cc:2243] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.691630 17442 raft_consensus.cc:2272] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.693300 17239 raft_consensus.cc:2804] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:00.693360 17239 raft_consensus.cc:493] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:00.693408 17239 raft_consensus.cc:3060] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.694108 17443 log.cc:1199] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/91176a6c085d43adab389621b96b1da7
I20251213 09:05:00.694223 17239 raft_consensus.cc:515] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.694427 17443 ts_tablet_manager.cc:1950] T 91176a6c085d43adab389621b96b1da7 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:00.694555 17239 leader_election.cc:290] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:00.695029 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0514913a4ce4b54bd78e53b11814912" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:00.695320 16820 raft_consensus.cc:3060] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.695962 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 91176a6c085d43adab389621b96b1da7 (table default.table_6a60e92df30c4d2d82969065613768d5 [id=f57307f860a84afe95f647e0e492ae68]) successfully deleted
I20251213 09:05:00.696163 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:00.696286 16820 raft_consensus.cc:2468] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:00.696635 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0514913a4ce4b54bd78e53b11814912" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:00.696684 17442 ts_tablet_manager.cc:1916] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.696733 17435 tablet.cc:1722] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.696874 16481 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51496 (request call id 12) took 1680 ms. Trace:
I20251213 09:05:00.696750 16957 raft_consensus.cc:2468] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:00.696925 16481 rpcz_store.cc:276] 1213 09:04:59.016073 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.020944 (+ 4871us) service_pool.cc:225] Handling call
1213 09:04:59.692399 (+671455us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.696460 (+1004061us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.696661 (+ 201us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:00.696861 (+ 200us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":2694,"Hive Metastore.run_cpu_time_us":488,"Hive Metastore.run_wall_time_us":79068}
I20251213 09:05:00.697274 17434 tablet.cc:1722] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.697604 17441 tablet_replica.cc:333] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:00.697734 17441 raft_consensus.cc:2243] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.697748 16481 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 851541c0460f4ca09bbbaf3764ba8d5d (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 1 got 0
I20251213 09:05:00.697830 17441 raft_consensus.cc:2272] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.698153 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0514913a4ce4b54bd78e53b11814912" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:00.698271 16958 raft_consensus.cc:3060] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.698755 17442 ts_tablet_manager.cc:1929] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.698818 17442 log.cc:1199] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/0ddcecd9bbb84c4fa5f8a55efba4f12f
I20251213 09:05:00.699105 17442 ts_tablet_manager.cc:1950] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:00.699282 16958 raft_consensus.cc:2468] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:00.699290 16481 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 851541c0460f4ca09bbbaf3764ba8d5d (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 1 got 0
I20251213 09:05:00.699795 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f (table default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]) successfully deleted
I20251213 09:05:00.700999 17441 ts_tablet_manager.cc:1916] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.702482 17026 leader_election.cc:304] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:00.703662 17239 raft_consensus.cc:2804] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:00.703207 16481 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb] alter complete (version 1)
I20251213 09:05:00.703673 17441 ts_tablet_manager.cc:1929] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.703747 17441 log.cc:1199] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/0ddcecd9bbb84c4fa5f8a55efba4f12f
I20251213 09:05:00.703753 17239 raft_consensus.cc:697] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:00.703896 17239 consensus_queue.cc:237] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.704185 17441 ts_tablet_manager.cc:1950] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:00.704911 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f (table default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]) successfully deleted
I20251213 09:05:00.705073 17443 tablet_replica.cc:333] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:00.705220 17443 raft_consensus.cc:2243] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:00.706194 17443 raft_consensus.cc:2272] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.706787 17443 ts_tablet_manager.cc:1916] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.707301 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:38044
W20251213 09:05:00.707775 16472 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f because the tablet was not found. No further retry: Not found: Tablet not found: 0ddcecd9bbb84c4fa5f8a55efba4f12f
I20251213 09:05:00.708930 17443 ts_tablet_manager.cc:1929] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.709025 17443 log.cc:1199] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/0ddcecd9bbb84c4fa5f8a55efba4f12f
I20251213 09:05:00.709292 17443 ts_tablet_manager.cc:1950] T 0ddcecd9bbb84c4fa5f8a55efba4f12f P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:00.710114 16484 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51496 (request call id 18) took 1642 ms. Trace:
I20251213 09:05:00.710177 16484 rpcz_store.cc:276] 1213 09:04:59.067620 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.113300 (+ 45680us) service_pool.cc:225] Handling call
1213 09:04:59.692562 (+579262us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.709795 (+1017233us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.709936 (+ 141us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:00.710102 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":81701,"Hive Metastore.run_cpu_time_us":548,"Hive Metastore.run_wall_time_us":75368}
I20251213 09:05:00.710624 17429 tablet.cc:1722] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:00.711913 16479 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51496 (request call id 19) took 1591 ms. Trace:
I20251213 09:05:00.711987 16479 rpcz_store.cc:276] 1213 09:04:59.120195 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.120861 (+ 666us) service_pool.cc:225] Handling call
1213 09:04:59.693213 (+572352us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.711594 (+1018381us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.711747 (+ 153us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:00.711899 (+ 152us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":156459,"Hive Metastore.run_cpu_time_us":482,"Hive Metastore.run_wall_time_us":62254}
W20251213 09:05:00.712167 16483 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9282d807387b4dce85db4768d872eff3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:00.712803 16479 catalog_manager.cc:5654] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
W20251213 09:05:00.713590 16480 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_00ca8030ef8d48088f07fb15e26d5bac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:00.714066 16482 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51496 (request call id 25) took 1447 ms. Trace:
I20251213 09:05:00.714115 16482 rpcz_store.cc:276] 1213 09:04:59.266724 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.403408 (+136684us) service_pool.cc:225] Handling call
1213 09:04:59.693425 (+290017us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.714054 (+1020629us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":247291,"Hive Metastore.run_cpu_time_us":227,"Hive Metastore.run_wall_time_us":520437}
I20251213 09:05:00.714318 16482 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_09f90194fbf44cf0b08c91cebff82558" } modify_external_catalogs: true
I20251213 09:05:00.714414 16482 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_09f90194fbf44cf0b08c91cebff82558" } modify_external_catalogs: true
I20251213 09:05:00.715287 16485 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51496 (request call id 21) took 1540 ms. Trace:
I20251213 09:05:00.715339 16485 rpcz_store.cc:276] 1213 09:04:59.174391 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.260318 (+ 85927us) service_pool.cc:225] Handling call
1213 09:04:59.693961 (+433643us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.709846 (+1015885us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.715137 (+ 5291us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:00.715276 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":801571,"Hive Metastore.run_cpu_time_us":522,"Hive Metastore.run_wall_time_us":73637}
I20251213 09:05:00.715554 16485 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_8931d18ab40348878fba01c709567310"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:00.715699 16481 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68] alter complete (version 1)
I20251213 09:05:00.711894 16476 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51496 (request call id 23) took 1475 ms. Trace:
I20251213 09:05:00.716153 16476 rpcz_store.cc:276] 1213 09:04:59.236759 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.321447 (+ 84688us) service_pool.cc:225] Handling call
1213 09:04:59.694097 (+372650us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:00.711880 (+1017783us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":875194,"Hive Metastore.run_cpu_time_us":181,"Hive Metastore.run_wall_time_us":46584}
I20251213 09:05:00.716382 16476 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_73d8d94f56c44d66a429e84fbe602baa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:00.720242 16484 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c] alter complete (version 1)
I20251213 09:05:00.725363 16484 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_63ce7db97320462daf62f4af78345483 [id=57463d6c4bc24d45ab54ddf180a102cd] alter complete (version 1)
I20251213 09:05:00.725782 16484 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_7bb124a916904ca5b08081aae9ac54a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:00.726305 16479 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_e03af1234dba427a8cdc24fb76d12515"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:00.727823 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 0ddcecd9bbb84c4fa5f8a55efba4f12f (table default.table_1c53c9ca376f4d3fb0db870f9fb12452 [id=76b019b500b54894a7cc86f8c1239727]) successfully deleted
I20251213 09:05:00.729949 16481 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_a90e27bac3a946e5bdd85f229deeb4be"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:00.763899 16478 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_aafe4f0475054e60b2069240902f63ca [id=42fe64ec82d444a89520ce173f7f1792]
I20251213 09:05:00.799937 16477 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_2a5c2b913d7940e191e58e3896de02fc [id=0b651bb014924526b0c76609312aac24]
I20251213 09:05:00.824059 16483 catalog_manager.cc:2174] created HMS catalog entry for table [id=bac9e29e59e64238a969a0bca23f9074]
I20251213 09:05:00.828902 16483 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 34) took 1454 ms. Trace:
I20251213 09:05:00.828997 16483 rpcz_store.cc:276] 1213 09:04:59.374850 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.662212 (+1287362us) service_pool.cc:225] Handling call
1213 09:05:00.712234 (+ 50022us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:00.712544 (+ 310us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:00.824046 (+111502us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:00.828690 (+ 4644us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:00.828794 (+ 104us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:00.828879 (+ 85us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:00.824783 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:00.824905 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:00.824910 (+ 5us) write_op.cc:435] Acquired schema lock
1213 09:05:00.824912 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:00.824988 (+ 76us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:00.825001 (+ 13us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:00.825004 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:00.825064 (+ 60us) tablet.cc:699] Row locks acquired
1213 09:05:00.825066 (+ 2us) write_op.cc:260] PREPARE: finished
1213 09:05:00.825101 (+ 35us) write_op.cc:270] Start()
1213 09:05:00.825130 (+ 29us) write_op.cc:276] Timestamp: P: 1765616700825033 usec, L: 0
1213 09:05:00.825132 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:00.825286 (+ 154us) log.cc:844] Serialized 432 byte log entry
1213 09:05:00.827937 (+ 2651us) op_driver.cc:464] REPLICATION: finished
1213 09:05:00.828040 (+ 103us) write_op.cc:301] APPLY: starting
1213 09:05:00.828057 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:00.828090 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:00.828105 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:00.828183 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:00.828212 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:00.828216 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:00.828277 (+ 61us) log.cc:844] Serialized 28 byte log entry
1213 09:05:00.828325 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.828337 (+ 12us) write_op.cc:454] Released schema lock
1213 09:05:00.828342 (+ 5us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:00.828411 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.828413 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":87310,"Hive Metastore.run_cpu_time_us":278,"Hive Metastore.run_wall_time_us":24017,"child_traces":[["op",{"apply.queue_time_us":64,"apply.run_cpu_time_us":361,"apply.run_wall_time_us":360,"num_ops":2,"prepare.queue_time_us":73,"prepare.run_cpu_time_us":622,"prepare.run_wall_time_us":622,"raft.queue_time_us":388,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":376,"replication_time_us":2777}]]}
I20251213 09:05:00.829728 16483 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_36b3468fc09644f19f0e34101ca664a7" } new_table_name: "default.Table_202ae634c0504cf88ed2d25c49b0d397" modify_external_catalogs: true
I20251213 09:05:00.837378 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 0e15d3e0580943cfa60041729f1bff62 (DEFAULT_TABLE table=default.table_9282d807387b4dce85db4768d872eff3 [id=bac9e29e59e64238a969a0bca23f9074]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.837723 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e15d3e0580943cfa60041729f1bff62. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.837903 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 0e15d3e0580943cfa60041729f1bff62 (DEFAULT_TABLE table=default.table_9282d807387b4dce85db4768d872eff3 [id=bac9e29e59e64238a969a0bca23f9074]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.838232 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e15d3e0580943cfa60041729f1bff62. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.839951 17202 tablet_bootstrap.cc:492] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:00.840714 17207 tablet_bootstrap.cc:492] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:00.840916 17202 tablet_bootstrap.cc:654] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.841795 17207 tablet_bootstrap.cc:654] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.842284 17202 tablet_bootstrap.cc:492] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:00.842374 17202 ts_tablet_manager.cc:1403] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251213 09:05:00.842896 17202 raft_consensus.cc:359] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.843020 17202 raft_consensus.cc:385] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.843058 17202 raft_consensus.cc:740] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.843199 17202 consensus_queue.cc:260] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.843551 17202 ts_tablet_manager.cc:1434] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:00.843931 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 0e15d3e0580943cfa60041729f1bff62 (DEFAULT_TABLE table=default.table_9282d807387b4dce85db4768d872eff3 [id=bac9e29e59e64238a969a0bca23f9074]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.844233 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e15d3e0580943cfa60041729f1bff62. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.846599 17201 tablet_bootstrap.cc:492] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:00.847779 17201 tablet_bootstrap.cc:654] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.848219 17207 tablet_bootstrap.cc:492] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:00.848320 17207 ts_tablet_manager.cc:1403] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251213 09:05:00.848810 17207 raft_consensus.cc:359] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.848905 17207 raft_consensus.cc:385] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.848946 17207 raft_consensus.cc:740] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.849097 17207 consensus_queue.cc:260] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.849406 17207 ts_tablet_manager.cc:1434] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:00.852908 17201 tablet_bootstrap.cc:492] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:00.853042 17201 ts_tablet_manager.cc:1403] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:00.853611 17201 raft_consensus.cc:359] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.853744 17201 raft_consensus.cc:385] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.853793 17201 raft_consensus.cc:740] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.853982 17201 consensus_queue.cc:260] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:00.855590 17201 ts_tablet_manager.cc:1434] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:00.860925 16480 catalog_manager.cc:2174] created HMS catalog entry for table [id=09f2d1a73e5841968a7b93bf4f07c5f9]
I20251213 09:05:00.864126 16704 catalog_manager.cc:2772] Deleting table default.table_aafe4f0475054e60b2069240902f63ca [id=42fe64ec82d444a89520ce173f7f1792] in response to Hive Metastore notification log event 21
I20251213 09:05:00.866070 16480 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 32) took 1538 ms. Trace:
I20251213 09:05:00.866153 16480 rpcz_store.cc:276] 1213 09:04:59.327609 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.122028 (+794419us) service_pool.cc:225] Handling call
1213 09:05:00.713654 (+591626us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:00.713941 (+ 287us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:00.860916 (+146975us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:00.865896 (+ 4980us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:00.865985 (+ 89us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:00.866055 (+ 70us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:00.861411 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:00.861518 (+ 107us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:00.861522 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:00.861523 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:00.861590 (+ 67us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:00.861599 (+ 9us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:00.861602 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:00.861655 (+ 53us) tablet.cc:699] Row locks acquired
1213 09:05:00.861656 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:00.861689 (+ 33us) write_op.cc:270] Start()
1213 09:05:00.861719 (+ 30us) write_op.cc:276] Timestamp: P: 1765616700861618 usec, L: 0
1213 09:05:00.861721 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:00.861860 (+ 139us) log.cc:844] Serialized 432 byte log entry
1213 09:05:00.865439 (+ 3579us) op_driver.cc:464] REPLICATION: finished
1213 09:05:00.865532 (+ 93us) write_op.cc:301] APPLY: starting
1213 09:05:00.865545 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:00.865574 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:00.865586 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:00.865660 (+ 74us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:00.865689 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:00.865697 (+ 8us) write_op.cc:312] APPLY: finished
1213 09:05:00.865750 (+ 53us) log.cc:844] Serialized 28 byte log entry
1213 09:05:00.865783 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.865792 (+ 9us) write_op.cc:454] Released schema lock
1213 09:05:00.865797 (+ 5us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:00.865854 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.865857 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":109990,"Hive Metastore.run_cpu_time_us":237,"Hive Metastore.run_wall_time_us":36844,"child_traces":[["op",{"apply.queue_time_us":53,"apply.run_cpu_time_us":312,"apply.run_wall_time_us":311,"num_ops":2,"prepare.queue_time_us":52,"prepare.run_cpu_time_us":570,"prepare.run_wall_time_us":570,"raft.queue_time_us":308,"raft.run_cpu_time_us":466,"raft.run_wall_time_us":466,"replication_time_us":3692,"spinlock_wait_cycles":105728}]]}
I20251213 09:05:00.869520 16704 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 07824c32051a4b7d99dc01951a27c0f6
I20251213 09:05:00.870102 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 07824c32051a4b7d99dc01951a27c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:00.870193 16704 catalog_manager.cc:2772] Deleting table default.table_2a5c2b913d7940e191e58e3896de02fc [id=0b651bb014924526b0c76609312aac24] in response to Hive Metastore notification log event 22
I20251213 09:05:00.870347 17443 tablet_replica.cc:333] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:00.870499 17443 raft_consensus.cc:2243] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.870615 17443 raft_consensus.cc:2272] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.871335 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 07824c32051a4b7d99dc01951a27c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:00.871389 17443 ts_tablet_manager.cc:1916] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.871500 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 07824c32051a4b7d99dc01951a27c0f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:00.871601 17441 tablet_replica.cc:333] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:00.871682 17442 tablet_replica.cc:333] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:00.871799 17442 raft_consensus.cc:2243] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.871747 17441 raft_consensus.cc:2243] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:00.871912 17442 raft_consensus.cc:2272] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.872058 17441 raft_consensus.cc:2272] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.872673 17442 ts_tablet_manager.cc:1916] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.872779 17441 ts_tablet_manager.cc:1916] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.874888 17441 ts_tablet_manager.cc:1929] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.874888 17442 ts_tablet_manager.cc:1929] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.874974 17441 log.cc:1199] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/07824c32051a4b7d99dc01951a27c0f6
I20251213 09:05:00.874974 17442 log.cc:1199] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/07824c32051a4b7d99dc01951a27c0f6
I20251213 09:05:00.875263 17442 ts_tablet_manager.cc:1950] T 07824c32051a4b7d99dc01951a27c0f6 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:00.875263 17441 ts_tablet_manager.cc:1950] T 07824c32051a4b7d99dc01951a27c0f6 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:00.875334 17443 ts_tablet_manager.cc:1929] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.875422 17443 log.cc:1199] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/07824c32051a4b7d99dc01951a27c0f6
I20251213 09:05:00.875669 17443 ts_tablet_manager.cc:1950] T 07824c32051a4b7d99dc01951a27c0f6 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:00.875995 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 07824c32051a4b7d99dc01951a27c0f6 (table default.table_aafe4f0475054e60b2069240902f63ca [id=42fe64ec82d444a89520ce173f7f1792]) successfully deleted
I20251213 09:05:00.876032 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 07824c32051a4b7d99dc01951a27c0f6 (table default.table_aafe4f0475054e60b2069240902f63ca [id=42fe64ec82d444a89520ce173f7f1792]) successfully deleted
I20251213 09:05:00.876317 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 07824c32051a4b7d99dc01951a27c0f6 (table default.table_aafe4f0475054e60b2069240902f63ca [id=42fe64ec82d444a89520ce173f7f1792]) successfully deleted
I20251213 09:05:00.878014 16801 tablet_service.cc:1505] Processing CreateTablet for tablet bd2a866a05cc4ecba3394d4ca38e9f7c (DEFAULT_TABLE table=default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.878304 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2a866a05cc4ecba3394d4ca38e9f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.878345 16937 tablet_service.cc:1505] Processing CreateTablet for tablet bd2a866a05cc4ecba3394d4ca38e9f7c (DEFAULT_TABLE table=default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.878604 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2a866a05cc4ecba3394d4ca38e9f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.880479 17202 tablet_bootstrap.cc:492] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:00.881155 16480 master_service.cc:954] ReplaceTablet: received request to replace tablet 91176a6c085d43adab389621b96b1da7 from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:00.881443 17202 tablet_bootstrap.cc:654] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.881378 17073 tablet_service.cc:1505] Processing CreateTablet for tablet bd2a866a05cc4ecba3394d4ca38e9f7c (DEFAULT_TABLE table=default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.881510 16480 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_cf83acd5b1a641a192b2c9592488faca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:00.881647 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd2a866a05cc4ecba3394d4ca38e9f7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.882459 16704 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 41ccb58d3de9424c929c6e21e47d931e
I20251213 09:05:00.883090 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 41ccb58d3de9424c929c6e21e47d931e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:00.883296 17441 tablet_replica.cc:333] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:00.883422 17441 raft_consensus.cc:2243] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:00.883610 17441 raft_consensus.cc:2272] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.883700 17207 tablet_bootstrap.cc:492] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:00.884093 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 41ccb58d3de9424c929c6e21e47d931e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:00.884354 17441 ts_tablet_manager.cc:1916] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.884748 17207 tablet_bootstrap.cc:654] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.886412 17201 tablet_bootstrap.cc:492] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:00.886536 17441 ts_tablet_manager.cc:1929] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.886606 17441 log.cc:1199] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/41ccb58d3de9424c929c6e21e47d931e
I20251213 09:05:00.886853 17441 ts_tablet_manager.cc:1950] T 41ccb58d3de9424c929c6e21e47d931e P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:00.887610 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 41ccb58d3de9424c929c6e21e47d931e (table default.table_2a5c2b913d7940e191e58e3896de02fc [id=0b651bb014924526b0c76609312aac24]) successfully deleted
I20251213 09:05:00.887776 17201 tablet_bootstrap.cc:654] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:00.888801 17201 tablet_bootstrap.cc:492] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:00.888893 17207 tablet_bootstrap.cc:492] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:00.888897 17201 ts_tablet_manager.cc:1403] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:00.888993 17207 ts_tablet_manager.cc:1403] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:00.889420 17201 raft_consensus.cc:359] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.889534 17201 raft_consensus.cc:385] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.889578 17201 raft_consensus.cc:740] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.889525 17207 raft_consensus.cc:359] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.889629 17207 raft_consensus.cc:385] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.889690 17207 raft_consensus.cc:740] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.889739 17201 consensus_queue.cc:260] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.889809 17207 consensus_queue.cc:260] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.890036 17201 ts_tablet_manager.cc:1434] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:00.890311 17207 ts_tablet_manager.cc:1434] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:00.891069 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 41ccb58d3de9424c929c6e21e47d931e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:00 UTC) from {username='slave'} at 127.0.0.1:49302
W20251213 09:05:00.892802 16476 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_73d8d94f56c44d66a429e84fbe602baa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:00.892782 16485 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_8931d18ab40348878fba01c709567310 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:00.894304 17442 tablet_replica.cc:333] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:00.895709 17442 raft_consensus.cc:2243] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.895907 17442 raft_consensus.cc:2272] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.896611 17443 tablet_replica.cc:333] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:00.896754 17443 raft_consensus.cc:2243] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:00.896867 17443 raft_consensus.cc:2272] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:00.896880 17202 tablet_bootstrap.cc:492] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:00.896974 17202 ts_tablet_manager.cc:1403] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20251213 09:05:00.897469 17443 ts_tablet_manager.cc:1916] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.897490 17202 raft_consensus.cc:359] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.897595 17202 raft_consensus.cc:385] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:00.897629 17202 raft_consensus.cc:740] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:00.897750 17202 consensus_queue.cc:260] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.898010 17202 ts_tablet_manager.cc:1434] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:00.899828 17443 ts_tablet_manager.cc:1929] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.899896 17443 log.cc:1199] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/41ccb58d3de9424c929c6e21e47d931e
I20251213 09:05:00.900151 17443 ts_tablet_manager.cc:1950] T 41ccb58d3de9424c929c6e21e47d931e P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:00.900879 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 41ccb58d3de9424c929c6e21e47d931e (table default.table_2a5c2b913d7940e191e58e3896de02fc [id=0b651bb014924526b0c76609312aac24]) successfully deleted
I20251213 09:05:00.901217 17442 ts_tablet_manager.cc:1916] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:00.903393 17442 ts_tablet_manager.cc:1929] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:00.903486 17442 log.cc:1199] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/41ccb58d3de9424c929c6e21e47d931e
I20251213 09:05:00.903717 17442 ts_tablet_manager.cc:1950] T 41ccb58d3de9424c929c6e21e47d931e P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:00.904423 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 41ccb58d3de9424c929c6e21e47d931e (table default.table_2a5c2b913d7940e191e58e3896de02fc [id=0b651bb014924526b0c76609312aac24]) successfully deleted
I20251213 09:05:00.916277 17209 raft_consensus.cc:493] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:00.916472 17209 raft_consensus.cc:515] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.917050 17209 leader_election.cc:290] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:00.917641 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd2a866a05cc4ecba3394d4ca38e9f7c" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:00.917641 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd2a866a05cc4ecba3394d4ca38e9f7c" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:00.917798 16820 raft_consensus.cc:2468] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:00.917798 16958 raft_consensus.cc:2468] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:00.918136 17028 leader_election.cc:304] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:00.918377 17209 raft_consensus.cc:2804] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:00.918442 17209 raft_consensus.cc:493] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:00.918484 17209 raft_consensus.cc:3060] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.919878 17209 raft_consensus.cc:515] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.920315 17209 leader_election.cc:290] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:00.920737 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd2a866a05cc4ecba3394d4ca38e9f7c" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:00.920894 16958 raft_consensus.cc:3060] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.921016 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd2a866a05cc4ecba3394d4ca38e9f7c" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:00.921149 16820 raft_consensus.cc:3060] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:00.922079 16958 raft_consensus.cc:2468] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:00.922132 16820 raft_consensus.cc:2468] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:00.922490 17026 leader_election.cc:304] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:00.922827 17209 raft_consensus.cc:2804] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:00.923296 17209 raft_consensus.cc:697] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:00.923480 17209 consensus_queue.cc:237] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:00.944931 16482 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_09f90194fbf44cf0b08c91cebff82558 [id=c38ae9af9154460b93e3daaf2a32f4ca]
I20251213 09:05:00.947692 17206 consensus_queue.cc:1048] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.955447 17250 consensus_queue.cc:1048] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:00.978534 16485 catalog_manager.cc:2174] created HMS catalog entry for table [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:00.983299 16485 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 36) took 1546 ms. Trace:
I20251213 09:05:00.983393 16485 rpcz_store.cc:276] 1213 09:04:59.436882 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.715480 (+1278598us) service_pool.cc:225] Handling call
1213 09:05:00.892997 (+177517us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:00.893316 (+ 319us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:00.978523 (+ 85207us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:00.983067 (+ 4544us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:00.983190 (+ 123us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:00.983278 (+ 88us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:00.979176 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:00.979298 (+ 122us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:00.979303 (+ 5us) write_op.cc:435] Acquired schema lock
1213 09:05:00.979305 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:00.979391 (+ 86us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:00.979402 (+ 11us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:00.979406 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:00.979469 (+ 63us) tablet.cc:699] Row locks acquired
1213 09:05:00.979470 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:00.979504 (+ 34us) write_op.cc:270] Start()
1213 09:05:00.979535 (+ 31us) write_op.cc:276] Timestamp: P: 1765616700979420 usec, L: 0
1213 09:05:00.979537 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:00.979684 (+ 147us) log.cc:844] Serialized 432 byte log entry
1213 09:05:00.982223 (+ 2539us) op_driver.cc:464] REPLICATION: finished
1213 09:05:00.982332 (+ 109us) write_op.cc:301] APPLY: starting
1213 09:05:00.982349 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:00.982381 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:00.982396 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:00.982475 (+ 79us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:00.982523 (+ 48us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:00.982528 (+ 5us) write_op.cc:312] APPLY: finished
1213 09:05:00.982586 (+ 58us) log.cc:844] Serialized 28 byte log entry
1213 09:05:00.982640 (+ 54us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.982653 (+ 13us) write_op.cc:454] Released schema lock
1213 09:05:00.982658 (+ 5us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:00.982723 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:00.982726 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":51518,"Hive Metastore.run_cpu_time_us":255,"Hive Metastore.run_wall_time_us":33538,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":68,"apply.run_cpu_time_us":378,"apply.run_wall_time_us":378,"num_ops":2,"prepare.queue_time_us":69,"prepare.run_cpu_time_us":643,"prepare.run_wall_time_us":642,"raft.queue_time_us":357,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":406,"replication_time_us":2659}]]}
I20251213 09:05:00.992215 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 8a9c4e8b224d440dbab9d693bbba9e37 (DEFAULT_TABLE table=default.table_8931d18ab40348878fba01c709567310 [id=497850be5e0c40179bfa90c0c0d6f4ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.992552 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9c4e8b224d440dbab9d693bbba9e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:00.992954 16485 master_service.cc:954] ReplaceTablet: received request to replace tablet 41ccb58d3de9424c929c6e21e47d931e from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:00.993286 16485 master_service.cc:954] ReplaceTablet: received request to replace tablet a883a3870b05405baec92e54ed13c64d from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:00.994832 17202 tablet_bootstrap.cc:492] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:00.999500 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 8a9c4e8b224d440dbab9d693bbba9e37 (DEFAULT_TABLE table=default.table_8931d18ab40348878fba01c709567310 [id=497850be5e0c40179bfa90c0c0d6f4ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:00.999776 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9c4e8b224d440dbab9d693bbba9e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.001232 17202 tablet_bootstrap.cc:654] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.001951 17207 tablet_bootstrap.cc:492] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.003332 17207 tablet_bootstrap.cc:654] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.004153 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 8a9c4e8b224d440dbab9d693bbba9e37 (DEFAULT_TABLE table=default.table_8931d18ab40348878fba01c709567310 [id=497850be5e0c40179bfa90c0c0d6f4ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.004472 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a9c4e8b224d440dbab9d693bbba9e37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.006682 16476 catalog_manager.cc:2174] created HMS catalog entry for table [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:01.007656 16485 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet a883a3870b05405baec92e54ed13c64d
I20251213 09:05:01.008020 16485 catalog_manager.cc:6724] ReplaceTablet: tablet a883a3870b05405baec92e54ed13c64d deleted and replaced by tablet fb68b603c201419491b09993080789b5
I20251213 09:05:01.008591 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet a883a3870b05405baec92e54ed13c64d with delete_type TABLET_DATA_DELETED (replaced by tablet fb68b603c201419491b09993080789b5) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:01.008772 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet a883a3870b05405baec92e54ed13c64d with delete_type TABLET_DATA_DELETED (replaced by tablet fb68b603c201419491b09993080789b5) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:01.008953 17442 tablet_replica.cc:333] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:01.009073 17442 raft_consensus.cc:2243] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.009194 17442 raft_consensus.cc:2272] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.009370 17441 tablet_replica.cc:333] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:01.009505 17441 raft_consensus.cc:2243] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.009620 17441 raft_consensus.cc:2272] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.010346 16485 catalog_manager.cc:5654] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.010985 17201 tablet_bootstrap.cc:492] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
W20251213 09:05:01.011662 16484 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_7bb124a916904ca5b08081aae9ac54a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:01.012112 17201 tablet_bootstrap.cc:654] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
W20251213 09:05:01.012413 16479 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e03af1234dba427a8cdc24fb76d12515 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:01.013094 16481 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a90e27bac3a946e5bdd85f229deeb4be in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:01.013748 16480 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cf83acd5b1a641a192b2c9592488faca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:01.013989 17207 tablet_bootstrap.cc:492] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.014083 17207 ts_tablet_manager.cc:1403] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251213 09:05:01.014611 17442 ts_tablet_manager.cc:1916] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.015044 16477 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51496 (request call id 33) took 1668 ms. Trace:
I20251213 09:05:01.015090 16477 rpcz_store.cc:276] 1213 09:04:59.346089 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.557539 (+1211450us) service_pool.cc:225] Handling call
1213 09:05:00.709685 (+152146us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:01.015033 (+305348us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":54107,"Hive Metastore.run_cpu_time_us":221,"Hive Metastore.run_wall_time_us":35975}
I20251213 09:05:01.015324 16477 master_service.cc:954] ReplaceTablet: received request to replace tablet d735ff6da0d24a1d902e50ac154c5d26 from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:01.016425 16478 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51496 (request call id 27) took 1715 ms. Trace:
I20251213 09:05:01.016479 16478 rpcz_store.cc:276] 1213 09:04:59.300506 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:04:59.779052 (+478546us) service_pool.cc:225] Handling call
1213 09:05:00.709645 (+930593us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:01.016415 (+306770us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":6784,"Hive Metastore.run_cpu_time_us":173,"Hive Metastore.run_wall_time_us":47309}
I20251213 09:05:01.016703 16478 master_service.cc:954] ReplaceTablet: received request to replace tablet 91176a6c085d43adab389621b96b1da7 from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:01.016948 17442 ts_tablet_manager.cc:1929] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.017016 17442 log.cc:1199] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/a883a3870b05405baec92e54ed13c64d
I20251213 09:05:01.016983 16478 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_d1445dc6dbb1441d82855de496280fd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:01.017282 17442 ts_tablet_manager.cc:1950] T a883a3870b05405baec92e54ed13c64d P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:01.018460 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet a883a3870b05405baec92e54ed13c64d with delete_type TABLET_DATA_DELETED (replaced by tablet fb68b603c201419491b09993080789b5) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:01.018656 17443 tablet_replica.cc:333] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:01.018783 17443 raft_consensus.cc:2243] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:01.018980 17441 ts_tablet_manager.cc:1916] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.019022 17443 raft_consensus.cc:2272] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.020910 16476 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 37) took 1554 ms. Trace:
I20251213 09:05:01.020988 16476 rpcz_store.cc:276] 1213 09:04:59.466431 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.716307 (+1249876us) service_pool.cc:225] Handling call
1213 09:05:00.892906 (+176599us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:00.893300 (+ 394us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:01.006674 (+113374us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:01.020728 (+ 14054us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:01.020823 (+ 95us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:01.020894 (+ 71us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:01.012827 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:01.012908 (+ 81us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:01.012913 (+ 5us) write_op.cc:435] Acquired schema lock
1213 09:05:01.012914 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:01.012997 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:01.013006 (+ 9us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:01.013009 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:01.013056 (+ 47us) tablet.cc:699] Row locks acquired
1213 09:05:01.013058 (+ 2us) write_op.cc:260] PREPARE: finished
1213 09:05:01.013085 (+ 27us) write_op.cc:270] Start()
1213 09:05:01.013106 (+ 21us) write_op.cc:276] Timestamp: P: 1765616701012999 usec, L: 0
1213 09:05:01.013108 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:01.013227 (+ 119us) log.cc:844] Serialized 432 byte log entry
1213 09:05:01.018866 (+ 5639us) op_driver.cc:464] REPLICATION: finished
1213 09:05:01.019962 (+ 1096us) write_op.cc:301] APPLY: starting
1213 09:05:01.019978 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:01.020006 (+ 28us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:01.020020 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:01.020112 (+ 92us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:01.020151 (+ 39us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:01.020156 (+ 5us) write_op.cc:312] APPLY: finished
1213 09:05:01.020214 (+ 58us) log.cc:844] Serialized 28 byte log entry
1213 09:05:01.020287 (+ 73us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.020299 (+ 12us) write_op.cc:454] Released schema lock
1213 09:05:01.020304 (+ 5us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:01.020375 (+ 71us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.020378 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":85103,"Hive Metastore.run_cpu_time_us":237,"Hive Metastore.run_wall_time_us":27215,"mutex_wait_us":31,"spinlock_wait_cycles":384,"child_traces":[["op",{"apply.queue_time_us":1042,"apply.run_cpu_time_us":400,"apply.run_wall_time_us":400,"num_ops":2,"prepare.queue_time_us":5775,"prepare.run_cpu_time_us":497,"prepare.run_wall_time_us":498,"raft.queue_time_us":523,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":158,"replication_time_us":5732}]]}
I20251213 09:05:01.021459 16476 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_fd1d1908e83b4925a03e655168a92b9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:01.021847 17441 ts_tablet_manager.cc:1929] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.021936 17441 log.cc:1199] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/a883a3870b05405baec92e54ed13c64d
I20251213 09:05:01.022357 17441 ts_tablet_manager.cc:1950] T a883a3870b05405baec92e54ed13c64d P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:01.023455 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet a883a3870b05405baec92e54ed13c64d (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:05:01.024587 16704 catalog_manager.cc:2772] Deleting table default.table_09f90194fbf44cf0b08c91cebff82558 [id=c38ae9af9154460b93e3daaf2a32f4ca] in response to Hive Metastore notification log event 25
I20251213 09:05:01.025421 16477 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet d735ff6da0d24a1d902e50ac154c5d26
I20251213 09:05:01.025719 16477 catalog_manager.cc:6724] ReplaceTablet: tablet d735ff6da0d24a1d902e50ac154c5d26 deleted and replaced by tablet f44dbd7d563346f58c3e04e5224bfe5e
I20251213 09:05:01.025978 16477 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_9282d807387b4dce85db4768d872eff3" } new_table_name: "default.Table_b3265ac4a94e4212945564c7137ada7c" modify_external_catalogs: true
I20251213 09:05:01.026501 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet d735ff6da0d24a1d902e50ac154c5d26 with delete_type TABLET_DATA_DELETED (replaced by tablet f44dbd7d563346f58c3e04e5224bfe5e) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:01.026955 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet d735ff6da0d24a1d902e50ac154c5d26 with delete_type TABLET_DATA_DELETED (replaced by tablet f44dbd7d563346f58c3e04e5224bfe5e) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:01.027416 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet d735ff6da0d24a1d902e50ac154c5d26 with delete_type TABLET_DATA_DELETED (replaced by tablet f44dbd7d563346f58c3e04e5224bfe5e) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:01.028071 17443 ts_tablet_manager.cc:1916] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.030494 17443 ts_tablet_manager.cc:1929] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.030577 17443 log.cc:1199] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/a883a3870b05405baec92e54ed13c64d
I20251213 09:05:01.030840 17443 ts_tablet_manager.cc:1950] T a883a3870b05405baec92e54ed13c64d P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:01.031677 16704 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 621515f0f52e4378a5bd09989a72a06c
I20251213 09:05:01.033432 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 621515f0f52e4378a5bd09989a72a06c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:01 UTC) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:01.033778 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 621515f0f52e4378a5bd09989a72a06c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:01 UTC) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:01.035409 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 621515f0f52e4378a5bd09989a72a06c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:01 UTC) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:01.014591 17207 raft_consensus.cc:359] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.035945 17207 raft_consensus.cc:385] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.035991 17207 raft_consensus.cc:740] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.036190 17207 consensus_queue.cc:260] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.039633 16485 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_63ce7db97320462daf62f4af78345483" } new_table_name: "default.Table_1b2da3534d4d457a886358d9b231dea8" modify_external_catalogs: true
I20251213 09:05:01.042093 17442 tablet_replica.cc:333] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:01.042232 17442 raft_consensus.cc:2243] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.042346 17442 raft_consensus.cc:2272] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.042649 16482 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:51496 (request call id 35) took 1655 ms. Trace:
I20251213 09:05:01.042716 16482 rpcz_store.cc:276] 1213 09:04:59.386856 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.714263 (+1327407us) service_pool.cc:225] Handling call
1213 09:05:00.892446 (+178183us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:01.042634 (+150188us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":3559,"Hive Metastore.run_cpu_time_us":179,"Hive Metastore.run_wall_time_us":48750}
I20251213 09:05:01.043779 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet a883a3870b05405baec92e54ed13c64d (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:05:01.045197 17202 tablet_bootstrap.cc:492] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.045311 17202 ts_tablet_manager.cc:1403] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.051s user 0.003s sys 0.000s
I20251213 09:05:01.039065 17207 ts_tablet_manager.cc:1434] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.025s user 0.002s sys 0.000s
I20251213 09:05:01.045871 17202 raft_consensus.cc:359] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.046011 17202 raft_consensus.cc:385] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.046052 17202 raft_consensus.cc:740] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.046172 17202 consensus_queue.cc:260] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.046484 17202 ts_tablet_manager.cc:1434] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.049026 17201 tablet_bootstrap.cc:492] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.049142 17201 ts_tablet_manager.cc:1403] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
I20251213 09:05:01.049614 17201 raft_consensus.cc:359] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.049723 17201 raft_consensus.cc:385] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.049750 17201 raft_consensus.cc:740] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.049860 17201 consensus_queue.cc:260] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.055384 17201 ts_tablet_manager.cc:1434] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251213 09:05:01.057548 16801 tablet_service.cc:1505] Processing CreateTablet for tablet fb68b603c201419491b09993080789b5 (DEFAULT_TABLE table=default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.057857 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb68b603c201419491b09993080789b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.060323 17202 tablet_bootstrap.cc:492] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.061478 17202 tablet_bootstrap.cc:654] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.061960 16937 tablet_service.cc:1505] Processing CreateTablet for tablet fb68b603c201419491b09993080789b5 (DEFAULT_TABLE table=default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.062681 17073 tablet_service.cc:1505] Processing CreateTablet for tablet fb68b603c201419491b09993080789b5 (DEFAULT_TABLE table=default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.062985 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb68b603c201419491b09993080789b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.063684 17202 tablet_bootstrap.cc:492] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.063791 17202 ts_tablet_manager.cc:1403] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20251213 09:05:01.064311 17202 raft_consensus.cc:359] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.064438 17202 raft_consensus.cc:385] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.064482 17202 raft_consensus.cc:740] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.064612 17202 consensus_queue.cc:260] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.064916 17202 ts_tablet_manager.cc:1434] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:01.068609 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb68b603c201419491b09993080789b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.074963 17209 raft_consensus.cc:493] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.075099 17209 raft_consensus.cc:515] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.075575 17209 leader_election.cc:290] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:01.075639 16482 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_924224088c604b9682478db9e1bbe741" } modify_external_catalogs: true
I20251213 09:05:01.075798 16482 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_924224088c604b9682478db9e1bbe741" } modify_external_catalogs: true
I20251213 09:05:01.076359 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a9c4e8b224d440dbab9d693bbba9e37" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.076540 16820 raft_consensus.cc:2468] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:01.076709 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a9c4e8b224d440dbab9d693bbba9e37" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:01.076858 16958 raft_consensus.cc:2468] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:01.077009 17026 leader_election.cc:304] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:01.077196 17209 raft_consensus.cc:2804] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.077256 17209 raft_consensus.cc:493] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.077298 17209 raft_consensus.cc:3060] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.077759 16800 tablet_service.cc:1505] Processing CreateTablet for tablet f44dbd7d563346f58c3e04e5224bfe5e (DEFAULT_TABLE table=default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.078050 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44dbd7d563346f58c3e04e5224bfe5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.078294 17209 raft_consensus.cc:515] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.078680 17209 leader_election.cc:290] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:01.079591 16801 tablet_service.cc:1505] Processing CreateTablet for tablet c5adcb68c5b9438da10370479acbed52 (DEFAULT_TABLE table=default.table_73d8d94f56c44d66a429e84fbe602baa [id=e9b9d5d3630e485c8177b62bf7cbc8ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.080049 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a9c4e8b224d440dbab9d693bbba9e37" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:01.080184 16958 raft_consensus.cc:3060] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.080479 16484 catalog_manager.cc:2174] created HMS catalog entry for table [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:01.080732 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5adcb68c5b9438da10370479acbed52. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.080747 17202 tablet_bootstrap.cc:492] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.081171 17072 tablet_service.cc:1505] Processing CreateTablet for tablet f44dbd7d563346f58c3e04e5224bfe5e (DEFAULT_TABLE table=default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.081219 16958 raft_consensus.cc:2468] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:01.081447 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44dbd7d563346f58c3e04e5224bfe5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.081822 17202 tablet_bootstrap.cc:654] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.083999 17028 leader_election.cc:304] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.084308 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8a9c4e8b224d440dbab9d693bbba9e37" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.084431 16820 raft_consensus.cc:3060] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.085340 16820 raft_consensus.cc:2468] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:01.085743 17209 raft_consensus.cc:2804] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.085853 17209 raft_consensus.cc:697] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:01.085983 17209 consensus_queue.cc:237] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.090534 16938 tablet_service.cc:1505] Processing CreateTablet for tablet f44dbd7d563346f58c3e04e5224bfe5e (DEFAULT_TABLE table=default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.090844 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f44dbd7d563346f58c3e04e5224bfe5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.093819 16937 tablet_service.cc:1505] Processing CreateTablet for tablet c5adcb68c5b9438da10370479acbed52 (DEFAULT_TABLE table=default.table_73d8d94f56c44d66a429e84fbe602baa [id=e9b9d5d3630e485c8177b62bf7cbc8ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.094099 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5adcb68c5b9438da10370479acbed52. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.102514 16484 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 38) took 1601 ms. Trace:
I20251213 09:05:01.102592 16484 rpcz_store.cc:276] 1213 09:04:59.501060 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.725700 (+1224640us) service_pool.cc:225] Handling call
1213 09:05:01.011739 (+286039us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:01.012084 (+ 345us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:01.080471 (+ 68387us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:01.102315 (+ 21844us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:01.102413 (+ 98us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:01.102496 (+ 83us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:01.082328 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:01.082429 (+ 101us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:01.082433 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:01.082434 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:01.082498 (+ 64us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:01.082506 (+ 8us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:01.082508 (+ 2us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:01.082565 (+ 57us) tablet.cc:699] Row locks acquired
1213 09:05:01.082568 (+ 3us) write_op.cc:260] PREPARE: finished
1213 09:05:01.082602 (+ 34us) write_op.cc:270] Start()
1213 09:05:01.082637 (+ 35us) write_op.cc:276] Timestamp: P: 1765616701082508 usec, L: 0
1213 09:05:01.082639 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:01.082785 (+ 146us) log.cc:844] Serialized 432 byte log entry
1213 09:05:01.096959 (+ 14174us) op_driver.cc:464] REPLICATION: finished
1213 09:05:01.097078 (+ 119us) write_op.cc:301] APPLY: starting
1213 09:05:01.097096 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:01.097130 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:01.097149 (+ 19us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:01.097233 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:01.097268 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:01.097273 (+ 5us) write_op.cc:312] APPLY: finished
1213 09:05:01.097341 (+ 68us) log.cc:844] Serialized 28 byte log entry
1213 09:05:01.097425 (+ 84us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.097441 (+ 16us) write_op.cc:454] Released schema lock
1213 09:05:01.097447 (+ 6us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:01.097536 (+ 89us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.097539 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":11884,"Hive Metastore.run_cpu_time_us":255,"Hive Metastore.run_wall_time_us":55843,"child_traces":[["op",{"apply.queue_time_us":51,"apply.run_cpu_time_us":456,"apply.run_wall_time_us":456,"num_ops":2,"prepare.queue_time_us":1428,"prepare.run_cpu_time_us":547,"prepare.run_wall_time_us":548,"raft.queue_time_us":769,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":244,"replication_time_us":14287}]]}
I20251213 09:05:01.105600 17073 tablet_service.cc:1505] Processing CreateTablet for tablet c5adcb68c5b9438da10370479acbed52 (DEFAULT_TABLE table=default.table_73d8d94f56c44d66a429e84fbe602baa [id=e9b9d5d3630e485c8177b62bf7cbc8ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.105928 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5adcb68c5b9438da10370479acbed52. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.108073 17201 tablet_bootstrap.cc:492] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.109313 17201 tablet_bootstrap.cc:654] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.109462 17207 tablet_bootstrap.cc:492] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.110384 17443 tablet_replica.cc:333] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:01.110482 17207 tablet_bootstrap.cc:654] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.110601 17443 raft_consensus.cc:2243] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:01.110811 17443 raft_consensus.cc:2272] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.111368 17443 ts_tablet_manager.cc:1916] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.111975 17442 ts_tablet_manager.cc:1916] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.113806 17441 tablet_replica.cc:333] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:01.114017 17441 raft_consensus.cc:2243] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.114121 17442 ts_tablet_manager.cc:1929] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.114228 17442 log.cc:1199] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/d735ff6da0d24a1d902e50ac154c5d26
I20251213 09:05:01.114548 17442 ts_tablet_manager.cc:1950] T d735ff6da0d24a1d902e50ac154c5d26 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:01.115312 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet a883a3870b05405baec92e54ed13c64d (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]) successfully deleted
I20251213 09:05:01.115758 17441 raft_consensus.cc:2272] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.116405 17441 ts_tablet_manager.cc:1916] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.118180 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet d735ff6da0d24a1d902e50ac154c5d26 (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:05:01.118665 17441 ts_tablet_manager.cc:1929] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.118726 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 10339e3d2aef482580748a80f247d57f (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.118784 17441 log.cc:1199] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/d735ff6da0d24a1d902e50ac154c5d26
I20251213 09:05:01.118742 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 10339e3d2aef482580748a80f247d57f (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.118971 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10339e3d2aef482580748a80f247d57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.118981 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10339e3d2aef482580748a80f247d57f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.119069 17441 ts_tablet_manager.cc:1950] T d735ff6da0d24a1d902e50ac154c5d26 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:01.119704 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet d735ff6da0d24a1d902e50ac154c5d26 (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:05:01.119940 17441 tablet_replica.cc:333] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:01.120079 17441 raft_consensus.cc:2243] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.120182 17441 raft_consensus.cc:2272] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.114722 17443 ts_tablet_manager.cc:1929] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.120652 17443 log.cc:1199] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/d735ff6da0d24a1d902e50ac154c5d26
I20251213 09:05:01.120739 17441 ts_tablet_manager.cc:1916] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.120893 17443 ts_tablet_manager.cc:1950] T d735ff6da0d24a1d902e50ac154c5d26 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:01.121373 17443 tablet_replica.cc:333] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:01.121521 17442 tablet_replica.cc:333] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:01.121698 17442 raft_consensus.cc:2243] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.121819 17442 raft_consensus.cc:2272] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.122053 17443 raft_consensus.cc:2243] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:01.122459 17442 ts_tablet_manager.cc:1916] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.122687 17443 raft_consensus.cc:2272] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.123231 16484 catalog_manager.cc:5654] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:01.123942 17441 ts_tablet_manager.cc:1929] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:01.123526 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet d735ff6da0d24a1d902e50ac154c5d26 (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:05:01.124706 17442 ts_tablet_manager.cc:1929] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:01.127646 17441 log.cc:1199] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/621515f0f52e4378a5bd09989a72a06c
I20251213 09:05:01.127982 17441 ts_tablet_manager.cc:1950] T 621515f0f52e4378a5bd09989a72a06c P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:01.128815 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 621515f0f52e4378a5bd09989a72a06c (table default.table_09f90194fbf44cf0b08c91cebff82558 [id=c38ae9af9154460b93e3daaf2a32f4ca]) successfully deleted
I20251213 09:05:01.129791 16479 catalog_manager.cc:2174] created HMS catalog entry for table [id=2b664bbdfb5d437fa4afe367a5b93fd3]
I20251213 09:05:01.130498 17443 ts_tablet_manager.cc:1916] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.130817 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 10339e3d2aef482580748a80f247d57f (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.133553 16479 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 39) took 1586 ms. Trace:
I20251213 09:05:01.133617 16479 rpcz_store.cc:276] 1213 09:04:59.546611 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.726240 (+1179629us) service_pool.cc:225] Handling call
1213 09:05:01.012487 (+286247us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:01.012787 (+ 300us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:01.129786 (+116999us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:01.133387 (+ 3601us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:01.133470 (+ 83us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:01.133541 (+ 71us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:01.130253 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:01.130332 (+ 79us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:01.130335 (+ 3us) write_op.cc:435] Acquired schema lock
1213 09:05:01.130336 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:01.130394 (+ 58us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:01.130402 (+ 8us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:01.130405 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:01.130450 (+ 45us) tablet.cc:699] Row locks acquired
1213 09:05:01.130452 (+ 2us) write_op.cc:260] PREPARE: finished
1213 09:05:01.130474 (+ 22us) write_op.cc:270] Start()
1213 09:05:01.130493 (+ 19us) write_op.cc:276] Timestamp: P: 1765616701130376 usec, L: 0
1213 09:05:01.130494 (+ 1us) op_driver.cc:348] REPLICATION: starting
1213 09:05:01.131252 (+ 758us) log.cc:844] Serialized 432 byte log entry
1213 09:05:01.132899 (+ 1647us) op_driver.cc:464] REPLICATION: finished
1213 09:05:01.133020 (+ 121us) write_op.cc:301] APPLY: starting
1213 09:05:01.133031 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:01.133053 (+ 22us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:01.133065 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:01.133184 (+ 119us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:01.133209 (+ 25us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:01.133214 (+ 5us) write_op.cc:312] APPLY: finished
1213 09:05:01.133258 (+ 44us) log.cc:844] Serialized 28 byte log entry
1213 09:05:01.133307 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.133318 (+ 11us) write_op.cc:454] Released schema lock
1213 09:05:01.133322 (+ 4us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:01.133384 (+ 62us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.133387 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":67085,"Hive Metastore.run_cpu_time_us":200,"Hive Metastore.run_wall_time_us":49656,"child_traces":[["op",{"apply.queue_time_us":41,"apply.run_cpu_time_us":372,"apply.run_wall_time_us":371,"num_ops":2,"prepare.queue_time_us":92,"prepare.run_cpu_time_us":684,"prepare.run_wall_time_us":1100,"raft.queue_time_us":91,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":350,"replication_time_us":2385,"spinlock_wait_cycles":1385600}]]}
I20251213 09:05:01.135324 16479 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_00ca8030ef8d48088f07fb15e26d5bac" } modify_external_catalogs: true
I20251213 09:05:01.135447 16479 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_00ca8030ef8d48088f07fb15e26d5bac" } modify_external_catalogs: true
I20251213 09:05:01.137219 17442 log.cc:1199] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/621515f0f52e4378a5bd09989a72a06c
I20251213 09:05:01.137578 17442 ts_tablet_manager.cc:1950] T 621515f0f52e4378a5bd09989a72a06c P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:01.138293 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 621515f0f52e4378a5bd09989a72a06c (table default.table_09f90194fbf44cf0b08c91cebff82558 [id=c38ae9af9154460b93e3daaf2a32f4ca]) successfully deleted
I20251213 09:05:01.143267 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 7876a7d15b0e438ebb7f6224794a6e46 (DEFAULT_TABLE table=default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.143615 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7876a7d15b0e438ebb7f6224794a6e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.143671 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 7876a7d15b0e438ebb7f6224794a6e46 (DEFAULT_TABLE table=default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.143937 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7876a7d15b0e438ebb7f6224794a6e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.149923 16484 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet fb68b603c201419491b09993080789b5 (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:01.137122 17443 ts_tablet_manager.cc:1929] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:01.150676 17443 log.cc:1199] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/621515f0f52e4378a5bd09989a72a06c
I20251213 09:05:01.151369 17443 ts_tablet_manager.cc:1950] T 621515f0f52e4378a5bd09989a72a06c P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:01.146756 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 7876a7d15b0e438ebb7f6224794a6e46 (DEFAULT_TABLE table=default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.152664 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10339e3d2aef482580748a80f247d57f. 1 dirs total, 0 dirs full, 0 dirs failed
W20251213 09:05:01.153168 16484 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet fb68b603c201419491b09993080789b5 (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet fb68b603c201419491b09993080789b5 consensus state has no leader
I20251213 09:05:01.152505 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 621515f0f52e4378a5bd09989a72a06c (table default.table_09f90194fbf44cf0b08c91cebff82558 [id=c38ae9af9154460b93e3daaf2a32f4ca]) successfully deleted
I20251213 09:05:01.155930 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7876a7d15b0e438ebb7f6224794a6e46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.158056 17206 raft_consensus.cc:493] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.158162 17206 raft_consensus.cc:515] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.158385 17209 consensus_queue.cc:1048] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.158563 17206 leader_election.cc:290] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.158778 16484 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_d6d6d9a459ff460f97765707846c32ea" } new_table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" modify_external_catalogs: true
I20251213 09:05:01.159042 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e15d3e0580943cfa60041729f1bff62" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.159201 16819 raft_consensus.cc:2468] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.159736 16891 leader_election.cc:304] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.159914 17201 tablet_bootstrap.cc:492] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.159996 17201 ts_tablet_manager.cc:1403] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20251213 09:05:01.160305 17207 tablet_bootstrap.cc:492] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.160385 17207 ts_tablet_manager.cc:1403] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.000s
I20251213 09:05:01.160660 17201 raft_consensus.cc:359] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.160758 17201 raft_consensus.cc:385] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.160790 17201 raft_consensus.cc:740] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.160828 17207 raft_consensus.cc:359] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.160915 17207 raft_consensus.cc:385] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.160949 17207 raft_consensus.cc:740] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.160928 17201 consensus_queue.cc:260] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.161057 17207 consensus_queue.cc:260] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.161201 17201 ts_tablet_manager.cc:1434] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.161325 17207 ts_tablet_manager.cc:1434] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:01.161412 17201 tablet_bootstrap.cc:492] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.161499 17207 tablet_bootstrap.cc:492] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.162468 17201 tablet_bootstrap.cc:654] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.162468 17207 tablet_bootstrap.cc:654] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.163587 17202 tablet_bootstrap.cc:492] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.163873 17237 raft_consensus.cc:2804] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.163934 17237 raft_consensus.cc:493] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.163990 17237 raft_consensus.cc:3060] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.165007 17237 raft_consensus.cc:515] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.165342 17237 leader_election.cc:290] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.167941 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e15d3e0580943cfa60041729f1bff62" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.168057 16820 raft_consensus.cc:3060] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.168363 16481 catalog_manager.cc:2174] created HMS catalog entry for table [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:01.169009 16820 raft_consensus.cc:2468] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.169430 17202 ts_tablet_manager.cc:1403] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.001s
I20251213 09:05:01.169947 17202 raft_consensus.cc:359] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.170050 17202 raft_consensus.cc:385] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.170083 17202 raft_consensus.cc:740] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.170197 17202 consensus_queue.cc:260] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.170483 17202 ts_tablet_manager.cc:1434] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.170661 17202 tablet_bootstrap.cc:492] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.170769 16891 leader_election.cc:304] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.171876 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e15d3e0580943cfa60041729f1bff62" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.172016 17092 raft_consensus.cc:2468] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.172250 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0e15d3e0580943cfa60041729f1bff62" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.172340 17091 raft_consensus.cc:3060] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.173823 17091 raft_consensus.cc:2468] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.174624 17206 raft_consensus.cc:2804] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.174723 17206 raft_consensus.cc:697] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:01.174858 17206 consensus_queue.cc:237] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.175220 16481 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 40) took 1587 ms. Trace:
I20251213 09:05:01.175292 16481 rpcz_store.cc:276] 1213 09:04:59.587391 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.729876 (+1142485us) service_pool.cc:225] Handling call
1213 09:05:01.013176 (+283300us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:01.013486 (+ 310us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:01.168355 (+154869us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:01.174989 (+ 6634us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:01.175101 (+ 112us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:01.175203 (+ 102us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:01.169048 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:01.169179 (+ 131us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:01.169184 (+ 5us) write_op.cc:435] Acquired schema lock
1213 09:05:01.169186 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:01.169260 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:01.169272 (+ 12us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:01.169275 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:01.169343 (+ 68us) tablet.cc:699] Row locks acquired
1213 09:05:01.169345 (+ 2us) write_op.cc:260] PREPARE: finished
1213 09:05:01.169380 (+ 35us) write_op.cc:270] Start()
1213 09:05:01.169411 (+ 31us) write_op.cc:276] Timestamp: P: 1765616701169274 usec, L: 0
1213 09:05:01.169413 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:01.169568 (+ 155us) log.cc:844] Serialized 432 byte log entry
1213 09:05:01.174299 (+ 4731us) op_driver.cc:464] REPLICATION: finished
1213 09:05:01.174395 (+ 96us) write_op.cc:301] APPLY: starting
1213 09:05:01.174412 (+ 17us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:01.174443 (+ 31us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:01.174456 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:01.174552 (+ 96us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:01.174581 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:01.174586 (+ 5us) write_op.cc:312] APPLY: finished
1213 09:05:01.174647 (+ 61us) log.cc:844] Serialized 28 byte log entry
1213 09:05:01.174705 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.174721 (+ 16us) write_op.cc:454] Released schema lock
1213 09:05:01.174727 (+ 6us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:01.174790 (+ 63us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.174793 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":116073,"Hive Metastore.run_cpu_time_us":224,"Hive Metastore.run_wall_time_us":38529,"child_traces":[["op",{"apply.queue_time_us":54,"apply.run_cpu_time_us":384,"apply.run_wall_time_us":384,"num_ops":2,"prepare.queue_time_us":196,"prepare.run_cpu_time_us":631,"prepare.run_wall_time_us":632,"raft.queue_time_us":583,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":303,"replication_time_us":4858,"spinlock_wait_cycles":24960}]]}
I20251213 09:05:01.177800 17202 tablet_bootstrap.cc:654] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.179281 17201 tablet_bootstrap.cc:492] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.179395 17201 ts_tablet_manager.cc:1403] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251213 09:05:01.179903 17201 raft_consensus.cc:359] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.179962 17207 tablet_bootstrap.cc:492] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.180001 17201 raft_consensus.cc:385] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.180029 17201 raft_consensus.cc:740] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.180042 17207 ts_tablet_manager.cc:1403] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251213 09:05:01.180150 17201 consensus_queue.cc:260] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.180426 17201 ts_tablet_manager.cc:1434] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:01.180616 17201 tablet_bootstrap.cc:492] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.180506 17207 raft_consensus.cc:359] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.181464 17207 raft_consensus.cc:385] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.181495 17207 raft_consensus.cc:740] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.182209 17207 consensus_queue.cc:260] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.183810 17207 ts_tablet_manager.cc:1434] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:05:01.184605 16481 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet fb68b603c201419491b09993080789b5 (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:01.184882 16801 tablet_service.cc:1505] Processing CreateTablet for tablet e84ebaac44df41368df8bafc582e55cc (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.185055 17073 tablet_service.cc:1505] Processing CreateTablet for tablet e84ebaac44df41368df8bafc582e55cc (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.185153 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84ebaac44df41368df8bafc582e55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.185279 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84ebaac44df41368df8bafc582e55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.185568 16481 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet fb68b603c201419491b09993080789b5 (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:01.186766 16481 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_d884ba72f14242f19c59cb34de4b7f36" } new_table_name: "default.Table_bd51adb8915743138d7a842893d52f60" modify_external_catalogs: true
I20251213 09:05:01.188822 16937 tablet_service.cc:1505] Processing CreateTablet for tablet e84ebaac44df41368df8bafc582e55cc (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.189101 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e84ebaac44df41368df8bafc582e55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.190038 17201 tablet_bootstrap.cc:654] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.191202 17202 tablet_bootstrap.cc:492] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.191291 17202 ts_tablet_manager.cc:1403] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20251213 09:05:01.191787 17202 raft_consensus.cc:359] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.191896 17202 raft_consensus.cc:385] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.191928 17202 raft_consensus.cc:740] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.192049 17202 consensus_queue.cc:260] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.192325 17202 ts_tablet_manager.cc:1434] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.192534 17202 tablet_bootstrap.cc:492] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.193519 17202 tablet_bootstrap.cc:654] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.197106 17207 tablet_bootstrap.cc:492] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.198122 17207 tablet_bootstrap.cc:654] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.202169 17202 tablet_bootstrap.cc:492] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.202257 17202 ts_tablet_manager.cc:1403] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251213 09:05:01.202783 17202 raft_consensus.cc:359] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.202881 17202 raft_consensus.cc:385] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.202911 17202 raft_consensus.cc:740] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.203022 17202 consensus_queue.cc:260] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.203860 17202 ts_tablet_manager.cc:1434] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:01.204020 17202 tablet_bootstrap.cc:492] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.206830 17239 consensus_queue.cc:1048] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.207315 17202 tablet_bootstrap.cc:654] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.208513 17201 tablet_bootstrap.cc:492] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.208612 17201 ts_tablet_manager.cc:1403] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.002s
I20251213 09:05:01.209082 17201 raft_consensus.cc:359] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.209183 17201 raft_consensus.cc:385] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.209213 17201 raft_consensus.cc:740] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.209322 17201 consensus_queue.cc:260] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.209589 17201 ts_tablet_manager.cc:1434] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:01.209731 17201 tablet_bootstrap.cc:492] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.210664 17201 tablet_bootstrap.cc:654] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.212209 17207 tablet_bootstrap.cc:492] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.212317 17207 ts_tablet_manager.cc:1403] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251213 09:05:01.212813 17207 raft_consensus.cc:359] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.212906 17207 raft_consensus.cc:385] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.212942 17207 raft_consensus.cc:740] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.213085 17207 consensus_queue.cc:260] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.213349 17207 ts_tablet_manager.cc:1434] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.213546 17207 tablet_bootstrap.cc:492] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.214498 17207 tablet_bootstrap.cc:654] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.215926 17239 raft_consensus.cc:493] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.216012 17239 raft_consensus.cc:515] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.216408 17239 leader_election.cc:290] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:01.217120 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5adcb68c5b9438da10370479acbed52" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.217260 16821 raft_consensus.cc:2468] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:01.218312 17026 leader_election.cc:304] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
W20251213 09:05:01.218501 16470 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet fb68b603c201419491b09993080789b5 (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fb68b603c201419491b09993080789b5 consensus state has no leader
I20251213 09:05:01.218855 17209 raft_consensus.cc:2804] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.218907 17209 raft_consensus.cc:493] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.218941 17209 raft_consensus.cc:3060] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.219970 17209 raft_consensus.cc:515] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.220301 17209 leader_election.cc:290] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:01.221814 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5adcb68c5b9438da10370479acbed52" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.221915 16821 raft_consensus.cc:3060] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.222710 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5adcb68c5b9438da10370479acbed52" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:01.222741 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5adcb68c5b9438da10370479acbed52" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:01.222831 16958 raft_consensus.cc:2468] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:01.222867 16821 raft_consensus.cc:2468] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:01.223217 17026 leader_election.cc:304] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:01.223464 17209 raft_consensus.cc:2804] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.223543 17209 raft_consensus.cc:697] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:01.223672 17209 consensus_queue.cc:237] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.224037 17207 tablet_bootstrap.cc:492] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.224107 17207 ts_tablet_manager.cc:1403] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251213 09:05:01.224603 17207 raft_consensus.cc:359] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.224704 17207 raft_consensus.cc:385] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.224736 17207 raft_consensus.cc:740] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.224830 17207 consensus_queue.cc:260] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.225066 17207 ts_tablet_manager.cc:1434] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.225234 17207 tablet_bootstrap.cc:492] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.226202 17207 tablet_bootstrap.cc:654] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.227609 17207 tablet_bootstrap.cc:492] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.227705 17207 ts_tablet_manager.cc:1403] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:01.228150 17207 raft_consensus.cc:359] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.228242 17207 raft_consensus.cc:385] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.228273 17207 raft_consensus.cc:740] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.228401 17207 consensus_queue.cc:260] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.228662 17207 ts_tablet_manager.cc:1434] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.228824 17207 tablet_bootstrap.cc:492] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.230129 17207 tablet_bootstrap.cc:654] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.232350 17207 tablet_bootstrap.cc:492] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.232440 17207 ts_tablet_manager.cc:1403] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:01.232869 17207 raft_consensus.cc:359] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.232980 17207 raft_consensus.cc:385] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.233012 17207 raft_consensus.cc:740] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.233124 17207 consensus_queue.cc:260] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.234071 17201 tablet_bootstrap.cc:492] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.234169 17201 ts_tablet_manager.cc:1403] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.002s
I20251213 09:05:01.234750 17201 raft_consensus.cc:359] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.234856 17201 raft_consensus.cc:385] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.234884 17201 raft_consensus.cc:740] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.235000 17201 consensus_queue.cc:260] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.235324 17201 ts_tablet_manager.cc:1434] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:01.235512 17201 tablet_bootstrap.cc:492] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.236559 17201 tablet_bootstrap.cc:654] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.238324 17207 ts_tablet_manager.cc:1434] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251213 09:05:01.243247 17202 tablet_bootstrap.cc:492] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.243383 17202 ts_tablet_manager.cc:1403] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.039s user 0.002s sys 0.000s
I20251213 09:05:01.243654 17201 tablet_bootstrap.cc:492] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.243736 17201 ts_tablet_manager.cc:1403] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20251213 09:05:01.243927 17202 raft_consensus.cc:359] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.244025 17202 raft_consensus.cc:385] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.244058 17202 raft_consensus.cc:740] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.244190 17202 consensus_queue.cc:260] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.244292 17201 raft_consensus.cc:359] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.244395 17201 raft_consensus.cc:385] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.244426 17201 raft_consensus.cc:740] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.244506 17202 ts_tablet_manager.cc:1434] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.244495 17239 raft_consensus.cc:493] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.244547 17201 consensus_queue.cc:260] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.244613 17239 raft_consensus.cc:515] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.244706 17202 tablet_bootstrap.cc:492] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.244870 17201 ts_tablet_manager.cc:1434] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.245040 17201 tablet_bootstrap.cc:492] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.245042 17239 leader_election.cc:290] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:01.245492 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84ebaac44df41368df8bafc582e55cc" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:01.245500 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84ebaac44df41368df8bafc582e55cc" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.245805 17202 tablet_bootstrap.cc:654] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
W20251213 09:05:01.245950 17026 leader_election.cc:343] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Illegal state: must be running to vote when last-logged opid is not known
W20251213 09:05:01.246057 17028 leader_election.cc:343] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Illegal state: must be running to vote when last-logged opid is not known
I20251213 09:05:01.246096 17201 tablet_bootstrap.cc:654] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.246121 17028 leader_election.cc:304] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:01.246392 17239 raft_consensus.cc:2749] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:01.249300 17201 tablet_bootstrap.cc:492] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.249742 17202 tablet_bootstrap.cc:492] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.249884 17202 ts_tablet_manager.cc:1403] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:01.250407 17202 raft_consensus.cc:359] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.250481 17201 ts_tablet_manager.cc:1403] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:01.250568 17202 raft_consensus.cc:385] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.250650 17202 raft_consensus.cc:740] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.250913 17393 raft_consensus.cc:493] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.250988 17393 raft_consensus.cc:515] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.250969 17201 raft_consensus.cc:359] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.251053 17201 raft_consensus.cc:385] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.251034 16480 catalog_manager.cc:2174] created HMS catalog entry for table [id=f579b0c783bd4db4920fe2246c04d0df]
I20251213 09:05:01.251083 17201 raft_consensus.cc:740] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.251253 17201 consensus_queue.cc:260] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.251384 17393 leader_election.cc:290] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.252044 17202 consensus_queue.cc:260] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.252089 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10339e3d2aef482580748a80f247d57f" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.252209 17091 raft_consensus.cc:2468] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:01.252257 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10339e3d2aef482580748a80f247d57f" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:01.252377 16958 raft_consensus.cc:2468] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:01.252954 16756 leader_election.cc:304] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.255105 17393 raft_consensus.cc:2804] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.255194 17393 raft_consensus.cc:493] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.255239 17393 raft_consensus.cc:3060] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.255537 17201 ts_tablet_manager.cc:1434] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20251213 09:05:01.256327 17393 raft_consensus.cc:515] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.256690 17393 leader_election.cc:290] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.257570 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10339e3d2aef482580748a80f247d57f" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.257702 17091 raft_consensus.cc:3060] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.257647 17202 ts_tablet_manager.cc:1434] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20251213 09:05:01.258775 17091 raft_consensus.cc:2468] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:01.259347 16757 leader_election.cc:304] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:01.259354 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "10339e3d2aef482580748a80f247d57f" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:01.259485 16958 raft_consensus.cc:3060] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.260210 17393 raft_consensus.cc:2804] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.260394 17393 raft_consensus.cc:697] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:01.260528 17393 consensus_queue.cc:237] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.260677 16958 raft_consensus.cc:2468] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:01.263419 16480 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:51496 (request call id 43) took 1108 ms. Trace:
I20251213 09:05:01.263509 16480 rpcz_store.cc:276] 1213 09:05:00.155252 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.881438 (+726186us) service_pool.cc:225] Handling call
1213 09:05:01.013816 (+132378us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:01.014105 (+ 289us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:01.251023 (+236918us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:01.263201 (+ 12178us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:01.263300 (+ 99us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:01.263399 (+ 99us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:01.251577 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:01.251688 (+ 111us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:01.251693 (+ 5us) write_op.cc:435] Acquired schema lock
1213 09:05:01.251694 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:01.251768 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:01.251779 (+ 11us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:01.251783 (+ 4us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:01.251840 (+ 57us) tablet.cc:699] Row locks acquired
1213 09:05:01.251842 (+ 2us) write_op.cc:260] PREPARE: finished
1213 09:05:01.251874 (+ 32us) write_op.cc:270] Start()
1213 09:05:01.251904 (+ 30us) write_op.cc:276] Timestamp: P: 1765616701251760 usec, L: 0
1213 09:05:01.251908 (+ 4us) op_driver.cc:348] REPLICATION: starting
1213 09:05:01.252050 (+ 142us) log.cc:844] Serialized 432 byte log entry
1213 09:05:01.261688 (+ 9638us) op_driver.cc:464] REPLICATION: finished
1213 09:05:01.261826 (+ 138us) write_op.cc:301] APPLY: starting
1213 09:05:01.261848 (+ 22us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:01.261881 (+ 33us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:01.261898 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:01.261991 (+ 93us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:01.262026 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:01.262032 (+ 6us) write_op.cc:312] APPLY: finished
1213 09:05:01.262106 (+ 74us) log.cc:844] Serialized 28 byte log entry
1213 09:05:01.262182 (+ 76us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.262202 (+ 20us) write_op.cc:454] Released schema lock
1213 09:05:01.262208 (+ 6us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:01.262283 (+ 75us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:01.262285 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":154030,"Hive Metastore.run_cpu_time_us":234,"Hive Metastore.run_wall_time_us":82630,"child_traces":[["op",{"apply.queue_time_us":75,"apply.run_cpu_time_us":452,"apply.run_wall_time_us":452,"num_ops":2,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":579,"prepare.run_wall_time_us":579,"raft.queue_time_us":1091,"raft.run_cpu_time_us":416,"raft.run_wall_time_us":417,"replication_time_us":9747}]]}
I20251213 09:05:01.264590 16480 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet fb68b603c201419491b09993080789b5 (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:01.264714 16480 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]). Expected version 1 got 0
W20251213 09:05:01.265154 16480 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f44dbd7d563346f58c3e04e5224bfe5e consensus state has no leader
I20251213 09:05:01.265950 16480 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]). Expected version 1 got 0
I20251213 09:05:01.273154 17393 raft_consensus.cc:493] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.273273 17393 raft_consensus.cc:515] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.273623 17393 leader_election.cc:290] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:01.274395 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7876a7d15b0e438ebb7f6224794a6e46" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.274554 17091 raft_consensus.cc:2468] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:01.274858 16757 leader_election.cc:304] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:01.275022 17393 raft_consensus.cc:2804] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.275063 17393 raft_consensus.cc:493] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.275096 17393 raft_consensus.cc:3060] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.276219 17393 raft_consensus.cc:515] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.276911 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7876a7d15b0e438ebb7f6224794a6e46" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.277050 17091 raft_consensus.cc:3060] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.277287 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7876a7d15b0e438ebb7f6224794a6e46" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:01.277423 16957 raft_consensus.cc:3060] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.278076 17091 raft_consensus.cc:2468] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:01.278415 16957 raft_consensus.cc:2468] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:01.278817 16756 leader_election.cc:304] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.279057 17484 raft_consensus.cc:2804] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.279289 17484 raft_consensus.cc:697] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:01.279373 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 5c6e18d23d374b7faecc78db155aaa2c (DEFAULT_TABLE table=default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.279436 17484 consensus_queue.cc:237] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:01.279702 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6e18d23d374b7faecc78db155aaa2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.282114 17202 tablet_bootstrap.cc:492] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.282512 17393 leader_election.cc:290] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:01.283277 17202 tablet_bootstrap.cc:654] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.284997 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 5c6e18d23d374b7faecc78db155aaa2c (DEFAULT_TABLE table=default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.285310 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6e18d23d374b7faecc78db155aaa2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.285266 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 5c6e18d23d374b7faecc78db155aaa2c (DEFAULT_TABLE table=default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.285579 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6e18d23d374b7faecc78db155aaa2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.287562 17201 tablet_bootstrap.cc:492] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.288645 17201 tablet_bootstrap.cc:654] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.289899 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7876a7d15b0e438ebb7f6224794a6e46" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:01.290040 16958 raft_consensus.cc:2376] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1. Re-sending same reply.
I20251213 09:05:01.291105 17207 tablet_bootstrap.cc:492] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.292183 17207 tablet_bootstrap.cc:654] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.293355 16480 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet fb68b603c201419491b09993080789b5 (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
I20251213 09:05:01.293440 17201 tablet_bootstrap.cc:492] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.293524 17201 ts_tablet_manager.cc:1403] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251213 09:05:01.293565 16480 catalog_manager.cc:5654] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.293800 16480 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]). Expected version 1 got 0
I20251213 09:05:01.293958 17201 raft_consensus.cc:359] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.294051 17201 raft_consensus.cc:385] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.294081 17201 raft_consensus.cc:740] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.294209 17201 consensus_queue.cc:260] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.294459 17201 ts_tablet_manager.cc:1434] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:01.298538 17207 tablet_bootstrap.cc:492] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.298640 17207 ts_tablet_manager.cc:1403] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251213 09:05:01.299062 17207 raft_consensus.cc:359] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.299284 17207 raft_consensus.cc:385] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.299320 17207 raft_consensus.cc:740] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.299429 17207 consensus_queue.cc:260] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.300460 17207 ts_tablet_manager.cc:1434] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251213 09:05:01.306571 17393 raft_consensus.cc:493] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.306746 17393 raft_consensus.cc:515] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.307245 17393 leader_election.cc:290] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.308107 17202 tablet_bootstrap.cc:492] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.308210 17202 ts_tablet_manager.cc:1403] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.002s
I20251213 09:05:01.308193 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb68b603c201419491b09993080789b5" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.308305 17091 raft_consensus.cc:2468] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:01.308569 16757 leader_election.cc:304] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:01.308753 17486 raft_consensus.cc:2804] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.308728 17202 raft_consensus.cc:359] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.308810 17486 raft_consensus.cc:493] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.308837 17202 raft_consensus.cc:385] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.308856 17486 raft_consensus.cc:3060] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.308874 17202 raft_consensus.cc:740] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.309000 17202 consensus_queue.cc:260] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.309123 17250 raft_consensus.cc:493] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.309208 17250 raft_consensus.cc:515] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.309286 17202 ts_tablet_manager.cc:1434] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.309597 17250 leader_election.cc:290] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.309911 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb68b603c201419491b09993080789b5" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:01.310029 16958 raft_consensus.cc:2468] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:01.310515 16480 catalog_manager.cc:5654] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.311753 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f44dbd7d563346f58c3e04e5224bfe5e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.311870 16821 raft_consensus.cc:2468] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.313244 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f44dbd7d563346f58c3e04e5224bfe5e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.313359 17091 raft_consensus.cc:2468] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.313977 16891 leader_election.cc:304] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.314198 17250 raft_consensus.cc:2804] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.314251 17250 raft_consensus.cc:493] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.314288 17250 raft_consensus.cc:3060] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.315238 17250 raft_consensus.cc:515] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.315606 17250 leader_election.cc:290] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.316191 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f44dbd7d563346f58c3e04e5224bfe5e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.316300 17091 raft_consensus.cc:3060] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.316740 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f44dbd7d563346f58c3e04e5224bfe5e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.316839 16821 raft_consensus.cc:3060] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.317374 17091 raft_consensus.cc:2468] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.317894 16821 raft_consensus.cc:2468] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.318398 16891 leader_election.cc:304] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.320983 17250 raft_consensus.cc:2804] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.321079 17250 raft_consensus.cc:697] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:01.321211 17250 consensus_queue.cc:237] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.321653 16480 catalog_manager.cc:5654] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.325316 17486 raft_consensus.cc:515] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.329353 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb68b603c201419491b09993080789b5" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:01.329432 17486 leader_election.cc:290] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.329519 16958 raft_consensus.cc:3060] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.329517 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb68b603c201419491b09993080789b5" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.329622 17091 raft_consensus.cc:3060] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.330550 16958 raft_consensus.cc:2468] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:01.330585 17091 raft_consensus.cc:2468] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:01.330895 16757 leader_election.cc:304] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:01.331215 17486 raft_consensus.cc:2804] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.331676 17486 raft_consensus.cc:697] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:01.331866 17486 consensus_queue.cc:237] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.336987 16480 catalog_manager.cc:5654] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.342782 16480 catalog_manager.cc:5654] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.343088 16480 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]). Expected version 1 got 0
I20251213 09:05:01.344358 16483 catalog_manager.cc:3485] renamed table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee] in HMS: new name default.table_202ae634c0504cf88ed2d25c49b0d397
I20251213 09:05:01.347755 17239 consensus_queue.cc:1048] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.354754 16480 catalog_manager.cc:5654] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.355101 16480 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet fb68b603c201419491b09993080789b5 (table default.table_36b3468fc09644f19f0e34101ca664a7 [id=4ec61addd21c4307bce7a9891a6983ee]). Expected version 1 got 0
W20251213 09:05:01.356892 16704 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb68b603c201419491b09993080789b5 consensus state has no leader
W20251213 09:05:01.357299 16478 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d1445dc6dbb1441d82855de496280fd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:01.357939 16476 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_fd1d1908e83b4925a03e655168a92b9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:01.361850 17209 consensus_queue.cc:1048] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.367997 16480 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_0bc46ad17b194fbf831fab656bf97fd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:01.372378 17091 raft_consensus.cc:1275] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Refusing update from remote peer ba49ca51d8eb4be288091d19e7114792: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:05:01.372473 16821 raft_consensus.cc:1275] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Refusing update from remote peer ba49ca51d8eb4be288091d19e7114792: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:05:01.372957 17250 consensus_queue.cc:1048] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.373306 17250 consensus_queue.cc:1048] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.386758 17498 tablet.cc:1722] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:01.387465 17497 tablet.cc:1722] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:01.392952 17250 raft_consensus.cc:493] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.393069 17250 raft_consensus.cc:515] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.393441 17250 leader_election.cc:290] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:01.394007 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84ebaac44df41368df8bafc582e55cc" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.394161 16820 raft_consensus.cc:2468] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.394591 16891 leader_election.cc:304] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.394618 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84ebaac44df41368df8bafc582e55cc" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.394789 17091 raft_consensus.cc:2468] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.394833 17250 raft_consensus.cc:2804] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.394884 17250 raft_consensus.cc:493] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.394922 17250 raft_consensus.cc:3060] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.402456 17342 mvcc.cc:204] Tried to move back new op lower bound from 7231966008817762304 to 7231966008613249024. Current Snapshot: MvccSnapshot[applied={T|T < 7231966008817762304}]
I20251213 09:05:01.403007 17500 tablet.cc:1722] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:01.409451 17250 raft_consensus.cc:515] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.409865 17250 leader_election.cc:290] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:01.411166 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84ebaac44df41368df8bafc582e55cc" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.411302 16821 raft_consensus.cc:3060] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.411521 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e84ebaac44df41368df8bafc582e55cc" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.411656 17091 raft_consensus.cc:3060] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.412312 16821 raft_consensus.cc:2468] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.412660 16891 leader_election.cc:304] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.412688 17091 raft_consensus.cc:2468] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.415650 17091 raft_consensus.cc:1275] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Refusing update from remote peer 42c0ccabbfc1460685086e58e05cd152: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:05:01.415843 16958 raft_consensus.cc:1275] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Refusing update from remote peer 42c0ccabbfc1460685086e58e05cd152: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:05:01.416209 17393 consensus_queue.cc:1048] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.416356 17486 consensus_queue.cc:1048] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.417254 17237 raft_consensus.cc:2804] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.417359 17237 raft_consensus.cc:697] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:01.417508 17237 consensus_queue.cc:237] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.425731 17500 tablet.cc:1722] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251213 09:05:01.427960 17498 tablet.cc:1722] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251213 09:05:01.432755 17497 tablet.cc:1722] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251213 09:05:01.439622 16477 catalog_manager.cc:3485] renamed table default.table_9282d807387b4dce85db4768d872eff3 [id=bac9e29e59e64238a969a0bca23f9074] in HMS: new name default.table_b3265ac4a94e4212945564c7137ada7c
I20251213 09:05:01.482437 16485 catalog_manager.cc:3485] renamed table default.table_63ce7db97320462daf62f4af78345483 [id=57463d6c4bc24d45ab54ddf180a102cd] in HMS: new name default.table_1b2da3534d4d457a886358d9b231dea8
I20251213 09:05:01.482949 17239 consensus_queue.cc:1048] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.493928 17209 consensus_queue.cc:1048] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.508380 16478 catalog_manager.cc:2174] created HMS catalog entry for table [id=ad6f8e7d521942ceb1a70bd4515486d9]
I20251213 09:05:01.511281 17250 raft_consensus.cc:493] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.511421 17250 raft_consensus.cc:515] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.511824 17250 leader_election.cc:290] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:01.512348 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c6e18d23d374b7faecc78db155aaa2c" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.512410 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c6e18d23d374b7faecc78db155aaa2c" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.512488 17091 raft_consensus.cc:2468] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.512545 16821 raft_consensus.cc:2468] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.512825 16894 leader_election.cc:304] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.513036 17250 raft_consensus.cc:2804] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.513095 17250 raft_consensus.cc:493] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.513149 17250 raft_consensus.cc:3060] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.514245 17250 raft_consensus.cc:515] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.514622 17250 leader_election.cc:290] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:01.516937 16478 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]). Expected version 1 got 0
I20251213 09:05:01.518038 16478 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]). Expected version 1 got 0
I20251213 09:05:01.522137 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c6e18d23d374b7faecc78db155aaa2c" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.522298 16821 raft_consensus.cc:3060] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.524798 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c6e18d23d374b7faecc78db155aaa2c" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.524946 17091 raft_consensus.cc:3060] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.526031 17091 raft_consensus.cc:2468] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.526759 16894 leader_election.cc:304] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.527205 16821 raft_consensus.cc:2468] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.527671 17250 raft_consensus.cc:2804] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.527771 17250 raft_consensus.cc:697] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:01.527917 17250 consensus_queue.cc:237] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:01.534286 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 (DEFAULT_TABLE table=default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.534634 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466ce39a1a5d4037b9ce27eaba467266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.534622 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 (DEFAULT_TABLE table=default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.534752 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 (DEFAULT_TABLE table=default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.534925 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466ce39a1a5d4037b9ce27eaba467266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.535009 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466ce39a1a5d4037b9ce27eaba467266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.537142 17201 tablet_bootstrap.cc:492] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.537223 17202 tablet_bootstrap.cc:492] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.538090 17201 tablet_bootstrap.cc:654] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.538240 17202 tablet_bootstrap.cc:654] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.538403 16478 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_202ae634c0504cf88ed2d25c49b0d397 [id=4ec61addd21c4307bce7a9891a6983ee] alter complete (version 2)
I20251213 09:05:01.538723 17207 tablet_bootstrap.cc:492] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.539662 17202 tablet_bootstrap.cc:492] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.539687 17207 tablet_bootstrap.cc:654] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.539753 17202 ts_tablet_manager.cc:1403] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:01.540309 17202 raft_consensus.cc:359] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.540424 17202 raft_consensus.cc:385] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.540462 17202 raft_consensus.cc:740] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.540580 17202 consensus_queue.cc:260] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.540903 17202 ts_tablet_manager.cc:1434] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.541363 17201 tablet_bootstrap.cc:492] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.541296 16478 catalog_manager.cc:5654] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.541457 17201 ts_tablet_manager.cc:1403] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:05:01.541893 17201 raft_consensus.cc:359] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.541999 17201 raft_consensus.cc:385] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.542035 17201 raft_consensus.cc:740] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.542148 17201 consensus_queue.cc:260] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.542446 17201 ts_tablet_manager.cc:1434] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.544534 17207 tablet_bootstrap.cc:492] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.544631 17207 ts_tablet_manager.cc:1403] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251213 09:05:01.545146 17207 raft_consensus.cc:359] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.545254 17207 raft_consensus.cc:385] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.545286 17207 raft_consensus.cc:740] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.545415 17207 consensus_queue.cc:260] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.547348 17207 ts_tablet_manager.cc:1434] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251213 09:05:01.550745 16476 catalog_manager.cc:2174] created HMS catalog entry for table [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:01.555166 16476 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_731dc67a6a2b407180abef538691c40c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:01.559836 16483 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:51496 (request call id 41) took 1654 ms. Trace:
I20251213 09:05:01.559922 16483 rpcz_store.cc:276] 1213 09:04:59.905244 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:00.829630 (+924386us) service_pool.cc:225] Handling call
1213 09:05:01.014871 (+185241us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:01.559513 (+544642us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:01.559672 (+ 159us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:01.559820 (+ 148us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":235884,"Hive Metastore.run_cpu_time_us":491,"Hive Metastore.run_wall_time_us":93346}
I20251213 09:05:01.560791 16483 catalog_manager.cc:5654] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:01.560973 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 79d28675183f4fb1ad9a573cab3bba32 (DEFAULT_TABLE table=default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.561101 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 79d28675183f4fb1ad9a573cab3bba32 (DEFAULT_TABLE table=default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.561262 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d28675183f4fb1ad9a573cab3bba32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.561399 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d28675183f4fb1ad9a573cab3bba32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.561882 17499 consensus_queue.cc:1048] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.564183 17202 tablet_bootstrap.cc:492] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.564321 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 79d28675183f4fb1ad9a573cab3bba32 (DEFAULT_TABLE table=default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.564565 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d28675183f4fb1ad9a573cab3bba32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.565186 17202 tablet_bootstrap.cc:654] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.567828 17207 tablet_bootstrap.cc:492] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.567878 16483 master_service.cc:954] ReplaceTablet: received request to replace tablet 851541c0460f4ca09bbbaf3764ba8d5d from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:01.568841 17201 tablet_bootstrap.cc:492] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.569025 16478 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_432a26ea35484c14b07c89f682c923e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:01.569880 17201 tablet_bootstrap.cc:654] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.571655 17250 consensus_queue.cc:1048] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.572283 16483 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 851541c0460f4ca09bbbaf3764ba8d5d
I20251213 09:05:01.572583 16483 catalog_manager.cc:6724] ReplaceTablet: tablet 851541c0460f4ca09bbbaf3764ba8d5d deleted and replaced by tablet 7d063b797ac74e9fbefa304a854dfba3
I20251213 09:05:01.572702 16483 master_service.cc:954] ReplaceTablet: received request to replace tablet ae4b3ae0e6cb4169861d12d90756c401 from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:01.568894 17207 tablet_bootstrap.cc:654] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.573879 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 851541c0460f4ca09bbbaf3764ba8d5d with delete_type TABLET_DATA_DELETED (replaced by tablet 7d063b797ac74e9fbefa304a854dfba3) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:01.574056 17443 tablet_replica.cc:333] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:01.574191 17443 raft_consensus.cc:2243] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.574302 17443 raft_consensus.cc:2272] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.575460 17443 ts_tablet_manager.cc:1916] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.575802 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 851541c0460f4ca09bbbaf3764ba8d5d with delete_type TABLET_DATA_DELETED (replaced by tablet 7d063b797ac74e9fbefa304a854dfba3) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:01.576398 17442 tablet_replica.cc:333] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:01.576735 17442 raft_consensus.cc:2243] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.576872 17442 raft_consensus.cc:2272] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.577407 17202 tablet_bootstrap.cc:492] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.577502 17202 ts_tablet_manager.cc:1403] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20251213 09:05:01.577983 17202 raft_consensus.cc:359] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.578140 17202 raft_consensus.cc:385] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.578178 17202 raft_consensus.cc:740] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.578320 17202 consensus_queue.cc:260] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.579216 17202 ts_tablet_manager.cc:1434] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:01.579288 17442 ts_tablet_manager.cc:1916] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.581450 17442 ts_tablet_manager.cc:1929] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.581518 17442 log.cc:1199] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/851541c0460f4ca09bbbaf3764ba8d5d
I20251213 09:05:01.584013 17443 ts_tablet_manager.cc:1929] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.584095 17443 log.cc:1199] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/851541c0460f4ca09bbbaf3764ba8d5d
I20251213 09:05:01.584626 17443 ts_tablet_manager.cc:1950] T 851541c0460f4ca09bbbaf3764ba8d5d P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:01.587673 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 851541c0460f4ca09bbbaf3764ba8d5d (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:01.588025 16483 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet ae4b3ae0e6cb4169861d12d90756c401
I20251213 09:05:01.588250 16483 catalog_manager.cc:6724] ReplaceTablet: tablet ae4b3ae0e6cb4169861d12d90756c401 deleted and replaced by tablet 37930409accc4a1eb5e31c095667f597
I20251213 09:05:01.588385 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 7d063b797ac74e9fbefa304a854dfba3 (DEFAULT_TABLE table=default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.588626 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d063b797ac74e9fbefa304a854dfba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.589414 16483 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 0e15d3e0580943cfa60041729f1bff62 (table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]). Expected version 1 got 0
I20251213 09:05:01.589747 16483 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_1eb38c19e2ee4d43bce7ee0f6617f5d6" } modify_external_catalogs: true
I20251213 09:05:01.589846 16483 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_1eb38c19e2ee4d43bce7ee0f6617f5d6" } modify_external_catalogs: true
I20251213 09:05:01.592218 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet ae4b3ae0e6cb4169861d12d90756c401 with delete_type TABLET_DATA_DELETED (replaced by tablet 37930409accc4a1eb5e31c095667f597) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:01.592415 16799 tablet_service.cc:1552] Processing DeleteTablet for tablet ae4b3ae0e6cb4169861d12d90756c401 with delete_type TABLET_DATA_DELETED (replaced by tablet 37930409accc4a1eb5e31c095667f597) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:01.592443 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 7d063b797ac74e9fbefa304a854dfba3 (DEFAULT_TABLE table=default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.592566 17441 tablet_replica.cc:333] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:01.592674 17441 raft_consensus.cc:2243] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.592772 17441 raft_consensus.cc:2272] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.592224 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 7d063b797ac74e9fbefa304a854dfba3 (DEFAULT_TABLE table=default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.593302 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d063b797ac74e9fbefa304a854dfba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.594439 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 851541c0460f4ca09bbbaf3764ba8d5d with delete_type TABLET_DATA_DELETED (replaced by tablet 7d063b797ac74e9fbefa304a854dfba3) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:01.595430 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d063b797ac74e9fbefa304a854dfba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.596372 17442 ts_tablet_manager.cc:1950] T 851541c0460f4ca09bbbaf3764ba8d5d P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:01.596974 17442 tablet_replica.cc:333] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:01.597087 17442 raft_consensus.cc:2243] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:01.597241 17442 raft_consensus.cc:2272] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.597694 17202 tablet_bootstrap.cc:492] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.597728 17441 ts_tablet_manager.cc:1916] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.598956 17497 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251213 09:05:01.599201 17442 ts_tablet_manager.cc:1916] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.599613 17441 ts_tablet_manager.cc:1929] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.599673 17441 log.cc:1199] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/ae4b3ae0e6cb4169861d12d90756c401
I20251213 09:05:01.599893 17441 ts_tablet_manager.cc:1950] T ae4b3ae0e6cb4169861d12d90756c401 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:01.600488 17202 tablet_bootstrap.cc:654] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.600454 17498 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251213 09:05:01.600888 17441 tablet_replica.cc:333] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:01.601006 17441 raft_consensus.cc:2243] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:01.601181 17441 raft_consensus.cc:2272] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.601393 17207 tablet_bootstrap.cc:492] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.601464 17207 ts_tablet_manager.cc:1403] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.001s
I20251213 09:05:01.601835 17442 ts_tablet_manager.cc:1929] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.601874 17207 raft_consensus.cc:359] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.602005 17207 raft_consensus.cc:385] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.602051 17207 raft_consensus.cc:740] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.602169 17207 consensus_queue.cc:260] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.602432 17207 ts_tablet_manager.cc:1434] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.602586 17207 tablet_bootstrap.cc:492] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.603482 17207 tablet_bootstrap.cc:654] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.603511 17441 ts_tablet_manager.cc:1916] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.601888 17442 log.cc:1199] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/ae4b3ae0e6cb4169861d12d90756c401
I20251213 09:05:01.604602 17442 ts_tablet_manager.cc:1950] T ae4b3ae0e6cb4169861d12d90756c401 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:01.606317 17441 ts_tablet_manager.cc:1929] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.606384 17441 log.cc:1199] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/851541c0460f4ca09bbbaf3764ba8d5d
I20251213 09:05:01.606606 17441 ts_tablet_manager.cc:1950] T 851541c0460f4ca09bbbaf3764ba8d5d P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:01.609112 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 851541c0460f4ca09bbbaf3764ba8d5d (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:01.609252 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet ae4b3ae0e6cb4169861d12d90756c401 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:05:01.609906 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet ae4b3ae0e6cb4169861d12d90756c401 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:05:01.610037 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 851541c0460f4ca09bbbaf3764ba8d5d (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:01.610850 17497 tablet.cc:1722] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:01.611070 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet ae4b3ae0e6cb4169861d12d90756c401 with delete_type TABLET_DATA_DELETED (replaced by tablet 37930409accc4a1eb5e31c095667f597) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:01.613665 17443 tablet_replica.cc:333] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:01.613786 17443 raft_consensus.cc:2243] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.613880 17443 raft_consensus.cc:2272] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.614535 17443 ts_tablet_manager.cc:1916] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.616293 17500 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251213 09:05:01.616598 17443 ts_tablet_manager.cc:1929] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:01.616660 17443 log.cc:1199] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/ae4b3ae0e6cb4169861d12d90756c401
I20251213 09:05:01.616909 17443 ts_tablet_manager.cc:1950] T ae4b3ae0e6cb4169861d12d90756c401 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:01.617708 17201 tablet_bootstrap.cc:492] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.617787 17201 ts_tablet_manager.cc:1403] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.000s
I20251213 09:05:01.618535 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet ae4b3ae0e6cb4169861d12d90756c401 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:05:01.619482 17201 raft_consensus.cc:359] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.619581 17201 raft_consensus.cc:385] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.619608 17201 raft_consensus.cc:740] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.619757 17201 consensus_queue.cc:260] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.620431 17201 ts_tablet_manager.cc:1434] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:01.620612 17201 tablet_bootstrap.cc:492] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.621382 17500 tablet.cc:1722] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:01.622803 17201 tablet_bootstrap.cc:654] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.624472 17201 tablet_bootstrap.cc:492] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.624581 17201 ts_tablet_manager.cc:1403] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20251213 09:05:01.627771 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 37930409accc4a1eb5e31c095667f597 (DEFAULT_TABLE table=default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.628062 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37930409accc4a1eb5e31c095667f597. 1 dirs total, 0 dirs full, 0 dirs failed
W20251213 09:05:01.629472 16480 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0bc46ad17b194fbf831fab656bf97fd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:01.629465 16476 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_731dc67a6a2b407180abef538691c40c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:01.630403 16477 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 0e15d3e0580943cfa60041729f1bff62 (table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]). Expected version 1 got 0
I20251213 09:05:01.631608 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 37930409accc4a1eb5e31c095667f597 (DEFAULT_TABLE table=default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.631649 16477 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 0e15d3e0580943cfa60041729f1bff62 (table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]). Expected version 1 got 0
I20251213 09:05:01.631873 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37930409accc4a1eb5e31c095667f597. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.636544 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 37930409accc4a1eb5e31c095667f597 (DEFAULT_TABLE table=default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.636830 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37930409accc4a1eb5e31c095667f597. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.641573 16485 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_e03af1234dba427a8cdc24fb76d12515" } modify_external_catalogs: true
I20251213 09:05:01.641709 16485 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51496:
table { table_name: "default.Table_e03af1234dba427a8cdc24fb76d12515" } modify_external_catalogs: true
I20251213 09:05:01.643277 16477 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_1b2da3534d4d457a886358d9b231dea8 [id=57463d6c4bc24d45ab54ddf180a102cd] alter complete (version 2)
I20251213 09:05:01.644953 17207 tablet_bootstrap.cc:492] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.645053 17207 ts_tablet_manager.cc:1403] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.002s
I20251213 09:05:01.645404 17202 tablet_bootstrap.cc:492] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.645486 17202 ts_tablet_manager.cc:1403] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20251213 09:05:01.645592 17207 raft_consensus.cc:359] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.645712 17207 raft_consensus.cc:385] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.645745 17207 raft_consensus.cc:740] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.645867 17207 consensus_queue.cc:260] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.646018 17202 raft_consensus.cc:359] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.646132 17202 raft_consensus.cc:385] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.646167 17207 ts_tablet_manager.cc:1434] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:01.646164 17202 raft_consensus.cc:740] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.646275 17202 consensus_queue.cc:260] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.646356 17207 tablet_bootstrap.cc:492] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.646543 17202 ts_tablet_manager.cc:1434] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.646710 17202 tablet_bootstrap.cc:492] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.647688 17202 tablet_bootstrap.cc:654] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.648345 17498 tablet.cc:1722] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:01.649235 17207 tablet_bootstrap.cc:654] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.652387 17201 raft_consensus.cc:359] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.652530 17201 raft_consensus.cc:385] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.652566 17201 raft_consensus.cc:740] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.653507 17201 consensus_queue.cc:260] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.656245 16477 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074] alter complete (version 1)
I20251213 09:05:01.656833 17202 tablet_bootstrap.cc:492] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.656908 17202 ts_tablet_manager.cc:1403] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251213 09:05:01.657045 16477 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 1 got 0
W20251213 09:05:01.657358 16477 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 7d063b797ac74e9fbefa304a854dfba3 consensus state has no leader
I20251213 09:05:01.657335 17202 raft_consensus.cc:359] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.657433 17202 raft_consensus.cc:385] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.657469 17202 raft_consensus.cc:740] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.657578 17202 consensus_queue.cc:260] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.657830 17202 ts_tablet_manager.cc:1434] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:01.658591 17201 ts_tablet_manager.cc:1434] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.034s user 0.001s sys 0.000s
I20251213 09:05:01.658802 17201 tablet_bootstrap.cc:492] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.659242 16477 master_service.cc:954] ReplaceTablet: received request to replace tablet ae4b3ae0e6cb4169861d12d90756c401 from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:01.660547 17207 tablet_bootstrap.cc:492] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.660625 17207 ts_tablet_manager.cc:1403] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251213 09:05:01.660580 16477 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 1 got 0
I20251213 09:05:01.660818 16477 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]). Expected version 1 got 0
I20251213 09:05:01.660892 17201 tablet_bootstrap.cc:654] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.661149 17207 raft_consensus.cc:359] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.661260 17207 raft_consensus.cc:385] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.661298 17207 raft_consensus.cc:740] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
W20251213 09:05:01.661378 16477 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 37930409accc4a1eb5e31c095667f597 consensus state has no leader
I20251213 09:05:01.661410 17207 consensus_queue.cc:260] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.661721 17207 ts_tablet_manager.cc:1434] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:01.662218 16477 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 1 got 0
I20251213 09:05:01.663609 16477 master_service.cc:954] ReplaceTablet: received request to replace tablet e84ebaac44df41368df8bafc582e55cc from {username='slave'} at 127.0.0.1:51496
I20251213 09:05:01.668517 16477 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet e84ebaac44df41368df8bafc582e55cc
I20251213 09:05:01.668942 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet e84ebaac44df41368df8bafc582e55cc with delete_type TABLET_DATA_DELETED (replaced by tablet bd00dd09b602490ea10b92795bbc2b82) from {username='slave'} at 127.0.0.1:38044
I20251213 09:05:01.669186 17442 tablet_replica.cc:333] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:01.669319 17442 raft_consensus.cc:2243] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.669440 17442 raft_consensus.cc:2272] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.669523 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet e84ebaac44df41368df8bafc582e55cc with delete_type TABLET_DATA_DELETED (replaced by tablet bd00dd09b602490ea10b92795bbc2b82) from {username='slave'} at 127.0.0.1:51868
I20251213 09:05:01.669668 17441 tablet_replica.cc:333] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:01.669780 17441 raft_consensus.cc:2243] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:01.669874 17441 raft_consensus.cc:2272] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.670023 16477 catalog_manager.cc:6724] ReplaceTablet: tablet e84ebaac44df41368df8bafc582e55cc deleted and replaced by tablet bd00dd09b602490ea10b92795bbc2b82
I20251213 09:05:01.670010 17442 ts_tablet_manager.cc:1916] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.670307 17441 ts_tablet_manager.cc:1916] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.672010 17442 ts_tablet_manager.cc:1929] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:05:01.672067 17442 log.cc:1199] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/e84ebaac44df41368df8bafc582e55cc
I20251213 09:05:01.672210 17441 ts_tablet_manager.cc:1929] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:05:01.672263 17442 ts_tablet_manager.cc:1950] T e84ebaac44df41368df8bafc582e55cc P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:01.672271 17441 log.cc:1199] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/e84ebaac44df41368df8bafc582e55cc
I20251213 09:05:01.672500 17441 ts_tablet_manager.cc:1950] T e84ebaac44df41368df8bafc582e55cc P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:01.672753 17209 raft_consensus.cc:493] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.672823 17209 raft_consensus.cc:515] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.673039 16482 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]
I20251213 09:05:01.673591 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d063b797ac74e9fbefa304a854dfba3" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.673722 16821 raft_consensus.cc:2468] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:01.673863 16469 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet e84ebaac44df41368df8bafc582e55cc (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]) successfully deleted
I20251213 09:05:01.673843 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d063b797ac74e9fbefa304a854dfba3" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:01.673966 16957 raft_consensus.cc:2468] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:01.673993 16958 raft_consensus.cc:3060] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.675019 17028 leader_election.cc:304] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.675225 17239 raft_consensus.cc:2804] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.675220 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet e84ebaac44df41368df8bafc582e55cc with delete_type TABLET_DATA_DELETED (replaced by tablet bd00dd09b602490ea10b92795bbc2b82) from {username='slave'} at 127.0.0.1:49302
I20251213 09:05:01.675279 17239 raft_consensus.cc:493] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.675321 17239 raft_consensus.cc:3060] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.673238 17209 leader_election.cc:290] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:01.675699 17443 tablet_replica.cc:333] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:01.675839 17443 raft_consensus.cc:2243] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:01.675967 17443 pending_rounds.cc:70] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Trying to abort 1 pending ops.
I20251213 09:05:01.676055 17443 pending_rounds.cc:77] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7231966009007681536 op_type: NO_OP noop_request { }
I20251213 09:05:01.676116 17443 raft_consensus.cc:2889] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251213 09:05:01.676198 17443 raft_consensus.cc:2272] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:01.676196 17239 raft_consensus.cc:515] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.676551 17239 leader_election.cc:290] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:01.677386 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d063b797ac74e9fbefa304a854dfba3" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.677505 16821 raft_consensus.cc:3060] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.678200 17443 ts_tablet_manager.cc:1916] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:01.678467 16821 raft_consensus.cc:2468] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:01.678844 17026 leader_election.cc:304] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:01.679454 17209 raft_consensus.cc:2804] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.679602 17209 raft_consensus.cc:697] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:01.679733 17209 consensus_queue.cc:237] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.680334 17443 ts_tablet_manager.cc:1929] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:01.680402 17443 log.cc:1199] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/e84ebaac44df41368df8bafc582e55cc
I20251213 09:05:01.680646 17443 ts_tablet_manager.cc:1950] T e84ebaac44df41368df8bafc582e55cc P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:01.681303 16472 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet e84ebaac44df41368df8bafc582e55cc (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]) successfully deleted
I20251213 09:05:01.681356 17201 tablet_bootstrap.cc:492] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.681445 17201 ts_tablet_manager.cc:1403] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20251213 09:05:01.682067 17201 raft_consensus.cc:359] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.682173 17201 raft_consensus.cc:385] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.682204 17201 raft_consensus.cc:740] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.682308 17201 consensus_queue.cc:260] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.682884 16471 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet e84ebaac44df41368df8bafc582e55cc (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]) successfully deleted
I20251213 09:05:01.682967 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7d063b797ac74e9fbefa304a854dfba3" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:01.683060 16958 raft_consensus.cc:3060] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.683898 16958 raft_consensus.cc:2468] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:01.684032 17201 ts_tablet_manager.cc:1434] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:01.684285 17073 tablet_service.cc:1505] Processing CreateTablet for tablet bd00dd09b602490ea10b92795bbc2b82 (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.684522 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd00dd09b602490ea10b92795bbc2b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.684525 16800 tablet_service.cc:1505] Processing CreateTablet for tablet bd00dd09b602490ea10b92795bbc2b82 (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.684784 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd00dd09b602490ea10b92795bbc2b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.686641 17207 tablet_bootstrap.cc:492] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:01.686858 17202 tablet_bootstrap.cc:492] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:01.687682 17207 tablet_bootstrap.cc:654] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.687817 17202 tablet_bootstrap.cc:654] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.688591 16477 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]). Expected version 1 got 0
I20251213 09:05:01.688740 17484 consensus_queue.cc:1048] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.688839 17239 consensus_queue.cc:1048] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.690171 16938 tablet_service.cc:1505] Processing CreateTablet for tablet bd00dd09b602490ea10b92795bbc2b82 (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:01.690438 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd00dd09b602490ea10b92795bbc2b82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:01.692508 17201 tablet_bootstrap.cc:492] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:01.693522 17201 tablet_bootstrap.cc:654] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:01.695096 16477 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]). Expected version 1 got 0
I20251213 09:05:01.696151 17207 tablet_bootstrap.cc:492] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:01.696236 17207 ts_tablet_manager.cc:1403] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251213 09:05:01.696247 16477 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]). Expected version 1 got 0
I20251213 09:05:01.696647 17207 raft_consensus.cc:359] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.696733 17207 raft_consensus.cc:385] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.696763 17207 raft_consensus.cc:740] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.696870 17207 consensus_queue.cc:260] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.697220 17207 ts_tablet_manager.cc:1434] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:01.697206 16477 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51496:
name: "default.Table_be02832fc0574645929e026489c9e677"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:01.698386 17201 tablet_bootstrap.cc:492] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:01.698462 17201 ts_tablet_manager.cc:1403] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:01.698850 17201 raft_consensus.cc:359] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.698940 17201 raft_consensus.cc:385] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.698968 17201 raft_consensus.cc:740] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.699070 17201 consensus_queue.cc:260] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.699337 17201 ts_tablet_manager.cc:1434] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.700692 17202 tablet_bootstrap.cc:492] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:01.700785 17202 ts_tablet_manager.cc:1403] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251213 09:05:01.701284 17202 raft_consensus.cc:359] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.701695 17202 raft_consensus.cc:385] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:01.701665 17239 consensus_queue.cc:1048] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.701740 17202 raft_consensus.cc:740] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:01.701849 17202 consensus_queue.cc:260] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.702093 17202 ts_tablet_manager.cc:1434] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:01.702885 17250 raft_consensus.cc:493] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.702965 17250 raft_consensus.cc:515] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.703326 17250 leader_election.cc:290] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.703794 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37930409accc4a1eb5e31c095667f597" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.703909 16820 raft_consensus.cc:2468] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.704422 16891 leader_election.cc:304] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.704882 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37930409accc4a1eb5e31c095667f597" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.704994 17092 raft_consensus.cc:2468] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.707587 17250 raft_consensus.cc:2804] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.707648 17250 raft_consensus.cc:493] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.707687 17250 raft_consensus.cc:3060] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.708707 17250 raft_consensus.cc:515] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.708716 17393 consensus_queue.cc:1048] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.709035 17250 leader_election.cc:290] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.709698 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37930409accc4a1eb5e31c095667f597" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.709800 16821 raft_consensus.cc:3060] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.710701 16821 raft_consensus.cc:2468] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.711177 16891 leader_election.cc:304] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.711392 17206 raft_consensus.cc:2804] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.711426 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "37930409accc4a1eb5e31c095667f597" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.711462 17206 raft_consensus.cc:697] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:01.711520 17091 raft_consensus.cc:3060] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.711571 17206 consensus_queue.cc:237] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.712496 17091 raft_consensus.cc:2468] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.731405 17250 raft_consensus.cc:493] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.731597 17250 raft_consensus.cc:515] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.732110 17250 leader_election.cc:290] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.732649 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79d28675183f4fb1ad9a573cab3bba32" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.732702 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79d28675183f4fb1ad9a573cab3bba32" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.732817 16821 raft_consensus.cc:2468] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.732841 17091 raft_consensus.cc:2468] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.733177 16894 leader_election.cc:304] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.733384 17250 raft_consensus.cc:2804] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.733446 17250 raft_consensus.cc:493] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.733498 17250 raft_consensus.cc:3060] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.734197 17486 consensus_queue.cc:1048] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.734558 17250 raft_consensus.cc:515] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.734920 17250 leader_election.cc:290] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.735298 16479 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9]
I20251213 09:05:01.736241 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79d28675183f4fb1ad9a573cab3bba32" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.736372 16821 raft_consensus.cc:3060] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.737341 16821 raft_consensus.cc:2468] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.737630 16891 leader_election.cc:304] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.738051 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "79d28675183f4fb1ad9a573cab3bba32" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.738194 17091 raft_consensus.cc:3060] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.739048 17091 raft_consensus.cc:2468] T 79d28675183f4fb1ad9a573cab3bba32 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.739308 17250 raft_consensus.cc:2804] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.739413 17250 raft_consensus.cc:697] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:01.739589 17250 consensus_queue.cc:237] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.747457 17486 consensus_queue.cc:1048] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:01.764297 16212 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu with pid 16454
I20251213 09:05:01.777379 17253 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: recv got EOF from 127.15.213.62:42117 (error 108),
I20251213 09:05:01.779656 17253 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:05:01.780611 17146 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:01.780817 17146 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:01.781162 17146 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:01.781292 17146 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.62:42117)
W20251213 09:05:01.786481 17545 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:01.784271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.15.213.1:33997)
1213 09:05:01.785806 (+ 1535us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:01.785880 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":1449,"thread_start_us":68,"threads_started":1}
W20251213 09:05:01.787235 17544 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:01.783920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.15.213.2:58821)
1213 09:05:01.785418 (+ 1498us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:01.785482 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":1409,"thread_start_us":76,"threads_started":1}
W20251213 09:05:01.788379 17543 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:01.783031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.15.213.3:48419)
1213 09:05:01.787668 (+ 4637us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:01.787724 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":4551,"thread_start_us":167,"threads_started":1}
W20251213 09:05:01.788995 17541 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:01.782071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.0.0.1:51506)
1213 09:05:01.788189 (+ 6118us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:01.788291 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":6025,"thread_start_us":68,"threads_started":1}
I20251213 09:05:01.834151 17237 raft_consensus.cc:493] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.834280 17237 raft_consensus.cc:515] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.834721 17237 leader_election.cc:290] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.835150 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "466ce39a1a5d4037b9ce27eaba467266" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.835311 17092 raft_consensus.cc:2468] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.835356 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "466ce39a1a5d4037b9ce27eaba467266" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:01.835493 16821 raft_consensus.cc:2468] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:01.835798 16891 leader_election.cc:304] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.836035 17237 raft_consensus.cc:2804] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.836087 17237 raft_consensus.cc:493] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.836125 17237 raft_consensus.cc:3060] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.837057 17237 raft_consensus.cc:515] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.837412 17237 leader_election.cc:290] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.837733 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "466ce39a1a5d4037b9ce27eaba467266" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:01.837757 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "466ce39a1a5d4037b9ce27eaba467266" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.837850 16821 raft_consensus.cc:3060] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.837873 17092 raft_consensus.cc:3060] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.838668 16821 raft_consensus.cc:2468] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.838673 17092 raft_consensus.cc:2468] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:01.838963 16894 leader_election.cc:304] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.839167 17237 raft_consensus.cc:2804] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.839257 17237 raft_consensus.cc:697] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:01.839435 17237 consensus_queue.cc:237] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.922494 17486 raft_consensus.cc:493] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:01.922652 17486 raft_consensus.cc:515] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.923108 17486 leader_election.cc:290] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.923599 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd00dd09b602490ea10b92795bbc2b82" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:01.923605 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd00dd09b602490ea10b92795bbc2b82" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:01.923748 17092 raft_consensus.cc:2468] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:01.923751 16958 raft_consensus.cc:2468] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:01.924062 16757 leader_election.cc:304] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:01.924320 17486 raft_consensus.cc:2804] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:01.924383 17486 raft_consensus.cc:493] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:01.924439 17486 raft_consensus.cc:3060] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.925544 17486 raft_consensus.cc:515] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:01.925872 17486 leader_election.cc:290] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:01.926204 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd00dd09b602490ea10b92795bbc2b82" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:01.926203 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bd00dd09b602490ea10b92795bbc2b82" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:01.926331 16958 raft_consensus.cc:3060] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.926331 17092 raft_consensus.cc:3060] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:01.927222 17092 raft_consensus.cc:2468] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:01.927217 16958 raft_consensus.cc:2468] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:01.927486 16756 leader_election.cc:304] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:01.927634 17486 raft_consensus.cc:2804] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:01.927711 17486 raft_consensus.cc:697] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:01.927817 17486 consensus_queue.cc:237] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.011157 17237 consensus_queue.cc:1048] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.015887 17250 consensus_queue.cc:1048] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.118760 17250 consensus_queue.cc:1048] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.122866 17206 consensus_queue.cc:1048] T 79d28675183f4fb1ad9a573cab3bba32 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.170657 17239 consensus_queue.cc:1048] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.175830 17239 consensus_queue.cc:1048] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.177840 17554 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:02.178296 17554 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:02.179371 17554 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:02.179816 16613 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:02.181828 16613 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:02.184715 17306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7f61ccb4ffd4066babfa94938e28b87" candidate_term: 2 candidate_status { last_received { term: 1 index: 120 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" is_pre_election: true
I20251213 09:05:02.185279 16615 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:02.185510 17554 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251213 09:05:02.196519 17558 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:02.196663 17558 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:02.197819 17558 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:02.198465 17280 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:02.199327 17280 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:02.201313 16638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" candidate_term: 2 candidate_status { last_received { term: 1 index: 120 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87" is_pre_election: true
I20251213 09:05:02.201437 16638 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ef4ffe02ab44248dc97cb1c5cceac1 in term 1.
I20251213 09:05:02.201857 17283 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982
I20251213 09:05:02.202045 17558 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251213 09:05:02.202113 17558 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:02.202142 17558 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 1 FOLLOWER]: Advancing to term 2
I20251213 09:05:02.203766 17558 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:02.204082 17558 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 2 election: Requested vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:02.204442 16638 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" candidate_term: 2 candidate_status { last_received { term: 1 index: 120 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87"
I20251213 09:05:02.204557 16638 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 1 FOLLOWER]: Advancing to term 2
W20251213 09:05:02.204985 17280 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:02.205509 16638 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ef4ffe02ab44248dc97cb1c5cceac1 in term 2.
I20251213 09:05:02.205749 17283 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982
I20251213 09:05:02.205919 17558 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 2 FOLLOWER]: Leader election won for term 2
I20251213 09:05:02.206061 17558 raft_consensus.cc:697] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 2 LEADER]: Becoming Leader. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Running, Role: LEADER
I20251213 09:05:02.206315 17558 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 120, Committed index: 120, Last appended: 1.120, Last appended by leader: 120, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:02.207234 17563 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ef4ffe02ab44248dc97cb1c5cceac1. Latest consensus state: current_term: 2 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:02.207337 17563 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:02.207639 17564 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:05:02.209803 17564 catalog_manager.cc:679] Loaded metadata for table default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:02.210089 17564 catalog_manager.cc:679] Loaded metadata for table default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9]
I20251213 09:05:02.210389 17564 catalog_manager.cc:679] Loaded metadata for table default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3]
I20251213 09:05:02.210572 17564 catalog_manager.cc:679] Loaded metadata for table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:02.210798 17564 catalog_manager.cc:679] Loaded metadata for table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]
I20251213 09:05:02.211097 17564 catalog_manager.cc:679] Loaded metadata for table default.table_8931d18ab40348878fba01c709567310 [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:02.211344 17564 catalog_manager.cc:679] Loaded metadata for table default.table_202ae634c0504cf88ed2d25c49b0d397 [id=4ec61addd21c4307bce7a9891a6983ee]
I20251213 09:05:02.211555 17564 catalog_manager.cc:679] Loaded metadata for table default.table_1b2da3534d4d457a886358d9b231dea8 [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:05:02.211773 17564 catalog_manager.cc:679] Loaded metadata for table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:05:02.212002 17564 catalog_manager.cc:679] Loaded metadata for table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]
I20251213 09:05:02.212189 17564 catalog_manager.cc:679] Loaded metadata for table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:02.212421 17564 catalog_manager.cc:679] Loaded metadata for table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]
I20251213 09:05:02.212662 17564 catalog_manager.cc:679] Loaded metadata for table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]
I20251213 09:05:02.213019 17564 catalog_manager.cc:679] Loaded metadata for table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:02.213243 17564 catalog_manager.cc:679] Loaded metadata for table default.table_233a6a0146384e14bd0d8ff512419278 [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:02.213460 17564 catalog_manager.cc:679] Loaded metadata for table default.table_73d8d94f56c44d66a429e84fbe602baa [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:02.213677 17564 catalog_manager.cc:679] Loaded metadata for table default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f]
I20251213 09:05:02.213996 17564 catalog_manager.cc:679] Loaded metadata for table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]
I20251213 09:05:02.216006 17564 tablet_loader.cc:96] loaded metadata for tablet 0e15d3e0580943cfa60041729f1bff62 (table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074])
I20251213 09:05:02.216214 17564 tablet_loader.cc:96] loaded metadata for tablet 10339e3d2aef482580748a80f247d57f (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8])
I20251213 09:05:02.216383 17564 tablet_loader.cc:96] loaded metadata for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb])
I20251213 09:05:02.216549 17564 tablet_loader.cc:96] loaded metadata for tablet 41c1a0b4450842fda55296abeea8dfae (table default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f])
I20251213 09:05:02.216823 17564 tablet_loader.cc:96] loaded metadata for tablet 466ce39a1a5d4037b9ce27eaba467266 (table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9])
I20251213 09:05:02.217067 17564 tablet_loader.cc:96] loaded metadata for tablet 5c6e18d23d374b7faecc78db155aaa2c (table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df])
I20251213 09:05:02.217453 17564 tablet_loader.cc:96] loaded metadata for tablet 7751d6a8df064e9bbafee2c6310cf456 (table default.table_233a6a0146384e14bd0d8ff512419278 [id=e5096b86f1244b13ad349eb23d8a0c07])
I20251213 09:05:02.217633 17564 tablet_loader.cc:96] loaded metadata for tablet 7876a7d15b0e438ebb7f6224794a6e46 (table default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3])
I20251213 09:05:02.217808 17564 tablet_loader.cc:96] loaded metadata for tablet 79d28675183f4fb1ad9a573cab3bba32 (table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a])
I20251213 09:05:02.217983 17564 tablet_loader.cc:96] loaded metadata for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_d884ba72f14242f19c59cb34de4b7f36 [id=73b5f4e0be40400a98d4a95538a99e1c])
I20251213 09:05:02.218286 17564 tablet_loader.cc:96] loaded metadata for tablet 8a9c4e8b224d440dbab9d693bbba9e37 (table default.table_8931d18ab40348878fba01c709567310 [id=497850be5e0c40179bfa90c0c0d6f4ce])
I20251213 09:05:02.218600 17564 tablet_loader.cc:96] loaded metadata for tablet a0514913a4ce4b54bd78e53b11814912 (table default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d])
I20251213 09:05:02.218976 17564 tablet_loader.cc:96] loaded metadata for tablet bd00dd09b602490ea10b92795bbc2b82 (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1])
I20251213 09:05:02.219178 17564 tablet_loader.cc:96] loaded metadata for tablet bd2a866a05cc4ecba3394d4ca38e9f7c (table default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9])
I20251213 09:05:02.219343 17564 tablet_loader.cc:96] loaded metadata for tablet c5adcb68c5b9438da10370479acbed52 (table default.table_73d8d94f56c44d66a429e84fbe602baa [id=e9b9d5d3630e485c8177b62bf7cbc8ba])
I20251213 09:05:02.219533 17564 tablet_loader.cc:96] loaded metadata for tablet c8276392af2740258e804f72f7529d16 (table default.table_1b2da3534d4d457a886358d9b231dea8 [id=57463d6c4bc24d45ab54ddf180a102cd])
I20251213 09:05:02.220142 17564 tablet_loader.cc:96] loaded metadata for tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68])
I20251213 09:05:02.220316 17564 tablet_loader.cc:96] loaded metadata for tablet fb68b603c201419491b09993080789b5 (table default.table_202ae634c0504cf88ed2d25c49b0d397 [id=4ec61addd21c4307bce7a9891a6983ee])
I20251213 09:05:02.220432 17564 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:05:02.221177 17564 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:02.221220 17564 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:05:02.222268 17564 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:05:02.222879 17564 catalog_manager.cc:6038] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Loaded TSK: 0
I20251213 09:05:02.223582 17564 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:05:02.224264 17564 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:05:02.224876 17564 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 36
I20251213 09:05:02.249212 17293 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_233a6a0146384e14bd0d8ff512419278" } new_table_name: "default.Table_59d286f920344321bc3617bef4c8f32a" modify_external_catalogs: true
I20251213 09:05:02.249295 17292 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_e15a5e101cf24bec9b2ecc545598c4b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.249863 17291 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_3bdf6aed0ee54ebb8b7bf14c832ceae6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.249950 17294 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_430d04b174a84f139dae2021743273d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.250165 17290 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_2c647fd17c384b5a81ffdb84f9d5dc8e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.250411 17289 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_2d8ae593f178467881752483962712b3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.250689 17288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_724fda2f787b4496b3133ceb99be2012"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.250828 17287 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_cfed201f26564767a4a57c58382df9b9" } modify_external_catalogs: true
I20251213 09:05:02.250867 17295 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_be02832fc0574645929e026489c9e677"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.250926 17287 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_cfed201f26564767a4a57c58382df9b9" } modify_external_catalogs: true
I20251213 09:05:02.250708 17296 master_service.cc:954] ReplaceTablet: received request to replace tablet e84ebaac44df41368df8bafc582e55cc from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:02.251612 17296 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_e03af1234dba427a8cdc24fb76d12515" } modify_external_catalogs: true
I20251213 09:05:02.251715 17296 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_e03af1234dba427a8cdc24fb76d12515" } modify_external_catalogs: true
I20251213 09:05:02.254617 17358 catalog_manager.cc:2772] Deleting table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68] in response to Hive Metastore notification log event 37
I20251213 09:05:02.258417 16638 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Refusing update from remote peer f0ef4ffe02ab44248dc97cb1c5cceac1: Log matching property violated. Preceding OpId in replica: term: 1 index: 120. Preceding OpId from leader: term: 2 index: 122. (index mismatch)
W20251213 09:05:02.258801 17280 consensus_peers.cc:597] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 -> Peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Couldn't send request to peer 8fe04e8d31ac4cd9bca8f96335ff1982. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:02.258910 17563 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 121, Last known committed idx: 120, Time since last communication: 0.000s
I20251213 09:05:02.260247 17554 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ef4ffe02ab44248dc97cb1c5cceac1. Latest consensus state: current_term: 2 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:02.260362 17554 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:02.261404 17558 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:02.261511 17558 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:02.261927 17358 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet f44dbd7d563346f58c3e04e5224bfe5e
I20251213 09:05:02.261953 17554 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:02.262038 17554 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:02.263855 17358 catalog_manager.cc:2772] Deleting table default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9] in response to Hive Metastore notification log event 38
I20251213 09:05:02.267429 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet f44dbd7d563346f58c3e04e5224bfe5e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:02.267752 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet f44dbd7d563346f58c3e04e5224bfe5e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:02.267787 17573 tablet_replica.cc:333] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:02.268029 17574 tablet_replica.cc:333] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:02.268205 17574 raft_consensus.cc:2243] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:02.268445 17574 raft_consensus.cc:2272] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.268662 17358 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet bd2a866a05cc4ecba3394d4ca38e9f7c
I20251213 09:05:02.269028 17574 ts_tablet_manager.cc:1916] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.269160 17573 raft_consensus.cc:2243] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:02.269208 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet bd2a866a05cc4ecba3394d4ca38e9f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:02.269248 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet bd2a866a05cc4ecba3394d4ca38e9f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:02.269325 17573 raft_consensus.cc:2272] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.269827 17573 ts_tablet_manager.cc:1916] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.271488 17574 ts_tablet_manager.cc:1929] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:02.271608 17574 log.cc:1199] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/f44dbd7d563346f58c3e04e5224bfe5e
I20251213 09:05:02.271950 17574 ts_tablet_manager.cc:1950] T f44dbd7d563346f58c3e04e5224bfe5e P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:02.272238 17573 ts_tablet_manager.cc:1929] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:02.272629 17574 tablet_replica.cc:333] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:02.272696 17573 log.cc:1199] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/f44dbd7d563346f58c3e04e5224bfe5e
I20251213 09:05:02.272769 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:05:02.272809 17574 raft_consensus.cc:2243] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:02.272919 17574 raft_consensus.cc:2272] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.273342 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet f44dbd7d563346f58c3e04e5224bfe5e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:02.273379 17573 ts_tablet_manager.cc:1950] T f44dbd7d563346f58c3e04e5224bfe5e P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:02.273343 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet bd2a866a05cc4ecba3394d4ca38e9f7c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:02.273789 17575 tablet_replica.cc:333] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:02.274075 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:05:02.273814 17574 ts_tablet_manager.cc:1916] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.274369 17573 tablet_replica.cc:333] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:02.274457 17575 raft_consensus.cc:2243] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:02.274590 17573 raft_consensus.cc:2243] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:02.274605 17575 raft_consensus.cc:2272] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.274740 17573 raft_consensus.cc:2272] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.275144 17575 ts_tablet_manager.cc:1916] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.275393 17573 ts_tablet_manager.cc:1916] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.276281 17574 ts_tablet_manager.cc:1929] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:02.276376 17574 log.cc:1199] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/bd2a866a05cc4ecba3394d4ca38e9f7c
W20251213 09:05:02.276794 17358 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7d063b797ac74e9fbefa304a854dfba3 consensus state has no leader
I20251213 09:05:02.276999 17574 ts_tablet_manager.cc:1950] T bd2a866a05cc4ecba3394d4ca38e9f7c P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:02.277558 17573 ts_tablet_manager.cc:1929] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:02.277696 17573 log.cc:1199] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/bd2a866a05cc4ecba3394d4ca38e9f7c
I20251213 09:05:02.277976 17573 ts_tablet_manager.cc:1950] T bd2a866a05cc4ecba3394d4ca38e9f7c P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:02.278297 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet bd2a866a05cc4ecba3394d4ca38e9f7c (table default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9]) successfully deleted
W20251213 09:05:02.278556 17292 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e15a5e101cf24bec9b2ecc545598c4b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:02.278565 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet bd2a866a05cc4ecba3394d4ca38e9f7c (table default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9]) successfully deleted
I20251213 09:05:02.279726 17575 ts_tablet_manager.cc:1929] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:02.279798 17575 log.cc:1199] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/f44dbd7d563346f58c3e04e5224bfe5e
I20251213 09:05:02.280023 17575 ts_tablet_manager.cc:1950] T f44dbd7d563346f58c3e04e5224bfe5e P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:02.280619 17575 tablet_replica.cc:333] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:02.280714 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet f44dbd7d563346f58c3e04e5224bfe5e (table default.table_924224088c604b9682478db9e1bbe741 [id=b710aa4328c74aa3a83cb63bb8a55a68]) successfully deleted
I20251213 09:05:02.280755 17575 raft_consensus.cc:2243] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:02.280934 17575 raft_consensus.cc:2272] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.281387 17575 ts_tablet_manager.cc:1916] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.282987 17575 ts_tablet_manager.cc:1929] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:02.283056 17575 log.cc:1199] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/bd2a866a05cc4ecba3394d4ca38e9f7c
I20251213 09:05:02.283313 17575 ts_tablet_manager.cc:1950] T bd2a866a05cc4ecba3394d4ca38e9f7c P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:02.283978 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet bd2a866a05cc4ecba3394d4ca38e9f7c (table default.table_00ca8030ef8d48088f07fb15e26d5bac [id=09f2d1a73e5841968a7b93bf4f07c5f9]) successfully deleted
I20251213 09:05:02.292223 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.62:42117
--webserver_interface=127.15.213.62
--webserver_port=43541
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251213 09:05:02.308929 17281 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7d063b797ac74e9fbefa304a854dfba3 consensus state has no leader
I20251213 09:05:02.321693 17206 consensus_queue.cc:1048] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.328447 17206 consensus_queue.cc:1048] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.336607 17237 consensus_queue.cc:1048] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.342059 17206 consensus_queue.cc:1048] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.356513 17293 catalog_manager.cc:3485] renamed table default.table_233a6a0146384e14bd0d8ff512419278 [id=e5096b86f1244b13ad349eb23d8a0c07] in HMS: new name default.table_59d286f920344321bc3617bef4c8f32a
I20251213 09:05:02.389668 17292 catalog_manager.cc:2174] created HMS catalog entry for table [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]
W20251213 09:05:02.395690 17291 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:02.396416 17294 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_430d04b174a84f139dae2021743273d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:02.397046 17290 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:02.397646 17289 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2d8ae593f178467881752483962712b3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:02.398306 17288 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_724fda2f787b4496b3133ceb99be2012 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:02.398936 17295 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_be02832fc0574645929e026489c9e677 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:02.399855 16870 heartbeater.cc:499] Master 127.15.213.61:38171 was elected leader, sending a full tablet report...
I20251213 09:05:02.402276 17292 catalog_manager.cc:5654] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } }
I20251213 09:05:02.403514 16938 tablet_service.cc:1505] Processing CreateTablet for tablet c5dfe56534c5486a868b4d28aa494d0b (DEFAULT_TABLE table=default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.403801 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5dfe56534c5486a868b4d28aa494d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.406515 16800 tablet_service.cc:1505] Processing CreateTablet for tablet c5dfe56534c5486a868b4d28aa494d0b (DEFAULT_TABLE table=default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.406821 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5dfe56534c5486a868b4d28aa494d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.407119 17072 tablet_service.cc:1505] Processing CreateTablet for tablet c5dfe56534c5486a868b4d28aa494d0b (DEFAULT_TABLE table=default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.407408 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5dfe56534c5486a868b4d28aa494d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.413168 17141 heartbeater.cc:499] Master 127.15.213.61:38171 was elected leader, sending a full tablet report...
I20251213 09:05:02.414027 17006 heartbeater.cc:499] Master 127.15.213.61:38171 was elected leader, sending a full tablet report...
I20251213 09:05:02.414487 17582 tablet_bootstrap.cc:492] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:02.415895 17582 tablet_bootstrap.cc:654] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.415516 17292 catalog_manager.cc:5654] T 79d28675183f4fb1ad9a573cab3bba32 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } }
I20251213 09:05:02.417606 17292 catalog_manager.cc:5654] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } }
I20251213 09:05:02.417748 17292 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]). Expected version 1 got 0
I20251213 09:05:02.418128 17292 catalog_manager.cc:5654] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:02.417457 17583 tablet_bootstrap.cc:492] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:02.418454 17292 catalog_manager.cc:5654] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } }
I20251213 09:05:02.419387 17292 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 2 got 0
I20251213 09:05:02.419914 17584 tablet_bootstrap.cc:492] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:02.420264 17583 tablet_bootstrap.cc:654] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.421264 17584 tablet_bootstrap.cc:654] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.427762 17582 tablet_bootstrap.cc:492] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:02.427924 17582 ts_tablet_manager.cc:1403] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20251213 09:05:02.428479 17582 raft_consensus.cc:359] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.428714 17582 raft_consensus.cc:385] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.428798 17582 raft_consensus.cc:740] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.429028 17582 consensus_queue.cc:260] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.429641 17582 ts_tablet_manager.cc:1434] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:02.430330 17293 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 2 got 0
I20251213 09:05:02.430477 17293 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 7751d6a8df064e9bbafee2c6310cf456 (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]). Expected version 1 got 0
I20251213 09:05:02.430616 17293 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]). Expected version 1 got 0
I20251213 09:05:02.433727 17584 tablet_bootstrap.cc:492] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:02.433871 17584 ts_tablet_manager.cc:1403] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251213 09:05:02.434422 17584 raft_consensus.cc:359] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.434592 17584 raft_consensus.cc:385] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.434669 17584 raft_consensus.cc:740] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.434849 17584 consensus_queue.cc:260] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.435322 17584 ts_tablet_manager.cc:1434] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.435854 17292 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]). Expected version 2 got 0
I20251213 09:05:02.436007 17292 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 7751d6a8df064e9bbafee2c6310cf456 (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]). Expected version 1 got 0
I20251213 09:05:02.437179 17293 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_1eb38c19e2ee4d43bce7ee0f6617f5d6" } modify_external_catalogs: true
I20251213 09:05:02.437318 17293 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_1eb38c19e2ee4d43bce7ee0f6617f5d6" } modify_external_catalogs: true
I20251213 09:05:02.437605 17292 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]). Expected version 1 got 0
I20251213 09:05:02.427696 17486 consensus_queue.cc:1048] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.442472 17292 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]). Expected version 1 got 0
I20251213 09:05:02.447311 17593 tablet.cc:1722] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:02.450063 17292 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_432a26ea35484c14b07c89f682c923e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.454792 17594 tablet.cc:1722] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:02.455796 17593 tablet.cc:1722] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:02.456286 17599 tablet.cc:1722] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:02.456722 17598 tablet.cc:1722] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:02.457032 17583 tablet_bootstrap.cc:492] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:02.457208 17583 ts_tablet_manager.cc:1403] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20251213 09:05:02.457791 17583 raft_consensus.cc:359] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.457979 17583 raft_consensus.cc:385] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.458072 17583 raft_consensus.cc:740] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.458273 17291 catalog_manager.cc:2174] created HMS catalog entry for table [id=b1729dc398c84d178ffc92c632fdc08d]
I20251213 09:05:02.459043 17583 consensus_queue.cc:260] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.462152 17583 ts_tablet_manager.cc:1434] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20251213 09:05:02.471424 17599 tablet.cc:1722] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251213 09:05:02.481531 17577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:05:02.481863 17577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:05:02.481936 17577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20251213 09:05:02.482143 17484 consensus_queue.cc:1048] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.486020 17594 tablet.cc:1722] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20251213 09:05:02.490144 17577 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20251213 09:05:02.490123 17599 tablet.cc:1722] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20251213 09:05:02.490216 17577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:05:02.490247 17577 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:05:02.490276 17577 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:05:02.490231 17593 tablet.cc:1722] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251213 09:05:02.493037 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 1391d28e1e4046b4af9f0b06ae539c0d (DEFAULT_TABLE table=default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.493340 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1391d28e1e4046b4af9f0b06ae539c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.493288 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 1391d28e1e4046b4af9f0b06ae539c0d (DEFAULT_TABLE table=default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.493546 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1391d28e1e4046b4af9f0b06ae539c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.494242 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 1391d28e1e4046b4af9f0b06ae539c0d (DEFAULT_TABLE table=default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.494532 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1391d28e1e4046b4af9f0b06ae539c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.495226 17393 raft_consensus.cc:493] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:02.495321 17393 raft_consensus.cc:515] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.495750 17393 leader_election.cc:290] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:02.495824 17584 tablet_bootstrap.cc:492] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:02.496161 17291 catalog_manager.cc:6199] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07] alter complete (version 1)
I20251213 09:05:02.496269 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5dfe56534c5486a868b4d28aa494d0b" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:02.496383 17091 raft_consensus.cc:2468] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:02.496786 17584 tablet_bootstrap.cc:654] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.496886 16757 leader_election.cc:304] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:02.497052 17583 tablet_bootstrap.cc:492] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:02.497438 17582 tablet_bootstrap.cc:492] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:02.498107 17583 tablet_bootstrap.cc:654] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.498143 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5dfe56534c5486a868b4d28aa494d0b" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:02.498272 16958 raft_consensus.cc:2468] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:02.497056 17393 raft_consensus.cc:2804] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:02.498463 17393 raft_consensus.cc:493] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:02.498503 17393 raft_consensus.cc:3060] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.498517 17582 tablet_bootstrap.cc:654] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.499756 17291 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_731dc67a6a2b407180abef538691c40c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.501575 17393 raft_consensus.cc:515] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.501960 17393 leader_election.cc:290] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:02.503185 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5dfe56534c5486a868b4d28aa494d0b" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:02.503324 17091 raft_consensus.cc:3060] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.504305 17091 raft_consensus.cc:2468] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:02.504652 16757 leader_election.cc:304] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:02.504659 17577 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.62:42117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.213.62
--webserver_port=43541
--never_fsync=true
--heap_profile_path=/tmp/kudu.17577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:05:02.505573 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c5dfe56534c5486a868b4d28aa494d0b" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:02.505694 16958 raft_consensus.cc:3060] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.506138 17577 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:05:02.506618 16958 raft_consensus.cc:2468] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:02.507134 17393 raft_consensus.cc:2804] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:02.507251 17393 raft_consensus.cc:697] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:02.507398 17393 consensus_queue.cc:237] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:02.507601 17577 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251213 09:05:02.511617 17583 tablet_bootstrap.cc:492] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:02.511723 17583 ts_tablet_manager.cc:1403] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20251213 09:05:02.512245 17583 raft_consensus.cc:359] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.512351 17583 raft_consensus.cc:385] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.512388 17583 raft_consensus.cc:740] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.512512 17583 consensus_queue.cc:260] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.512804 17583 ts_tablet_manager.cc:1434] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20251213 09:05:02.514411 17612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:02.515188 17582 tablet_bootstrap.cc:492] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
W20251213 09:05:02.515246 17610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:02.515304 17582 ts_tablet_manager.cc:1403] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
W20251213 09:05:02.515422 17609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:02.515807 17582 raft_consensus.cc:359] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.515905 17582 raft_consensus.cc:385] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.515936 17582 raft_consensus.cc:740] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.516060 17582 consensus_queue.cc:260] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.516187 17577 server_base.cc:1047] running on GCE node
I20251213 09:05:02.516343 17582 ts_tablet_manager.cc:1434] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.516798 17577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:05:02.517880 17577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:05:02.518494 17584 tablet_bootstrap.cc:492] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:02.518589 17584 ts_tablet_manager.cc:1403] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20251213 09:05:02.519043 17584 raft_consensus.cc:359] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.519166 17584 raft_consensus.cc:385] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.519202 17584 raft_consensus.cc:740] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.519320 17584 consensus_queue.cc:260] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.519577 17584 ts_tablet_manager.cc:1434] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.522783 17577 hybrid_clock.cc:648] HybridClock initialized: now 1765616702522756 us; error 39 us; skew 500 ppm
I20251213 09:05:02.524910 17577 webserver.cc:492] Webserver started at http://127.15.213.62:43541/ using document root <none> and password file <none>
I20251213 09:05:02.525574 17577 fs_manager.cc:362] Metadata directory not provided
I20251213 09:05:02.525643 17577 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:05:02.529675 17577 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20251213 09:05:02.532027 17618 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:05:02.533257 17577 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:02.533365 17577 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
uuid: "8fe04e8d31ac4cd9bca8f96335ff1982"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:05:02.533797 17577 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:05:02.537009 17294 catalog_manager.cc:2174] created HMS catalog entry for table [id=f49de92593644a14a779b22e01e511dd]
I20251213 09:05:02.552567 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 95c05f1a7c9a4448bd1e171090009768 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.552891 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c05f1a7c9a4448bd1e171090009768. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.553467 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 95c05f1a7c9a4448bd1e171090009768 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.553581 17294 catalog_manager.cc:6199] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c] alter complete (version 2)
I20251213 09:05:02.553748 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c05f1a7c9a4448bd1e171090009768. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.553722 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 95c05f1a7c9a4448bd1e171090009768 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.553961 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c05f1a7c9a4448bd1e171090009768. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.555234 17582 tablet_bootstrap.cc:492] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:02.556017 17583 tablet_bootstrap.cc:492] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:02.556017 17584 tablet_bootstrap.cc:492] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:02.556273 17582 tablet_bootstrap.cc:654] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.557168 17583 tablet_bootstrap.cc:654] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.557168 17584 tablet_bootstrap.cc:654] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.559073 17294 catalog_manager.cc:5654] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:02.563812 17583 tablet_bootstrap.cc:492] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:02.563911 17583 ts_tablet_manager.cc:1403] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251213 09:05:02.564379 17583 raft_consensus.cc:359] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.564494 17583 raft_consensus.cc:385] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.564527 17583 raft_consensus.cc:740] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.564664 17583 consensus_queue.cc:260] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.564914 17583 ts_tablet_manager.cc:1434] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:02.570027 17584 tablet_bootstrap.cc:492] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:02.570137 17584 ts_tablet_manager.cc:1403] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251213 09:05:02.570622 17584 raft_consensus.cc:359] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.570608 17294 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_0bc46ad17b194fbf831fab656bf97fd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:02.570726 17584 raft_consensus.cc:385] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.570762 17584 raft_consensus.cc:740] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.570884 17584 consensus_queue.cc:260] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.571537 17582 tablet_bootstrap.cc:492] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:02.571641 17582 ts_tablet_manager.cc:1403] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20251213 09:05:02.572191 17582 raft_consensus.cc:359] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.572309 17582 raft_consensus.cc:385] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.572350 17582 raft_consensus.cc:740] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.572467 17584 ts_tablet_manager.cc:1434] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:02.572466 17582 consensus_queue.cc:260] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.572731 17582 ts_tablet_manager.cc:1434] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251213 09:05:02.586202 17484 raft_consensus.cc:493] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:02.586341 17484 raft_consensus.cc:515] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.586787 17484 leader_election.cc:290] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:02.587714 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1391d28e1e4046b4af9f0b06ae539c0d" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:02.587867 16958 raft_consensus.cc:2468] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:02.588150 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1391d28e1e4046b4af9f0b06ae539c0d" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:02.588320 17091 raft_consensus.cc:2468] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:02.588683 16757 leader_election.cc:304] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:02.588847 17484 raft_consensus.cc:2804] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:02.588897 17484 raft_consensus.cc:493] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:02.588940 17484 raft_consensus.cc:3060] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.589968 17484 raft_consensus.cc:515] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.590291 17484 leader_election.cc:290] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:02.591046 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1391d28e1e4046b4af9f0b06ae539c0d" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:02.591169 17091 raft_consensus.cc:3060] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.592137 17091 raft_consensus.cc:2468] T 1391d28e1e4046b4af9f0b06ae539c0d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:02.592422 16757 leader_election.cc:304] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:02.592667 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1391d28e1e4046b4af9f0b06ae539c0d" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:02.592782 16958 raft_consensus.cc:3060] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.593713 16958 raft_consensus.cc:2468] T 1391d28e1e4046b4af9f0b06ae539c0d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:02.594117 17484 raft_consensus.cc:2804] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:02.594218 17484 raft_consensus.cc:697] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:02.594359 17484 consensus_queue.cc:237] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.607750 17577 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:05:02.608541 17577 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:05:02.608810 17577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:05:02.612917 17287 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]
I20251213 09:05:02.617300 17577 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.62:42117
I20251213 09:05:02.618772 17577 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
I20251213 09:05:02.619047 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 17577
I20251213 09:05:02.620620 17675 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.62:42117 every 8 connection(s)
I20251213 09:05:02.626225 17677 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:05:02.631860 17677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap starting.
I20251213 09:05:02.634853 17290 catalog_manager.cc:2174] created HMS catalog entry for table [id=a6e855d0c53c4082922304bfbecd3cfb]
I20251213 09:05:02.641393 17290 catalog_manager.cc:5654] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:02.654408 17005 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:02.654408 16594 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: OK, instance_id { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" instance_seqno: 1765616702615089 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20251213 09:05:02.654561 16594 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:02.656047 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 5c38f6e874044009a4656efa5dddd9a7 (DEFAULT_TABLE table=default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.656064 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 5c38f6e874044009a4656efa5dddd9a7 (DEFAULT_TABLE table=default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.656057 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 5c38f6e874044009a4656efa5dddd9a7 (DEFAULT_TABLE table=default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.656327 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c38f6e874044009a4656efa5dddd9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.656327 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c38f6e874044009a4656efa5dddd9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.656335 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c38f6e874044009a4656efa5dddd9a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.658478 17583 tablet_bootstrap.cc:492] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:02.658538 17584 tablet_bootstrap.cc:492] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:02.659539 17583 tablet_bootstrap.cc:654] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.659590 17584 tablet_bootstrap.cc:654] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.660269 17582 tablet_bootstrap.cc:492] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:02.660689 17677 log.cc:826] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Log is configured to *not* fsync() on all Append() calls
I20251213 09:05:02.661461 17582 tablet_bootstrap.cc:654] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.661593 17584 tablet_bootstrap.cc:492] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:02.661680 17584 ts_tablet_manager.cc:1403] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:02.662185 17584 raft_consensus.cc:359] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.662302 17584 raft_consensus.cc:385] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.662345 17584 raft_consensus.cc:740] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.662472 17584 consensus_queue.cc:260] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.662456 17290 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_d884ba72f14242f19c59cb34de4b7f36" } new_table_name: "default.Table_bd51adb8915743138d7a842893d52f60" modify_external_catalogs: true
I20251213 09:05:02.662757 17584 ts_tablet_manager.cc:1434] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.667884 17582 tablet_bootstrap.cc:492] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:02.667979 17582 ts_tablet_manager.cc:1403] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251213 09:05:02.668547 17582 raft_consensus.cc:359] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.668658 17582 raft_consensus.cc:385] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.668699 17582 raft_consensus.cc:740] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.668895 17140 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:02.668820 17582 consensus_queue.cc:260] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.670980 17582 ts_tablet_manager.cc:1434] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:02.671955 17583 tablet_bootstrap.cc:492] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:02.672053 17583 ts_tablet_manager.cc:1403] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251213 09:05:02.672506 17583 raft_consensus.cc:359] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.672603 17583 raft_consensus.cc:385] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.672639 17583 raft_consensus.cc:740] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.672780 17583 consensus_queue.cc:260] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.673058 17583 ts_tablet_manager.cc:1434] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.679903 16869 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:02.713475 17289 catalog_manager.cc:2174] created HMS catalog entry for table [id=6d12506ceb06414dbd055e0a048c1907]
I20251213 09:05:02.732504 17526 raft_consensus.cc:493] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:02.732631 17526 raft_consensus.cc:515] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.733084 17526 leader_election.cc:290] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:02.733246 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 4a86f3d6176a4a4681c0fb31649e0eab (DEFAULT_TABLE table=default.table_2d8ae593f178467881752483962712b3 [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.733574 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a86f3d6176a4a4681c0fb31649e0eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.733551 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 4a86f3d6176a4a4681c0fb31649e0eab (DEFAULT_TABLE table=default.table_2d8ae593f178467881752483962712b3 [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.733604 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 4a86f3d6176a4a4681c0fb31649e0eab (DEFAULT_TABLE table=default.table_2d8ae593f178467881752483962712b3 [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.733827 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a86f3d6176a4a4681c0fb31649e0eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.733827 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a86f3d6176a4a4681c0fb31649e0eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.736105 17582 tablet_bootstrap.cc:492] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:02.736230 17584 tablet_bootstrap.cc:492] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:02.737267 17582 tablet_bootstrap.cc:654] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.737265 17584 tablet_bootstrap.cc:654] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.737911 17583 tablet_bootstrap.cc:492] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:02.738909 17583 tablet_bootstrap.cc:654] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.739719 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c05f1a7c9a4448bd1e171090009768" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:02.739856 16958 raft_consensus.cc:2468] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:02.741940 17028 leader_election.cc:304] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:02.742758 17526 raft_consensus.cc:2804] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:02.742844 17526 raft_consensus.cc:493] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:02.742813 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c05f1a7c9a4448bd1e171090009768" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:02.742887 17526 raft_consensus.cc:3060] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.742934 16820 raft_consensus.cc:2468] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:02.743959 17526 raft_consensus.cc:515] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.744385 17526 leader_election.cc:290] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:02.744552 17289 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_d6d6d9a459ff460f97765707846c32ea" } new_table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" modify_external_catalogs: true
I20251213 09:05:02.744987 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c05f1a7c9a4448bd1e171090009768" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:02.745092 16820 raft_consensus.cc:3060] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.745507 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c05f1a7c9a4448bd1e171090009768" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:02.745633 16958 raft_consensus.cc:3060] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.746055 16820 raft_consensus.cc:2468] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:02.746479 17026 leader_election.cc:304] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:02.746644 16958 raft_consensus.cc:2468] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:02.746848 17209 raft_consensus.cc:2804] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:02.746930 17209 raft_consensus.cc:697] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:02.747057 17209 consensus_queue.cc:237] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.753146 17583 tablet_bootstrap.cc:492] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:02.753274 17583 ts_tablet_manager.cc:1403] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20251213 09:05:02.753822 17583 raft_consensus.cc:359] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.753940 17583 raft_consensus.cc:385] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.753979 17583 raft_consensus.cc:740] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.754112 17583 consensus_queue.cc:260] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.754469 17583 ts_tablet_manager.cc:1434] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:02.755210 17582 tablet_bootstrap.cc:492] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:02.755306 17582 ts_tablet_manager.cc:1403] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251213 09:05:02.755749 17677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap replayed 1/1 log segments. Stats: ops{read=120 overwritten=0 applied=120 ignored=0} inserts{seen=78 ignored=0} mutations{seen=98 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251213 09:05:02.755805 17582 raft_consensus.cc:359] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.755906 17582 raft_consensus.cc:385] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.755937 17582 raft_consensus.cc:740] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.756049 17582 consensus_queue.cc:260] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.756165 17677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap complete.
I20251213 09:05:02.756314 17582 ts_tablet_manager.cc:1434] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.761628 17677 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:02.761972 17677 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe04e8d31ac4cd9bca8f96335ff1982, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.762763 17677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 120, Last appended: 1.120, Last appended by leader: 120, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:02.763896 17690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:02.763998 17677 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:05:02.764088 17690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:02.770200 17641 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 1 FOLLOWER]: Advancing to term 2
I20251213 09:05:02.771662 17704 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:02.771713 17704 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: loading cluster ID for follower catalog manager: success
I20251213 09:05:02.771939 17584 tablet_bootstrap.cc:492] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:02.772045 17584 ts_tablet_manager.cc:1403] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20251213 09:05:02.772589 17584 raft_consensus.cc:359] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.772689 17584 raft_consensus.cc:385] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.772722 17584 raft_consensus.cc:740] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.772902 17584 consensus_queue.cc:260] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.773216 17584 ts_tablet_manager.cc:1434] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.775240 17704 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: acquiring CA information for follower catalog manager: success
I20251213 09:05:02.777199 17690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ef4ffe02ab44248dc97cb1c5cceac1. Latest consensus state: current_term: 2 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:02.777307 17690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:02.777245 17638 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:36239; Asking this server to re-register.
I20251213 09:05:02.777396 17690 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:02.777467 17690 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:02.778280 17140 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:02.778672 17704 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:05:02.779798 17638 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:02.784340 17288 catalog_manager.cc:2174] created HMS catalog entry for table [id=102e2c3131734392b7c5d603015c2b46]
I20251213 09:05:02.788029 17563 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:02.788168 17563 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:02.790441 17288 catalog_manager.cc:5654] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:02.801676 17708 mvcc.cc:204] Tried to move back new op lower bound from 7231966014355722240 to 7231966012239482880. Current Snapshot: MvccSnapshot[applied={T|T < 7231966014355722240}]
I20251213 09:05:02.801877 16800 tablet_service.cc:1505] Processing CreateTablet for tablet eb95522d80454b48af6bfdd05fb684d6 (DEFAULT_TABLE table=default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.802181 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb95522d80454b48af6bfdd05fb684d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.802145 16938 tablet_service.cc:1505] Processing CreateTablet for tablet eb95522d80454b48af6bfdd05fb684d6 (DEFAULT_TABLE table=default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.802438 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb95522d80454b48af6bfdd05fb684d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.802662 17072 tablet_service.cc:1505] Processing CreateTablet for tablet eb95522d80454b48af6bfdd05fb684d6 (DEFAULT_TABLE table=default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.802904 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb95522d80454b48af6bfdd05fb684d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.804603 17583 tablet_bootstrap.cc:492] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:02.804759 17582 tablet_bootstrap.cc:492] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:02.805413 17584 tablet_bootstrap.cc:492] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:02.805739 17583 tablet_bootstrap.cc:654] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.805766 17582 tablet_bootstrap.cc:654] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.806437 17584 tablet_bootstrap.cc:654] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.807920 17288 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_00ca8030ef8d48088f07fb15e26d5bac" } modify_external_catalogs: true
I20251213 09:05:02.808077 17288 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_00ca8030ef8d48088f07fb15e26d5bac" } modify_external_catalogs: true
I20251213 09:05:02.814013 17584 tablet_bootstrap.cc:492] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:02.814155 17584 ts_tablet_manager.cc:1403] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:02.814718 17584 raft_consensus.cc:359] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.814852 17584 raft_consensus.cc:385] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.814901 17584 raft_consensus.cc:740] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.815030 17584 consensus_queue.cc:260] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.815385 17584 ts_tablet_manager.cc:1434] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.817250 17582 tablet_bootstrap.cc:492] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:02.817364 17582 ts_tablet_manager.cc:1403] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251213 09:05:02.818163 17582 raft_consensus.cc:359] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.818277 17582 raft_consensus.cc:385] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.818315 17582 raft_consensus.cc:740] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.818482 17582 consensus_queue.cc:260] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.818768 17582 ts_tablet_manager.cc:1434] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.822268 17639 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:39209; Asking this server to re-register.
I20251213 09:05:02.823170 17583 tablet_bootstrap.cc:492] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:02.823330 17583 ts_tablet_manager.cc:1403] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.002s
I20251213 09:05:02.824014 17583 raft_consensus.cc:359] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.824162 17583 raft_consensus.cc:385] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.824218 17583 raft_consensus.cc:740] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.824419 17583 consensus_queue.cc:260] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.824802 17583 ts_tablet_manager.cc:1434] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.827430 17639 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:50479; Asking this server to re-register.
I20251213 09:05:02.828843 17005 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:02.829190 16869 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:02.830600 17639 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:02.831727 17639 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:02.847880 17295 catalog_manager.cc:2174] created HMS catalog entry for table [id=26100504d2dc4aa89c7484bcde13e454]
I20251213 09:05:02.848349 17526 raft_consensus.cc:493] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:02.848496 17526 raft_consensus.cc:515] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.848879 17526 leader_election.cc:290] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:02.849536 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb95522d80454b48af6bfdd05fb684d6" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:02.849661 16958 raft_consensus.cc:2468] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:02.850996 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb95522d80454b48af6bfdd05fb684d6" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:02.851150 16820 raft_consensus.cc:2468] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:02.853296 17026 leader_election.cc:304] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:02.854570 17526 raft_consensus.cc:2804] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:02.854640 17526 raft_consensus.cc:493] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:02.854686 17526 raft_consensus.cc:3060] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.855813 17526 raft_consensus.cc:515] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.856237 17526 leader_election.cc:290] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:02.856710 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb95522d80454b48af6bfdd05fb684d6" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:02.856837 16820 raft_consensus.cc:3060] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.857801 16820 raft_consensus.cc:2468] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:02.858179 17026 leader_election.cc:304] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:02.858768 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eb95522d80454b48af6bfdd05fb684d6" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:02.858908 16958 raft_consensus.cc:3060] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:02.859983 16958 raft_consensus.cc:2468] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:02.863627 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 562701029f4a4988a4a7afd236def25e (DEFAULT_TABLE table=default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.863931 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562701029f4a4988a4a7afd236def25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.863960 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 562701029f4a4988a4a7afd236def25e (DEFAULT_TABLE table=default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.864252 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562701029f4a4988a4a7afd236def25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.866907 17583 tablet_bootstrap.cc:492] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:02.867180 17582 tablet_bootstrap.cc:492] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:02.868258 17583 tablet_bootstrap.cc:654] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.868316 17582 tablet_bootstrap.cc:654] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.868785 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 562701029f4a4988a4a7afd236def25e (DEFAULT_TABLE table=default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:02.869091 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 562701029f4a4988a4a7afd236def25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:02.870290 17583 tablet_bootstrap.cc:492] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:02.870371 17583 ts_tablet_manager.cc:1403] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251213 09:05:02.870838 17583 raft_consensus.cc:359] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.870949 17583 raft_consensus.cc:385] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.870980 17583 raft_consensus.cc:740] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.871160 17583 consensus_queue.cc:260] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.871536 17583 ts_tablet_manager.cc:1434] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:02.874099 17526 raft_consensus.cc:2804] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:02.874204 17526 raft_consensus.cc:697] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:02.874347 17526 consensus_queue.cc:237] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.876688 17584 tablet_bootstrap.cc:492] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:02.877873 17584 tablet_bootstrap.cc:654] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:02.880923 17584 tablet_bootstrap.cc:492] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:02.881023 17584 ts_tablet_manager.cc:1403] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:02.881529 17584 raft_consensus.cc:359] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.881645 17584 raft_consensus.cc:385] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.881675 17584 raft_consensus.cc:740] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.881800 17584 consensus_queue.cc:260] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.884208 17584 ts_tablet_manager.cc:1434] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:02.888451 17295 catalog_manager.cc:5654] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:02.889271 17582 tablet_bootstrap.cc:492] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:02.889389 17582 ts_tablet_manager.cc:1403] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20251213 09:05:02.890082 17582 raft_consensus.cc:359] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.890197 17582 raft_consensus.cc:385] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:02.890239 17582 raft_consensus.cc:740] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:02.890373 17582 consensus_queue.cc:260] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:02.890652 17582 ts_tablet_manager.cc:1434] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:02.903504 17295 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_924224088c604b9682478db9e1bbe741" } modify_external_catalogs: true
I20251213 09:05:02.903898 17295 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_924224088c604b9682478db9e1bbe741" } modify_external_catalogs: true
I20251213 09:05:02.942843 17296 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3]
I20251213 09:05:02.946990 17358 catalog_manager.cc:2772] Deleting table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb] in response to Hive Metastore notification log event 44
I20251213 09:05:02.952657 17358 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 37930409accc4a1eb5e31c095667f597
I20251213 09:05:02.953375 17358 catalog_manager.cc:2772] Deleting table default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3] in response to Hive Metastore notification log event 49
I20251213 09:05:02.953327 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet 37930409accc4a1eb5e31c095667f597 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:02.953753 17724 tablet_replica.cc:333] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:02.953969 17724 raft_consensus.cc:2243] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:02.954293 17724 raft_consensus.cc:2272] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.954885 17724 ts_tablet_manager.cc:1916] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.955343 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 37930409accc4a1eb5e31c095667f597 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:02.955646 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 37930409accc4a1eb5e31c095667f597 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:02.957898 17724 ts_tablet_manager.cc:1929] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:02.958024 17724 log.cc:1199] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/37930409accc4a1eb5e31c095667f597
I20251213 09:05:02.958382 17724 ts_tablet_manager.cc:1950] T 37930409accc4a1eb5e31c095667f597 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:02.959534 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:05:02.960985 17358 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 7876a7d15b0e438ebb7f6224794a6e46
I20251213 09:05:02.961582 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet 7876a7d15b0e438ebb7f6224794a6e46 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:02.961865 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 7876a7d15b0e438ebb7f6224794a6e46 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:02.962653 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 7876a7d15b0e438ebb7f6224794a6e46 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:02 UTC) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:02.961879 17725 tablet_replica.cc:333] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:02.964483 17724 tablet_replica.cc:333] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:02.964588 17725 raft_consensus.cc:2243] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:02.964776 17725 raft_consensus.cc:2272] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.965453 17725 ts_tablet_manager.cc:1916] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.967950 17725 ts_tablet_manager.cc:1929] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:02.968091 17725 log.cc:1199] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/37930409accc4a1eb5e31c095667f597
I20251213 09:05:02.968413 17725 ts_tablet_manager.cc:1950] T 37930409accc4a1eb5e31c095667f597 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:02.969089 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:05:02.969355 17726 tablet_replica.cc:333] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:02.969607 17726 raft_consensus.cc:2243] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:02.969794 17726 raft_consensus.cc:2272] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.970391 17726 ts_tablet_manager.cc:1916] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.973265 17726 ts_tablet_manager.cc:1929] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:02.976115 17724 raft_consensus.cc:2243] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:02.976225 17725 tablet_replica.cc:333] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:02.976303 17724 raft_consensus.cc:2272] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.976408 17725 raft_consensus.cc:2243] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:02.976640 17725 raft_consensus.cc:2272] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.976778 17724 ts_tablet_manager.cc:1916] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.976912 17726 log.cc:1199] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/37930409accc4a1eb5e31c095667f597
I20251213 09:05:02.977034 17725 ts_tablet_manager.cc:1916] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.977227 17726 ts_tablet_manager.cc:1950] T 37930409accc4a1eb5e31c095667f597 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:02.977909 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 37930409accc4a1eb5e31c095667f597 (table default.table_cfed201f26564767a4a57c58382df9b9 [id=36adcbe9600b45698aaf15dcc1bb56fb]) successfully deleted
I20251213 09:05:02.978188 17726 tablet_replica.cc:333] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:02.978338 17726 raft_consensus.cc:2243] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:02.978479 17726 raft_consensus.cc:2272] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:02.978870 17725 ts_tablet_manager.cc:1929] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:02.978961 17726 ts_tablet_manager.cc:1916] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:02.978986 17725 log.cc:1199] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/7876a7d15b0e438ebb7f6224794a6e46
I20251213 09:05:02.978996 17724 ts_tablet_manager.cc:1929] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:02.979056 17724 log.cc:1199] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/7876a7d15b0e438ebb7f6224794a6e46
I20251213 09:05:02.979269 17725 ts_tablet_manager.cc:1950] T 7876a7d15b0e438ebb7f6224794a6e46 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:02.979542 17724 ts_tablet_manager.cc:1950] T 7876a7d15b0e438ebb7f6224794a6e46 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:02.979902 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 7876a7d15b0e438ebb7f6224794a6e46 (table default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3]) successfully deleted
I20251213 09:05:02.981043 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 7876a7d15b0e438ebb7f6224794a6e46 (table default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3]) successfully deleted
I20251213 09:05:02.986406 17484 consensus_queue.cc:1048] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:02.991173 17726 ts_tablet_manager.cc:1929] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:02.991340 17726 log.cc:1199] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/7876a7d15b0e438ebb7f6224794a6e46
I20251213 09:05:02.991772 17726 ts_tablet_manager.cc:1950] T 7876a7d15b0e438ebb7f6224794a6e46 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:02.992470 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 7876a7d15b0e438ebb7f6224794a6e46 (table default.table_e03af1234dba427a8cdc24fb76d12515 [id=2b664bbdfb5d437fa4afe367a5b93fd3]) successfully deleted
I20251213 09:05:02.995779 17393 consensus_queue.cc:1048] T 1391d28e1e4046b4af9f0b06ae539c0d P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.012554 17293 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f]
W20251213 09:05:03.014187 17294 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_0bc46ad17b194fbf831fab656bf97fd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:03.014187 17291 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_731dc67a6a2b407180abef538691c40c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:03.017724 17287 master_service.cc:954] ReplaceTablet: received request to replace tablet 5c6e18d23d374b7faecc78db155aaa2c from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:03.018617 17290 master_service.cc:954] ReplaceTablet: received request to replace tablet 10339e3d2aef482580748a80f247d57f from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:03.019629 17288 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_73d8d94f56c44d66a429e84fbe602baa" } new_table_name: "default.Table_9f1d86677c6e4ef3ad9ce23c8915bb90" modify_external_catalogs: true
I20251213 09:05:03.019927 17295 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_8931d18ab40348878fba01c709567310" } new_table_name: "default.Table_42f74bdd72ac4f25bfeefe916379f135" modify_external_catalogs: true
I20251213 09:05:03.020116 17296 master_service.cc:954] ReplaceTablet: received request to replace tablet 7876a7d15b0e438ebb7f6224794a6e46 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:03.020409 17296 master_service.cc:954] ReplaceTablet: received request to replace tablet a0514913a4ce4b54bd78e53b11814912 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:03.024796 17358 catalog_manager.cc:2772] Deleting table default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f] in response to Hive Metastore notification log event 50
W20251213 09:05:03.014210 17292 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_432a26ea35484c14b07c89f682c923e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:03.032234 17287 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 5c6e18d23d374b7faecc78db155aaa2c
I20251213 09:05:03.032861 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c6e18d23d374b7faecc78db155aaa2c with delete_type TABLET_DATA_DELETED (replaced by tablet eef16afe8d5c4a6babb602765783b8c6) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:03.033142 17724 tablet_replica.cc:333] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:03.033325 17724 raft_consensus.cc:2243] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:03.033572 17724 raft_consensus.cc:2272] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.033996 17724 ts_tablet_manager.cc:1916] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.034631 17287 catalog_manager.cc:6724] ReplaceTablet: tablet 5c6e18d23d374b7faecc78db155aaa2c deleted and replaced by tablet eef16afe8d5c4a6babb602765783b8c6
I20251213 09:05:03.036386 17724 ts_tablet_manager.cc:1929] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.036499 17724 log.cc:1199] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/5c6e18d23d374b7faecc78db155aaa2c
I20251213 09:05:03.036762 17724 ts_tablet_manager.cc:1950] T 5c6e18d23d374b7faecc78db155aaa2c P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:03.037462 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 5c6e18d23d374b7faecc78db155aaa2c (table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]) successfully deleted
I20251213 09:05:03.037746 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c6e18d23d374b7faecc78db155aaa2c with delete_type TABLET_DATA_DELETED (replaced by tablet eef16afe8d5c4a6babb602765783b8c6) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:03.037961 17725 tablet_replica.cc:333] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:03.038098 17725 raft_consensus.cc:2243] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.038169 17287 master_service.cc:954] ReplaceTablet: received request to replace tablet 7751d6a8df064e9bbafee2c6310cf456 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:03.038237 17725 raft_consensus.cc:2272] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.038643 17725 ts_tablet_manager.cc:1916] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.039088 17393 consensus_queue.cc:1048] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.040056 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c6e18d23d374b7faecc78db155aaa2c with delete_type TABLET_DATA_DELETED (replaced by tablet eef16afe8d5c4a6babb602765783b8c6) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:03.040256 17726 tablet_replica.cc:333] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:03.040374 17726 raft_consensus.cc:2243] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.040530 17726 raft_consensus.cc:2272] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.040882 17725 ts_tablet_manager.cc:1929] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.040946 17725 log.cc:1199] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/5c6e18d23d374b7faecc78db155aaa2c
I20251213 09:05:03.041182 17725 ts_tablet_manager.cc:1950] T 5c6e18d23d374b7faecc78db155aaa2c P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:03.044529 17526 raft_consensus.cc:493] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.044581 17726 ts_tablet_manager.cc:1916] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.044631 17526 raft_consensus.cc:515] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.044978 17526 leader_election.cc:290] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.045622 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a86f3d6176a4a4681c0fb31649e0eab" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:03.045780 16820 raft_consensus.cc:2468] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:03.046125 17026 leader_election.cc:304] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:03.046303 17526 raft_consensus.cc:2804] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.046393 17526 raft_consensus.cc:493] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.046453 17526 raft_consensus.cc:3060] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.046998 17726 ts_tablet_manager.cc:1929] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.047360 17726 log.cc:1199] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/5c6e18d23d374b7faecc78db155aaa2c
I20251213 09:05:03.047565 17526 raft_consensus.cc:515] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.047930 17726 ts_tablet_manager.cc:1950] T 5c6e18d23d374b7faecc78db155aaa2c P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:03.048211 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 5c6e18d23d374b7faecc78db155aaa2c (table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]) successfully deleted
I20251213 09:05:03.048338 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a86f3d6176a4a4681c0fb31649e0eab" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:03.048465 16820 raft_consensus.cc:3060] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.049121 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 5c6e18d23d374b7faecc78db155aaa2c (table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]) successfully deleted
I20251213 09:05:03.049455 16820 raft_consensus.cc:2468] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:03.049834 17026 leader_election.cc:304] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:03.049851 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a86f3d6176a4a4681c0fb31649e0eab" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:03.049909 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4a86f3d6176a4a4681c0fb31649e0eab" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:03.049981 16958 raft_consensus.cc:2468] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:03.050042 17209 raft_consensus.cc:2804] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.050194 17209 raft_consensus.cc:697] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:03.050338 17209 consensus_queue.cc:237] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.058964 17290 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 10339e3d2aef482580748a80f247d57f
I20251213 09:05:03.059386 17290 catalog_manager.cc:6724] ReplaceTablet: tablet 10339e3d2aef482580748a80f247d57f deleted and replaced by tablet 276f296aafef4965b27c89cb80ae323c
I20251213 09:05:03.060609 17290 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_6b013204511a4b49bd1c108904225841"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:03.060928 17296 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet a0514913a4ce4b54bd78e53b11814912
I20251213 09:05:03.061189 17296 catalog_manager.cc:6724] ReplaceTablet: tablet a0514913a4ce4b54bd78e53b11814912 deleted and replaced by tablet 9c8aa26100c142c490e113579219a3cc
I20251213 09:05:03.061357 17296 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_202ae634c0504cf88ed2d25c49b0d397" } new_table_name: "default.Table_3f366169f90d4115bc094d525207e859" modify_external_catalogs: true
I20251213 09:05:03.062137 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 10339e3d2aef482580748a80f247d57f with delete_type TABLET_DATA_DELETED (replaced by tablet 276f296aafef4965b27c89cb80ae323c) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:03.047941 17526 leader_election.cc:290] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.063910 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet 10339e3d2aef482580748a80f247d57f with delete_type TABLET_DATA_DELETED (replaced by tablet 276f296aafef4965b27c89cb80ae323c) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:03.064021 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet a0514913a4ce4b54bd78e53b11814912 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c8aa26100c142c490e113579219a3cc) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:03.064595 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet a0514913a4ce4b54bd78e53b11814912 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c8aa26100c142c490e113579219a3cc) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:03.064815 17725 tablet_replica.cc:333] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:03.064824 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet a0514913a4ce4b54bd78e53b11814912 with delete_type TABLET_DATA_DELETED (replaced by tablet 9c8aa26100c142c490e113579219a3cc) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:03.064998 17725 raft_consensus.cc:2243] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.065048 17726 tablet_replica.cc:333] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:03.065138 17725 raft_consensus.cc:2272] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.065186 17726 raft_consensus.cc:2243] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.065313 17726 raft_consensus.cc:2272] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.065624 17725 ts_tablet_manager.cc:1916] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.065706 17726 ts_tablet_manager.cc:1916] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.066134 17358 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 41c1a0b4450842fda55296abeea8dfae
I20251213 09:05:03.066730 17293 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_20afd9b96f7e403d9c185f93b6567f19"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:03.064829 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 10339e3d2aef482580748a80f247d57f with delete_type TABLET_DATA_DELETED (replaced by tablet 276f296aafef4965b27c89cb80ae323c) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:03.067500 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 41c1a0b4450842fda55296abeea8dfae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:03 UTC) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:03.068266 17726 ts_tablet_manager.cc:1929] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.068384 17726 log.cc:1199] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/10339e3d2aef482580748a80f247d57f
I20251213 09:05:03.068636 17725 ts_tablet_manager.cc:1929] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.068732 17726 ts_tablet_manager.cc:1950] T 10339e3d2aef482580748a80f247d57f P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:03.068791 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 41c1a0b4450842fda55296abeea8dfae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:03 UTC) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:03.068989 17725 log.cc:1199] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/a0514913a4ce4b54bd78e53b11814912
I20251213 09:05:03.069280 17725 ts_tablet_manager.cc:1950] T a0514913a4ce4b54bd78e53b11814912 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:03.069429 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 41c1a0b4450842fda55296abeea8dfae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:03 UTC) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:03.069576 17726 tablet_replica.cc:333] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:03.069567 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 10339e3d2aef482580748a80f247d57f (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]) successfully deleted
I20251213 09:05:03.069765 17726 raft_consensus.cc:2243] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:03.069990 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet a0514913a4ce4b54bd78e53b11814912 (table default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]) successfully deleted
I20251213 09:05:03.070024 17726 raft_consensus.cc:2272] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.070204 17725 tablet_replica.cc:333] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:03.070415 17725 raft_consensus.cc:2243] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:03.070515 17726 ts_tablet_manager.cc:1916] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.070655 17725 raft_consensus.cc:2272] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.071072 17725 ts_tablet_manager.cc:1916] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.073102 17725 ts_tablet_manager.cc:1929] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.073221 17725 log.cc:1199] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/10339e3d2aef482580748a80f247d57f
I20251213 09:05:03.073544 17725 ts_tablet_manager.cc:1950] T 10339e3d2aef482580748a80f247d57f P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:03.074178 17725 tablet_replica.cc:333] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:03.074331 17725 raft_consensus.cc:2243] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.074472 17725 raft_consensus.cc:2272] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.074810 17725 ts_tablet_manager.cc:1916] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.075050 17724 tablet_replica.cc:333] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:03.075235 17724 raft_consensus.cc:2243] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.075366 17724 raft_consensus.cc:2272] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.075758 17724 ts_tablet_manager.cc:1916] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.076109 17287 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 7751d6a8df064e9bbafee2c6310cf456
I20251213 09:05:03.076349 16937 tablet_service.cc:1505] Processing CreateTablet for tablet eef16afe8d5c4a6babb602765783b8c6 (DEFAULT_TABLE table=default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.076436 17287 catalog_manager.cc:6724] ReplaceTablet: tablet 7751d6a8df064e9bbafee2c6310cf456 deleted and replaced by tablet c15dfcf0143a480da7a2c0befd55e18d
I20251213 09:05:03.076606 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef16afe8d5c4a6babb602765783b8c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.077663 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet 7751d6a8df064e9bbafee2c6310cf456 with delete_type TABLET_DATA_DELETED (replaced by tablet c15dfcf0143a480da7a2c0befd55e18d) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:03.077792 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 10339e3d2aef482580748a80f247d57f (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]) successfully deleted
I20251213 09:05:03.078130 16800 tablet_service.cc:1505] Processing CreateTablet for tablet eef16afe8d5c4a6babb602765783b8c6 (DEFAULT_TABLE table=default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.078508 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef16afe8d5c4a6babb602765783b8c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.078962 17582 tablet_bootstrap.cc:492] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:03.078951 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 7751d6a8df064e9bbafee2c6310cf456 with delete_type TABLET_DATA_DELETED (replaced by tablet c15dfcf0143a480da7a2c0befd55e18d) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:03.079247 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 7751d6a8df064e9bbafee2c6310cf456 with delete_type TABLET_DATA_DELETED (replaced by tablet c15dfcf0143a480da7a2c0befd55e18d) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:03.079263 17072 tablet_service.cc:1505] Processing CreateTablet for tablet eef16afe8d5c4a6babb602765783b8c6 (DEFAULT_TABLE table=default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.079579 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eef16afe8d5c4a6babb602765783b8c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.080283 17582 tablet_bootstrap.cc:654] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.080919 17583 tablet_bootstrap.cc:492] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:03.081399 17725 ts_tablet_manager.cc:1929] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.081456 17725 log.cc:1199] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/41c1a0b4450842fda55296abeea8dfae
I20251213 09:05:03.081681 17725 ts_tablet_manager.cc:1950] T 41c1a0b4450842fda55296abeea8dfae P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:03.082103 17583 tablet_bootstrap.cc:654] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.082713 17584 tablet_bootstrap.cc:492] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:03.083688 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 41c1a0b4450842fda55296abeea8dfae (table default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f]) successfully deleted
I20251213 09:05:03.083922 17584 tablet_bootstrap.cc:654] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.084591 17725 tablet_replica.cc:333] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:03.084710 17725 raft_consensus.cc:2243] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.084815 17725 raft_consensus.cc:2272] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.085343 17725 ts_tablet_manager.cc:1916] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.087272 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 9c8aa26100c142c490e113579219a3cc (DEFAULT_TABLE table=default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.087450 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 276f296aafef4965b27c89cb80ae323c (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.087527 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8aa26100c142c490e113579219a3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.087674 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276f296aafef4965b27c89cb80ae323c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.088069 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 9c8aa26100c142c490e113579219a3cc (DEFAULT_TABLE table=default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.088274 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8aa26100c142c490e113579219a3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.089610 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 276f296aafef4965b27c89cb80ae323c (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.089648 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 9c8aa26100c142c490e113579219a3cc (DEFAULT_TABLE table=default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.089805 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276f296aafef4965b27c89cb80ae323c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.089844 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c8aa26100c142c490e113579219a3cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.092948 17726 ts_tablet_manager.cc:1929] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.093101 17726 log.cc:1199] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/a0514913a4ce4b54bd78e53b11814912
I20251213 09:05:03.093153 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 276f296aafef4965b27c89cb80ae323c (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.093405 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 276f296aafef4965b27c89cb80ae323c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.093565 17726 ts_tablet_manager.cc:1950] T a0514913a4ce4b54bd78e53b11814912 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:03.094364 17726 tablet_replica.cc:333] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:03.094535 17726 raft_consensus.cc:2243] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.094694 17726 raft_consensus.cc:2272] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.094803 17287 catalog_manager.cc:5654] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:03.095511 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet a0514913a4ce4b54bd78e53b11814912 (table default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]) successfully deleted
I20251213 09:05:03.095816 17073 tablet_service.cc:1505] Processing CreateTablet for tablet c15dfcf0143a480da7a2c0befd55e18d (DEFAULT_TABLE table=default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.096032 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15dfcf0143a480da7a2c0befd55e18d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.096091 17725 ts_tablet_manager.cc:1929] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:03.096154 17725 log.cc:1199] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/7751d6a8df064e9bbafee2c6310cf456
I20251213 09:05:03.096417 17725 ts_tablet_manager.cc:1950] T 7751d6a8df064e9bbafee2c6310cf456 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:03.096894 16800 tablet_service.cc:1505] Processing CreateTablet for tablet c15dfcf0143a480da7a2c0befd55e18d (DEFAULT_TABLE table=default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.097106 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15dfcf0143a480da7a2c0befd55e18d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.098172 17724 ts_tablet_manager.cc:1929] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.098237 17724 log.cc:1199] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/10339e3d2aef482580748a80f247d57f
I20251213 09:05:03.098496 17724 ts_tablet_manager.cc:1950] T 10339e3d2aef482580748a80f247d57f P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:03.098912 17726 ts_tablet_manager.cc:1916] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.099128 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 10339e3d2aef482580748a80f247d57f (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]) successfully deleted
I20251213 09:05:03.099671 16937 tablet_service.cc:1505] Processing CreateTablet for tablet c15dfcf0143a480da7a2c0befd55e18d (DEFAULT_TABLE table=default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.099977 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c15dfcf0143a480da7a2c0befd55e18d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.102097 17724 tablet_replica.cc:333] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:03.102267 17724 raft_consensus.cc:2243] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.102429 17724 raft_consensus.cc:2272] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.102837 17724 ts_tablet_manager.cc:1916] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.104506 17287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_2a73dd544c544da19748cbfd887fe768"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:03.105388 17724 ts_tablet_manager.cc:1929] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.105471 17724 log.cc:1199] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/a0514913a4ce4b54bd78e53b11814912
I20251213 09:05:03.105727 17724 ts_tablet_manager.cc:1950] T a0514913a4ce4b54bd78e53b11814912 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:03.106307 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet a0514913a4ce4b54bd78e53b11814912 (table default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d]) successfully deleted
I20251213 09:05:03.106525 17724 tablet_replica.cc:333] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:03.106659 17724 raft_consensus.cc:2243] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:03.106863 17724 raft_consensus.cc:2272] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.107240 17724 ts_tablet_manager.cc:1916] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.108982 17724 ts_tablet_manager.cc:1929] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.108983 17726 ts_tablet_manager.cc:1929] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:03.109057 17724 log.cc:1199] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/41c1a0b4450842fda55296abeea8dfae
I20251213 09:05:03.109284 17724 ts_tablet_manager.cc:1950] T 41c1a0b4450842fda55296abeea8dfae P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:03.110206 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 7751d6a8df064e9bbafee2c6310cf456 (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]) successfully deleted
I20251213 09:05:03.110662 17583 tablet_bootstrap.cc:492] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:03.110761 17583 ts_tablet_manager.cc:1403] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20251213 09:05:03.111245 17726 log.cc:1199] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/41c1a0b4450842fda55296abeea8dfae
I20251213 09:05:03.111289 17583 raft_consensus.cc:359] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.111398 17583 raft_consensus.cc:385] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.111433 17583 raft_consensus.cc:740] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.111505 17726 ts_tablet_manager.cc:1950] T 41c1a0b4450842fda55296abeea8dfae P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:03.111568 17583 consensus_queue.cc:260] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.111840 17583 ts_tablet_manager.cc:1434] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.112010 17726 tablet_replica.cc:333] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:03.112041 17583 tablet_bootstrap.cc:492] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:03.112119 17726 raft_consensus.cc:2243] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:03.112131 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 41c1a0b4450842fda55296abeea8dfae (table default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f]) successfully deleted
I20251213 09:05:03.112217 17726 raft_consensus.cc:2272] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.112795 17726 ts_tablet_manager.cc:1916] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.113201 17583 tablet_bootstrap.cc:654] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.114598 17726 ts_tablet_manager.cc:1929] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:03.114655 17726 log.cc:1199] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/7751d6a8df064e9bbafee2c6310cf456
I20251213 09:05:03.114872 17726 ts_tablet_manager.cc:1950] T 7751d6a8df064e9bbafee2c6310cf456 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:03.115454 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 7751d6a8df064e9bbafee2c6310cf456 (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]) successfully deleted
I20251213 09:05:03.110041 17584 tablet_bootstrap.cc:492] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:03.118642 17484 consensus_queue.cc:1048] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.118707 17584 ts_tablet_manager.cc:1403] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20251213 09:05:03.119273 17584 raft_consensus.cc:359] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.119380 17584 raft_consensus.cc:385] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.119410 17584 raft_consensus.cc:740] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.119539 17584 consensus_queue.cc:260] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.119699 17583 tablet_bootstrap.cc:492] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:03.119767 17583 ts_tablet_manager.cc:1403] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251213 09:05:03.119808 17584 ts_tablet_manager.cc:1434] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.119982 17584 tablet_bootstrap.cc:492] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:03.120198 17583 raft_consensus.cc:359] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.120282 17583 raft_consensus.cc:385] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.120311 17583 raft_consensus.cc:740] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.120461 17583 consensus_queue.cc:260] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.121038 17584 tablet_bootstrap.cc:654] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.126600 17582 tablet_bootstrap.cc:492] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:03.126693 17582 ts_tablet_manager.cc:1403] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20251213 09:05:03.126706 17584 tablet_bootstrap.cc:492] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:03.126768 17584 ts_tablet_manager.cc:1403] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:03.127202 17584 raft_consensus.cc:359] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.127187 17582 raft_consensus.cc:359] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.127286 17582 raft_consensus.cc:385] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.127286 17584 raft_consensus.cc:385] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.127318 17582 raft_consensus.cc:740] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.127318 17584 raft_consensus.cc:740] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.127453 17584 consensus_queue.cc:260] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.127436 17582 consensus_queue.cc:260] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.127715 17582 ts_tablet_manager.cc:1434] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:03.127892 17582 tablet_bootstrap.cc:492] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:03.128360 17584 ts_tablet_manager.cc:1434] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:03.128893 17582 tablet_bootstrap.cc:654] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.129096 17584 tablet_bootstrap.cc:492] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:03.129442 17526 raft_consensus.cc:493] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.129519 17526 raft_consensus.cc:515] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.129832 17526 leader_election.cc:290] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.130162 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c38f6e874044009a4656efa5dddd9a7" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:03.130288 16820 raft_consensus.cc:2468] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:03.130267 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c38f6e874044009a4656efa5dddd9a7" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:03.130373 16957 raft_consensus.cc:2468] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:03.130587 17026 leader_election.cc:304] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:03.130769 17526 raft_consensus.cc:2804] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.130815 17526 raft_consensus.cc:493] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.130851 17526 raft_consensus.cc:3060] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.131246 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 41c1a0b4450842fda55296abeea8dfae (table default.table_1eb38c19e2ee4d43bce7ee0f6617f5d6 [id=f0f07fd6e72744a18f77618b42da106f]) successfully deleted
I20251213 09:05:03.131405 17584 tablet_bootstrap.cc:654] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.131593 17724 tablet_replica.cc:333] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:03.131788 17724 raft_consensus.cc:2243] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:03.131767 17526 raft_consensus.cc:515] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.132019 17724 raft_consensus.cc:2272] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:03.132042 17526 leader_election.cc:290] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.132364 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c38f6e874044009a4656efa5dddd9a7" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:03.132469 16957 raft_consensus.cc:3060] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.132592 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c38f6e874044009a4656efa5dddd9a7" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:03.132648 17724 ts_tablet_manager.cc:1916] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:03.132678 16820 raft_consensus.cc:3060] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.133389 16957 raft_consensus.cc:2468] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:03.133589 16820 raft_consensus.cc:2468] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:03.133870 17028 leader_election.cc:304] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.134845 17724 ts_tablet_manager.cc:1929] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:03.134923 17724 log.cc:1199] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/7751d6a8df064e9bbafee2c6310cf456
I20251213 09:05:03.135200 17724 ts_tablet_manager.cc:1950] T 7751d6a8df064e9bbafee2c6310cf456 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:03.135660 17582 tablet_bootstrap.cc:492] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:03.135738 17582 ts_tablet_manager.cc:1403] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251213 09:05:03.136184 17582 raft_consensus.cc:359] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.136291 17584 tablet_bootstrap.cc:492] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:03.136289 17582 raft_consensus.cc:385] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.136324 17582 raft_consensus.cc:740] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.136363 17584 ts_tablet_manager.cc:1403] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:03.136430 17582 consensus_queue.cc:260] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.136710 17582 ts_tablet_manager.cc:1434] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.136782 17584 raft_consensus.cc:359] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.136874 17584 raft_consensus.cc:385] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.136896 17582 tablet_bootstrap.cc:492] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:03.136929 17584 raft_consensus.cc:740] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.137068 17584 consensus_queue.cc:260] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.137276 17733 raft_consensus.cc:2804] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.137336 17584 ts_tablet_manager.cc:1434] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.137373 17733 raft_consensus.cc:697] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:03.137508 17733 consensus_queue.cc:237] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.137794 17582 tablet_bootstrap.cc:654] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.138083 17584 tablet_bootstrap.cc:492] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:03.139226 17584 tablet_bootstrap.cc:654] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.141319 17294 catalog_manager.cc:2174] created HMS catalog entry for table [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]
I20251213 09:05:03.142218 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 7751d6a8df064e9bbafee2c6310cf456 (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]) successfully deleted
I20251213 09:05:03.145409 17583 ts_tablet_manager.cc:1434] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.026s user 0.001s sys 0.000s
I20251213 09:05:03.145617 17583 tablet_bootstrap.cc:492] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:03.146633 17583 tablet_bootstrap.cc:654] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.148021 17583 tablet_bootstrap.cc:492] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:03.148128 17583 ts_tablet_manager.cc:1403] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:03.148603 17583 raft_consensus.cc:359] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.148699 17583 raft_consensus.cc:385] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.148732 17583 raft_consensus.cc:740] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.149364 17583 consensus_queue.cc:260] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.151465 17583 ts_tablet_manager.cc:1434] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251213 09:05:03.151680 17583 tablet_bootstrap.cc:492] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:03.153851 17073 tablet_service.cc:1505] Processing CreateTablet for tablet f3b4a3ff63414a5da3faa9023644c677 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.154114 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b4a3ff63414a5da3faa9023644c677. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.155992 16937 tablet_service.cc:1505] Processing CreateTablet for tablet f3b4a3ff63414a5da3faa9023644c677 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.156282 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b4a3ff63414a5da3faa9023644c677. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.156853 17583 tablet_bootstrap.cc:654] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.157357 17294 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_c5239544ee2445018871c8161587d082"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:03.158075 17584 tablet_bootstrap.cc:492] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:03.158166 17584 ts_tablet_manager.cc:1403] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251213 09:05:03.158365 17237 raft_consensus.cc:493] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.158452 17237 raft_consensus.cc:515] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.158599 17584 raft_consensus.cc:359] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.158687 17584 raft_consensus.cc:385] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.158713 17584 raft_consensus.cc:740] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.158797 17237 leader_election.cc:290] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:03.158842 17584 consensus_queue.cc:260] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.159231 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "562701029f4a4988a4a7afd236def25e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:03.159338 17091 raft_consensus.cc:2468] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:03.159610 16894 leader_election.cc:304] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.160264 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "562701029f4a4988a4a7afd236def25e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:03.160372 16820 raft_consensus.cc:2468] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:03.160743 16800 tablet_service.cc:1505] Processing CreateTablet for tablet f3b4a3ff63414a5da3faa9023644c677 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.160969 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3b4a3ff63414a5da3faa9023644c677. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.161702 17237 raft_consensus.cc:2804] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.161778 17237 raft_consensus.cc:493] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.161816 17237 raft_consensus.cc:3060] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.162751 17237 raft_consensus.cc:515] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.163105 17237 leader_election.cc:290] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:03.163506 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "562701029f4a4988a4a7afd236def25e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:03.163612 16820 raft_consensus.cc:3060] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.164286 16820 raft_consensus.cc:2468] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:03.164556 16891 leader_election.cc:304] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.164861 17584 ts_tablet_manager.cc:1434] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251213 09:05:03.164861 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "562701029f4a4988a4a7afd236def25e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:03.165005 17091 raft_consensus.cc:3060] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.165099 17584 tablet_bootstrap.cc:492] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:03.165931 17091 raft_consensus.cc:2468] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:03.166137 17582 tablet_bootstrap.cc:492] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:03.166239 17582 ts_tablet_manager.cc:1403] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20251213 09:05:03.166767 17582 raft_consensus.cc:359] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.166869 17582 raft_consensus.cc:385] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.166900 17582 raft_consensus.cc:740] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.167201 17237 raft_consensus.cc:2804] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.167289 17237 raft_consensus.cc:697] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:03.167408 17237 consensus_queue.cc:237] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.168008 17584 tablet_bootstrap.cc:654] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.167042 17582 consensus_queue.cc:260] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.168345 17582 ts_tablet_manager.cc:1434] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:03.168922 17583 tablet_bootstrap.cc:492] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:03.169021 17583 ts_tablet_manager.cc:1403] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20251213 09:05:03.169245 17582 tablet_bootstrap.cc:492] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:03.169514 17583 raft_consensus.cc:359] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.169608 17583 raft_consensus.cc:385] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.169649 17583 raft_consensus.cc:740] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.169781 17583 consensus_queue.cc:260] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.170320 17582 tablet_bootstrap.cc:654] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.171298 17583 ts_tablet_manager.cc:1434] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251213 09:05:03.171500 17583 tablet_bootstrap.cc:492] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:03.175921 17584 tablet_bootstrap.cc:492] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:03.176049 17584 ts_tablet_manager.cc:1403] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251213 09:05:03.176641 17584 raft_consensus.cc:359] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.176759 17584 raft_consensus.cc:385] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.176802 17584 raft_consensus.cc:740] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.176961 17584 consensus_queue.cc:260] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.177358 17584 ts_tablet_manager.cc:1434] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:03.179339 17583 tablet_bootstrap.cc:654] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.183986 17583 tablet_bootstrap.cc:492] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:03.184101 17583 ts_tablet_manager.cc:1403] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251213 09:05:03.184268 17582 tablet_bootstrap.cc:492] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:03.184410 17582 ts_tablet_manager.cc:1403] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251213 09:05:03.184670 17583 raft_consensus.cc:359] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.184793 17583 raft_consensus.cc:385] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.184832 17583 raft_consensus.cc:740] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.184965 17583 consensus_queue.cc:260] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.185158 17582 raft_consensus.cc:359] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.185281 17583 ts_tablet_manager.cc:1434] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.185310 17582 raft_consensus.cc:385] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.185449 17582 raft_consensus.cc:740] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.185622 17582 consensus_queue.cc:260] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.185968 17582 ts_tablet_manager.cc:1434] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.186250 17582 tablet_bootstrap.cc:492] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:03.187629 17582 tablet_bootstrap.cc:654] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.191964 17291 catalog_manager.cc:2174] created HMS catalog entry for table [id=ddc2320ac07a41f5917210b36dbb05cb]
I20251213 09:05:03.196708 17582 tablet_bootstrap.cc:492] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:03.196815 17582 ts_tablet_manager.cc:1403] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251213 09:05:03.197314 17582 raft_consensus.cc:359] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.197433 17582 raft_consensus.cc:385] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.197477 17582 raft_consensus.cc:740] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.197635 17582 consensus_queue.cc:260] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.198433 17484 raft_consensus.cc:493] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.198529 17484 raft_consensus.cc:515] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.198915 17484 leader_election.cc:290] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:03.201129 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "276f296aafef4965b27c89cb80ae323c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:03.201292 16958 raft_consensus.cc:2468] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:03.201679 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "276f296aafef4965b27c89cb80ae323c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:03.201839 17091 raft_consensus.cc:2468] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:03.202224 16756 leader_election.cc:304] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.202428 17484 raft_consensus.cc:2804] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.202497 17484 raft_consensus.cc:493] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.202548 17484 raft_consensus.cc:3060] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.203891 17484 raft_consensus.cc:515] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.204320 17484 leader_election.cc:290] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:03.204865 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "276f296aafef4965b27c89cb80ae323c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:03.204984 16958 raft_consensus.cc:3060] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.209700 17291 catalog_manager.cc:5654] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:03.210175 17526 raft_consensus.cc:493] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.210296 17526 raft_consensus.cc:515] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.210706 17526 leader_election.cc:290] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:03.211354 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3b4a3ff63414a5da3faa9023644c677" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:03.211522 16820 raft_consensus.cc:2468] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:03.211992 17026 leader_election.cc:304] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:03.212195 17526 raft_consensus.cc:2804] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.212260 17526 raft_consensus.cc:493] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.212319 17526 raft_consensus.cc:3060] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.213657 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "276f296aafef4965b27c89cb80ae323c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:03.213819 17091 raft_consensus.cc:3060] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.214208 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3b4a3ff63414a5da3faa9023644c677" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:03.214370 16957 raft_consensus.cc:2468] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:03.214486 17582 ts_tablet_manager.cc:1434] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.018s user 0.001s sys 0.000s
I20251213 09:05:03.225174 17237 raft_consensus.cc:493] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.225315 17237 raft_consensus.cc:515] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.225725 17237 leader_election.cc:290] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.226424 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c15dfcf0143a480da7a2c0befd55e18d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:03.226577 17092 raft_consensus.cc:2468] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:03.227269 16894 leader_election.cc:304] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.227468 17206 raft_consensus.cc:493] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.227685 17206 raft_consensus.cc:515] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.228120 17206 leader_election.cc:290] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.228349 17206 raft_consensus.cc:2804] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.228478 17206 raft_consensus.cc:493] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.228662 17209 consensus_queue.cc:1048] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.228726 17206 raft_consensus.cc:3060] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.229754 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c15dfcf0143a480da7a2c0befd55e18d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:03.229915 16821 raft_consensus.cc:2468] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:03.230149 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c8aa26100c142c490e113579219a3cc" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:03.230306 16819 raft_consensus.cc:2468] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:03.231957 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 61068bc606a641a78e3c61edb25443c1 (DEFAULT_TABLE table=default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.232268 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61068bc606a641a78e3c61edb25443c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.233309 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c8aa26100c142c490e113579219a3cc" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:03.233500 17092 raft_consensus.cc:2468] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:03.234534 16891 leader_election.cc:304] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.234972 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 61068bc606a641a78e3c61edb25443c1 (DEFAULT_TABLE table=default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.235358 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61068bc606a641a78e3c61edb25443c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.235986 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 61068bc606a641a78e3c61edb25443c1 (DEFAULT_TABLE table=default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.236279 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61068bc606a641a78e3c61edb25443c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.237604 17237 raft_consensus.cc:2804] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.237679 17237 raft_consensus.cc:493] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.237725 17237 raft_consensus.cc:3060] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.239946 17291 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]). Expected version 1 got 0
W20251213 09:05:03.240427 17291 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet c15dfcf0143a480da7a2c0befd55e18d consensus state has no leader
I20251213 09:05:03.240728 17583 tablet_bootstrap.cc:492] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:03.241151 16958 raft_consensus.cc:2468] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:03.243357 17526 raft_consensus.cc:515] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.243882 17526 leader_election.cc:290] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:03.246803 17584 tablet_bootstrap.cc:492] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:03.248015 17584 tablet_bootstrap.cc:654] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.248662 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3b4a3ff63414a5da3faa9023644c677" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:03.248796 16958 raft_consensus.cc:3060] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.249327 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3b4a3ff63414a5da3faa9023644c677" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:03.249464 16819 raft_consensus.cc:3060] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.250587 17583 tablet_bootstrap.cc:654] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.250910 16756 leader_election.cc:304] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.251098 17484 raft_consensus.cc:2804] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.251255 17484 raft_consensus.cc:697] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:03.251402 17484 consensus_queue.cc:237] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.252374 17291 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_9dc2b6abe24f4a86ade24c79c38fa2e3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:03.252921 17582 tablet_bootstrap.cc:492] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:03.255007 17582 tablet_bootstrap.cc:654] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.256829 17582 tablet_bootstrap.cc:492] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:03.256956 17582 ts_tablet_manager.cc:1403] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:03.257500 17582 raft_consensus.cc:359] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.257617 17582 raft_consensus.cc:385] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.257649 17582 raft_consensus.cc:740] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.257797 17582 consensus_queue.cc:260] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.258127 17582 ts_tablet_manager.cc:1434] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.261160 17583 tablet_bootstrap.cc:492] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:03.261258 17583 ts_tablet_manager.cc:1403] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20251213 09:05:03.261787 17583 raft_consensus.cc:359] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.261886 17583 raft_consensus.cc:385] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.261929 17583 raft_consensus.cc:740] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.262058 17583 consensus_queue.cc:260] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.262959 17583 ts_tablet_manager.cc:1434] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:03.263746 17584 tablet_bootstrap.cc:492] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:03.263844 17584 ts_tablet_manager.cc:1403] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251213 09:05:03.264343 17584 raft_consensus.cc:359] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.264460 17584 raft_consensus.cc:385] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.264492 17584 raft_consensus.cc:740] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.264606 17584 consensus_queue.cc:260] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.264886 17584 ts_tablet_manager.cc:1434] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.268954 17209 consensus_queue.cc:1048] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.289331 17393 raft_consensus.cc:493] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.289434 17393 raft_consensus.cc:515] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.289805 17393 leader_election.cc:290] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:03.290128 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eef16afe8d5c4a6babb602765783b8c6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:03.290211 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eef16afe8d5c4a6babb602765783b8c6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:03.290262 16957 raft_consensus.cc:2468] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:03.290324 17092 raft_consensus.cc:2468] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:03.290575 16756 leader_election.cc:304] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.290750 17393 raft_consensus.cc:2804] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.290812 17393 raft_consensus.cc:493] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.290866 17393 raft_consensus.cc:3060] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.321228 17091 raft_consensus.cc:2468] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:03.321242 16958 raft_consensus.cc:2468] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:03.321594 16819 raft_consensus.cc:2468] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:03.321986 17026 leader_election.cc:304] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:03.322232 17206 raft_consensus.cc:515] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.322594 17237 raft_consensus.cc:515] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.322990 17237 leader_election.cc:290] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.322654 17206 leader_election.cc:290] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.323695 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c8aa26100c142c490e113579219a3cc" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:03.323822 16820 raft_consensus.cc:3060] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.324221 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c15dfcf0143a480da7a2c0befd55e18d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:03.324327 16819 raft_consensus.cc:3060] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.325008 16820 raft_consensus.cc:2468] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:03.325604 16891 leader_election.cc:304] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.325903 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9c8aa26100c142c490e113579219a3cc" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:03.326023 17092 raft_consensus.cc:3060] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.326155 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c15dfcf0143a480da7a2c0befd55e18d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:03.326274 17091 raft_consensus.cc:3060] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.326928 17206 raft_consensus.cc:2804] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.327039 17206 raft_consensus.cc:697] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:03.327195 17206 consensus_queue.cc:237] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.330801 17733 raft_consensus.cc:2804] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.330890 17733 raft_consensus.cc:697] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:03.331009 17733 consensus_queue.cc:237] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:03.340615 17209 consensus_queue.cc:1048] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.344453 17526 consensus_queue.cc:1048] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251213 09:05:03.352744 17281 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c15dfcf0143a480da7a2c0befd55e18d consensus state has no leader
I20251213 09:05:03.361600 17484 raft_consensus.cc:493] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.361749 17484 raft_consensus.cc:515] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.362254 17484 leader_election.cc:290] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:03.362736 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61068bc606a641a78e3c61edb25443c1" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:03.362723 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61068bc606a641a78e3c61edb25443c1" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:03.362879 16958 raft_consensus.cc:2468] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:03.362879 17093 raft_consensus.cc:2468] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:03.363209 16756 leader_election.cc:304] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.363394 17484 raft_consensus.cc:2804] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.363467 17484 raft_consensus.cc:493] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.363528 17484 raft_consensus.cc:3060] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.413480 17092 raft_consensus.cc:2468] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:03.413507 16819 raft_consensus.cc:2468] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:03.413959 17091 raft_consensus.cc:2468] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:03.414446 16894 leader_election.cc:304] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.414474 17393 raft_consensus.cc:515] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.414903 17393 leader_election.cc:290] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:03.415354 17484 raft_consensus.cc:515] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.415504 17237 raft_consensus.cc:2804] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.415611 17237 raft_consensus.cc:697] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:03.415771 17484 leader_election.cc:290] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:03.415753 17237 consensus_queue.cc:237] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:03.416558 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61068bc606a641a78e3c61edb25443c1" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:03.416704 17092 raft_consensus.cc:3060] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.416791 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eef16afe8d5c4a6babb602765783b8c6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:03.416908 17091 raft_consensus.cc:3060] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.416923 17289 catalog_manager.cc:3485] renamed table default.table_d6d6d9a459ff460f97765707846c32ea [id=045d3d231f2f407d93e565315930f71d] in HMS: new name default.table_b13c688f2da847468824aefa65d4c4ab
I20251213 09:05:03.417273 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eef16afe8d5c4a6babb602765783b8c6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:03.417377 16958 raft_consensus.cc:3060] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.417860 17092 raft_consensus.cc:2468] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:03.417943 17091 raft_consensus.cc:2468] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:03.418339 16958 raft_consensus.cc:2468] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:03.418393 16757 leader_election.cc:304] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:03.418607 16757 leader_election.cc:304] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:03.418916 17393 raft_consensus.cc:2804] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.419075 17393 raft_consensus.cc:697] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:03.419310 17393 consensus_queue.cc:237] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.419404 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "61068bc606a641a78e3c61edb25443c1" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:03.419497 16957 raft_consensus.cc:3060] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.419957 17393 raft_consensus.cc:2804] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.420022 17393 raft_consensus.cc:697] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:03.420138 17393 consensus_queue.cc:237] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.470489 17526 consensus_queue.cc:1048] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.475584 16958 raft_consensus.cc:3060] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.511688 16957 raft_consensus.cc:2468] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:03.513625 17526 consensus_queue.cc:1048] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.523923 17526 consensus_queue.cc:1048] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.528784 17733 consensus_queue.cc:1048] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.556372 17206 consensus_queue.cc:1048] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.560545 17762 consensus_queue.cc:1048] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.611435 17292 catalog_manager.cc:2174] created HMS catalog entry for table [id=3ff193025e8c46c9ba8ff470fdb4e644]
I20251213 09:05:03.616261 17292 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 39) took 1366 ms. Trace:
I20251213 09:05:03.616364 17292 rpcz_store.cc:276] 1213 09:05:02.249916 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:02.449952 (+200036us) service_pool.cc:225] Handling call
1213 09:05:03.025770 (+575818us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:03.026123 (+ 353us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:03.611426 (+585303us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:03.616070 (+ 4644us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:03.616159 (+ 89us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:03.616245 (+ 86us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:03.611937 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:03.612039 (+ 102us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:03.612043 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:03.612045 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:03.612140 (+ 95us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:03.612150 (+ 10us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:03.612153 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:03.612210 (+ 57us) tablet.cc:699] Row locks acquired
1213 09:05:03.612211 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:03.612233 (+ 22us) write_op.cc:270] Start()
1213 09:05:03.612259 (+ 26us) write_op.cc:276] Timestamp: P: 1765616703612167 usec, L: 0
1213 09:05:03.612261 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:03.612386 (+ 125us) log.cc:844] Serialized 433 byte log entry
1213 09:05:03.614763 (+ 2377us) op_driver.cc:464] REPLICATION: finished
1213 09:05:03.614849 (+ 86us) write_op.cc:301] APPLY: starting
1213 09:05:03.614865 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:03.614899 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:03.614913 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:03.614985 (+ 72us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:03.615011 (+ 26us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:03.615015 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:03.615070 (+ 55us) log.cc:844] Serialized 29 byte log entry
1213 09:05:03.615138 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:03.615149 (+ 11us) write_op.cc:454] Released schema lock
1213 09:05:03.615153 (+ 4us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:03.615210 (+ 57us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:03.615212 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":390577,"Hive Metastore.run_cpu_time_us":208,"Hive Metastore.run_wall_time_us":194570,"spinlock_wait_cycles":29184,"child_traces":[["op",{"apply.queue_time_us":46,"apply.run_cpu_time_us":353,"apply.run_wall_time_us":353,"num_ops":2,"prepare.queue_time_us":38,"prepare.run_cpu_time_us":526,"prepare.run_wall_time_us":527,"raft.queue_time_us":750,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":295,"replication_time_us":2473}]]}
W20251213 09:05:03.622164 17358 catalog_manager.cc:5914] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9c8aa26100c142c490e113579219a3cc consensus state has no leader
I20251213 09:05:03.623566 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 62236955121e49ec800c5e37a40c5b19 (DEFAULT_TABLE table=default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.623854 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62236955121e49ec800c5e37a40c5b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.623898 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 62236955121e49ec800c5e37a40c5b19 (DEFAULT_TABLE table=default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.624179 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62236955121e49ec800c5e37a40c5b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.626061 17582 tablet_bootstrap.cc:492] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:03.627297 17583 tablet_bootstrap.cc:492] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:03.627935 17582 tablet_bootstrap.cc:654] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.628300 17583 tablet_bootstrap.cc:654] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:03.628676 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 62236955121e49ec800c5e37a40c5b19 (DEFAULT_TABLE table=default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:03.628933 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62236955121e49ec800c5e37a40c5b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:03.629771 17292 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]). Expected version 1 got 0
I20251213 09:05:03.629940 17292 catalog_manager.cc:5654] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:03.631340 17584 tablet_bootstrap.cc:492] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:03.632412 17584 tablet_bootstrap.cc:654] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
W20251213 09:05:03.633767 17290 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_6b013204511a4b49bd1c108904225841 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:03.635004 17584 tablet_bootstrap.cc:492] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:03.635077 17584 ts_tablet_manager.cc:1403] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:03.635558 17584 raft_consensus.cc:359] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.635654 17584 raft_consensus.cc:385] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.635681 17584 raft_consensus.cc:740] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.635793 17584 consensus_queue.cc:260] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.636039 17584 ts_tablet_manager.cc:1434] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.637524 17582 tablet_bootstrap.cc:492] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:03.637636 17582 ts_tablet_manager.cc:1403] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20251213 09:05:03.638113 17582 raft_consensus.cc:359] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.638257 17582 raft_consensus.cc:385] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.638289 17582 raft_consensus.cc:740] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.638406 17582 consensus_queue.cc:260] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.638667 17582 ts_tablet_manager.cc:1434] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.641963 17393 consensus_queue.cc:1048] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.643782 17583 tablet_bootstrap.cc:492] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:03.643896 17583 ts_tablet_manager.cc:1403] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20251213 09:05:03.644424 17583 raft_consensus.cc:359] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.644546 17583 raft_consensus.cc:385] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:03.644593 17583 raft_consensus.cc:740] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:03.644717 17583 consensus_queue.cc:260] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.645023 17583 ts_tablet_manager.cc:1434] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:03.647482 17292 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]). Expected version 1 got 0
I20251213 09:05:03.648689 17292 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]). Expected version 1 got 0
I20251213 09:05:03.650893 17292 catalog_manager.cc:5654] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:03.653331 17292 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]). Expected version 1 got 0
I20251213 09:05:03.653589 17292 catalog_manager.cc:5654] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:03.653800 17292 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 9c8aa26100c142c490e113579219a3cc (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
I20251213 09:05:03.663080 17484 consensus_queue.cc:1048] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.668849 17292 catalog_manager.cc:5654] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:03.669183 17292 catalog_manager.cc:5654] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } }
I20251213 09:05:03.678975 17292 catalog_manager.cc:5654] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:03.679421 17292 catalog_manager.cc:5654] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:03.691184 17292 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_72b6ade0720a4ca696c10b619535e2b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:03.708403 17091 raft_consensus.cc:1275] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Refusing update from remote peer ba49ca51d8eb4be288091d19e7114792: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:05:03.708434 16819 raft_consensus.cc:1275] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Refusing update from remote peer ba49ca51d8eb4be288091d19e7114792: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251213 09:05:03.709038 17758 consensus_queue.cc:1048] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.710511 17758 consensus_queue.cc:1048] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.713691 17288 catalog_manager.cc:3485] renamed table default.table_73d8d94f56c44d66a429e84fbe602baa [id=e9b9d5d3630e485c8177b62bf7cbc8ba] in HMS: new name default.table_9f1d86677c6e4ef3ad9ce23c8915bb90
I20251213 09:05:03.722735 17791 tablet.cc:1722] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:03.722752 17790 tablet.cc:1722] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:03.729048 17792 tablet.cc:1722] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:03.800295 17484 consensus_queue.cc:1048] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.804410 17484 consensus_queue.cc:1048] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.811735 17526 consensus_queue.cc:1048] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.819728 17526 consensus_queue.cc:1048] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.861009 17526 raft_consensus.cc:493] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:03.861145 17526 raft_consensus.cc:515] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.861575 17526 leader_election.cc:290] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.861968 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62236955121e49ec800c5e37a40c5b19" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:03.862008 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62236955121e49ec800c5e37a40c5b19" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:03.862140 16819 raft_consensus.cc:2468] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:03.862109 16958 raft_consensus.cc:2468] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:03.862459 17028 leader_election.cc:304] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.862771 17526 raft_consensus.cc:2804] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:03.862835 17526 raft_consensus.cc:493] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:03.862865 17526 raft_consensus.cc:3060] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.867031 17762 consensus_queue.cc:1048] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.870260 17237 consensus_queue.cc:1048] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.885885 17792 tablet.cc:1722] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:03.885973 17791 tablet.cc:1722] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:03.886706 17790 tablet.cc:1722] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:03.902313 17484 consensus_queue.cc:1048] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.905673 17484 consensus_queue.cc:1048] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:03.912093 17526 raft_consensus.cc:515] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.912525 17526 leader_election.cc:290] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:03.912928 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62236955121e49ec800c5e37a40c5b19" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:03.913071 16958 raft_consensus.cc:3060] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:03.914064 16958 raft_consensus.cc:2468] T 62236955121e49ec800c5e37a40c5b19 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:03.914384 17028 leader_election.cc:304] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:03.914572 17526 raft_consensus.cc:2804] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:03.914665 17526 raft_consensus.cc:697] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:03.914809 17526 consensus_queue.cc:237] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:03.916535 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62236955121e49ec800c5e37a40c5b19" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:03.916659 16819 raft_consensus.cc:3060] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:04.009706 16819 raft_consensus.cc:2468] T 62236955121e49ec800c5e37a40c5b19 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:04.011308 17295 catalog_manager.cc:3485] renamed table default.table_8931d18ab40348878fba01c709567310 [id=497850be5e0c40179bfa90c0c0d6f4ce] in HMS: new name default.table_42f74bdd72ac4f25bfeefe916379f135
I20251213 09:05:04.116248 17290 catalog_manager.cc:2174] created HMS catalog entry for table [id=ac51e6353aeb41b7836d834c7a18946d]
I20251213 09:05:04.122227 17290 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 53) took 1523 ms. Trace:
I20251213 09:05:04.122314 17290 rpcz_store.cc:276] 1213 09:05:02.598829 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.060497 (+461668us) service_pool.cc:225] Handling call
1213 09:05:03.633849 (+573352us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:03.634159 (+ 310us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:04.116237 (+482078us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:04.122054 (+ 5817us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:04.122141 (+ 87us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:04.122211 (+ 70us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:04.116791 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:04.117670 (+ 879us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:04.117674 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:04.117676 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:04.117745 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:04.117755 (+ 10us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:04.117758 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:04.117813 (+ 55us) tablet.cc:699] Row locks acquired
1213 09:05:04.117814 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:04.117842 (+ 28us) write_op.cc:270] Start()
1213 09:05:04.117871 (+ 29us) write_op.cc:276] Timestamp: P: 1765616704117764 usec, L: 0
1213 09:05:04.117873 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:04.117998 (+ 125us) log.cc:844] Serialized 433 byte log entry
1213 09:05:04.121590 (+ 3592us) op_driver.cc:464] REPLICATION: finished
1213 09:05:04.121686 (+ 96us) write_op.cc:301] APPLY: starting
1213 09:05:04.121698 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:04.121725 (+ 27us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:04.121740 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:04.121805 (+ 65us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:04.121829 (+ 24us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:04.121833 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:04.121890 (+ 57us) log.cc:844] Serialized 29 byte log entry
1213 09:05:04.121928 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:04.121939 (+ 11us) write_op.cc:454] Released schema lock
1213 09:05:04.121944 (+ 5us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:04.121993 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:04.121995 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":377062,"Hive Metastore.run_cpu_time_us":240,"Hive Metastore.run_wall_time_us":104850,"child_traces":[["op",{"apply.queue_time_us":51,"apply.run_cpu_time_us":298,"apply.run_wall_time_us":298,"num_ops":2,"prepare.queue_time_us":47,"prepare.run_cpu_time_us":1303,"prepare.run_wall_time_us":1303,"raft.queue_time_us":871,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":368,"replication_time_us":3696}]]}
I20251213 09:05:04.123369 17290 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 9c8aa26100c142c490e113579219a3cc (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
I20251213 09:05:04.124467 17290 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 9c8aa26100c142c490e113579219a3cc (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
I20251213 09:05:04.125350 17290 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 9c8aa26100c142c490e113579219a3cc (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
I20251213 09:05:04.125723 17290 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_cf83acd5b1a641a192b2c9592488faca" } modify_external_catalogs: true
I20251213 09:05:04.125845 17290 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_cf83acd5b1a641a192b2c9592488faca" } modify_external_catalogs: true
I20251213 09:05:04.136509 16800 tablet_service.cc:1505] Processing CreateTablet for tablet b3c914dd363847b2a5730feb0c3e9c11 (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:04.136854 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c914dd363847b2a5730feb0c3e9c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:04.139088 17583 tablet_bootstrap.cc:492] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:04.140235 17583 tablet_bootstrap.cc:654] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:04.140630 17073 tablet_service.cc:1505] Processing CreateTablet for tablet b3c914dd363847b2a5730feb0c3e9c11 (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:04.140885 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c914dd363847b2a5730feb0c3e9c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:04.145174 16938 tablet_service.cc:1505] Processing CreateTablet for tablet b3c914dd363847b2a5730feb0c3e9c11 (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:04.145932 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3c914dd363847b2a5730feb0c3e9c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:04.149325 17803 tablet_bootstrap.cc:492] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:04.150632 17803 tablet_bootstrap.cc:654] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:04.151623 17804 tablet_bootstrap.cc:492] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:04.151667 17583 tablet_bootstrap.cc:492] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:04.151751 17583 ts_tablet_manager.cc:1403] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251213 09:05:04.152017 17803 tablet_bootstrap.cc:492] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:04.152139 17803 ts_tablet_manager.cc:1403] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:04.152245 17583 raft_consensus.cc:359] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.152376 17583 raft_consensus.cc:385] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:04.152415 17583 raft_consensus.cc:740] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:04.152560 17583 consensus_queue.cc:260] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.152837 17583 ts_tablet_manager.cc:1434] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:04.152783 17803 raft_consensus.cc:359] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.152933 17803 raft_consensus.cc:385] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:04.153028 17803 raft_consensus.cc:740] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:04.153224 17804 tablet_bootstrap.cc:654] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:04.153317 17803 consensus_queue.cc:260] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.154664 17804 tablet_bootstrap.cc:492] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:04.154752 17804 ts_tablet_manager.cc:1403] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:04.155263 17804 raft_consensus.cc:359] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.155767 17804 raft_consensus.cc:385] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:04.155822 17804 raft_consensus.cc:740] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:04.155959 17804 consensus_queue.cc:260] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.157428 17804 ts_tablet_manager.cc:1434] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:04.157606 17803 ts_tablet_manager.cc:1434] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251213 09:05:04.195957 17209 raft_consensus.cc:493] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:04.196099 17209 raft_consensus.cc:515] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.196552 17209 leader_election.cc:290] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:04.196985 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b3c914dd363847b2a5730feb0c3e9c11" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:04.197034 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b3c914dd363847b2a5730feb0c3e9c11" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:04.197150 16819 raft_consensus.cc:2468] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:04.197134 16958 raft_consensus.cc:2468] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:04.197487 17028 leader_election.cc:304] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:04.197644 17209 raft_consensus.cc:2804] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:04.197705 17209 raft_consensus.cc:493] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:04.197762 17209 raft_consensus.cc:3060] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:04.211436 17209 raft_consensus.cc:515] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.211969 17209 leader_election.cc:290] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:04.212469 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b3c914dd363847b2a5730feb0c3e9c11" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:04.212493 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b3c914dd363847b2a5730feb0c3e9c11" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:04.212613 16819 raft_consensus.cc:3060] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:04.212656 16958 raft_consensus.cc:3060] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:04.213640 16819 raft_consensus.cc:2468] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:04.213961 16958 raft_consensus.cc:2468] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:04.214016 17026 leader_election.cc:304] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:04.214202 17209 raft_consensus.cc:2804] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:04.214304 17209 raft_consensus.cc:697] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:04.214457 17209 consensus_queue.cc:237] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.308331 17296 catalog_manager.cc:3485] renamed table default.table_202ae634c0504cf88ed2d25c49b0d397 [id=4ec61addd21c4307bce7a9891a6983ee] in HMS: new name default.table_3f366169f90d4115bc094d525207e859
W20251213 09:05:04.313179 17293 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_20afd9b96f7e403d9c185f93b6567f19 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:04.313432 17289 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 43) took 2063 ms. Trace:
I20251213 09:05:04.313510 17289 rpcz_store.cc:276] 1213 09:05:02.250084 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:02.744473 (+494389us) service_pool.cc:225] Handling call
1213 09:05:03.019233 (+274760us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:04.312981 (+1293748us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:04.313222 (+ 241us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:04.313412 (+ 190us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":172452,"Hive Metastore.run_cpu_time_us":498,"Hive Metastore.run_wall_time_us":224901}
W20251213 09:05:04.313917 17294 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c5239544ee2445018871c8161587d082 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:04.314595 17291 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:04.313184 17287 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_2a73dd544c544da19748cbfd887fe768 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:04.315488 17289 catalog_manager.cc:5654] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:04.340049 17289 catalog_manager.cc:6199] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d] alter complete (version 1)
I20251213 09:05:04.341204 17792 tablet.cc:1722] T c5adcb68c5b9438da10370479acbed52 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:04.344619 17289 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_2d8ae593f178467881752483962712b3" } new_table_name: "default.Table_9875930af7074cd8b3baeb132c88b19a" modify_external_catalogs: true
I20251213 09:05:04.346895 17790 tablet.cc:1722] T c5adcb68c5b9438da10370479acbed52 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:04.350172 17791 tablet.cc:1722] T c5adcb68c5b9438da10370479acbed52 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251213 09:05:04.350334 17292 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_72b6ade0720a4ca696c10b619535e2b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:04.351104 17288 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 48) took 2100 ms. Trace:
I20251213 09:05:04.351203 17296 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 54) took 1718 ms. Trace:
I20251213 09:05:04.351245 17296 rpcz_store.cc:276] 1213 09:05:02.632904 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.061291 (+428387us) service_pool.cc:225] Handling call
1213 09:05:03.634271 (+572980us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:04.350880 (+716609us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:04.351017 (+ 137us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:04.351194 (+ 177us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":481825,"Hive Metastore.run_cpu_time_us":504,"Hive Metastore.run_wall_time_us":191996}
I20251213 09:05:04.351627 17295 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 49) took 2101 ms. Trace:
I20251213 09:05:04.351678 17295 rpcz_store.cc:276] 1213 09:05:02.250378 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.019873 (+769495us) service_pool.cc:225] Handling call
1213 09:05:03.633400 (+613527us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:04.351283 (+717883us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:04.351457 (+ 174us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:04.351611 (+ 154us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":78560,"Hive Metastore.run_cpu_time_us":550,"Hive Metastore.run_wall_time_us":299170}
I20251213 09:05:04.352027 17816 tablet.cc:1722] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:04.352392 17815 tablet.cc:1722] T 8a9c4e8b224d440dbab9d693bbba9e37 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:04.353143 17295 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_2c647fd17c384b5a81ffdb84f9d5dc8e" } modify_external_catalogs: true
I20251213 09:05:04.351220 17288 rpcz_store.cc:276] 1213 09:05:02.250338 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.019561 (+769223us) service_pool.cc:225] Handling call
1213 09:05:03.633229 (+613668us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:04.350706 (+717477us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:04.350889 (+ 183us) catalog_manager.cc:3708] Apply alter schema
1213 09:05:04.351088 (+ 199us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1073,"Hive Metastore.run_cpu_time_us":483,"Hive Metastore.run_wall_time_us":77611}
I20251213 09:05:04.353258 17295 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_2c647fd17c384b5a81ffdb84f9d5dc8e" } modify_external_catalogs: true
I20251213 09:05:04.353411 17288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_e3c10aee5e2044a5b15b49197906acde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:04.353451 17296 catalog_manager.cc:5654] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:04.354007 17814 tablet.cc:1722] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:04.357496 17296 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_e15a5e101cf24bec9b2ecc545598c4b2" } modify_external_catalogs: true
I20251213 09:05:04.357623 17296 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_e15a5e101cf24bec9b2ecc545598c4b2" } modify_external_catalogs: true
I20251213 09:05:04.358067 17820 tablet.cc:1722] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251213 09:05:04.358944 17822 tablet.cc:1722] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251213 09:05:04.359195 17821 tablet.cc:1722] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251213 09:05:04.475107 17526 consensus_queue.cc:1048] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:04.479635 17209 consensus_queue.cc:1048] T 62236955121e49ec800c5e37a40c5b19 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:04.509306 17293 catalog_manager.cc:2174] created HMS catalog entry for table [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:04.513360 17293 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 55) took 1832 ms. Trace:
I20251213 09:05:04.513448 17293 rpcz_store.cc:276] 1213 09:05:02.681232 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.066630 (+385398us) service_pool.cc:225] Handling call
1213 09:05:04.313310 (+1246680us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:04.313650 (+ 340us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:04.509295 (+195645us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:04.513169 (+ 3874us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:04.513269 (+ 100us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:04.513344 (+ 75us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:04.509918 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:04.510009 (+ 91us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:04.510012 (+ 3us) write_op.cc:435] Acquired schema lock
1213 09:05:04.510013 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:04.510091 (+ 78us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:04.510100 (+ 9us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:04.510102 (+ 2us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:04.510149 (+ 47us) tablet.cc:699] Row locks acquired
1213 09:05:04.510150 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:04.510178 (+ 28us) write_op.cc:270] Start()
1213 09:05:04.510214 (+ 36us) write_op.cc:276] Timestamp: P: 1765616704510124 usec, L: 0
1213 09:05:04.510215 (+ 1us) op_driver.cc:348] REPLICATION: starting
1213 09:05:04.510328 (+ 113us) log.cc:844] Serialized 433 byte log entry
1213 09:05:04.512507 (+ 2179us) op_driver.cc:464] REPLICATION: finished
1213 09:05:04.512594 (+ 87us) write_op.cc:301] APPLY: starting
1213 09:05:04.512607 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:04.512637 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:04.512651 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:04.512727 (+ 76us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:04.512757 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:04.512764 (+ 7us) write_op.cc:312] APPLY: finished
1213 09:05:04.512815 (+ 51us) log.cc:844] Serialized 29 byte log entry
1213 09:05:04.512870 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:04.512883 (+ 13us) write_op.cc:454] Released schema lock
1213 09:05:04.512889 (+ 6us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:04.512939 (+ 50us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:04.512941 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":3215,"Hive Metastore.run_cpu_time_us":150,"Hive Metastore.run_wall_time_us":192103,"spinlock_wait_cycles":5760,"child_traces":[["op",{"apply.queue_time_us":51,"apply.run_cpu_time_us":337,"apply.run_wall_time_us":337,"num_ops":2,"prepare.queue_time_us":148,"prepare.run_cpu_time_us":491,"prepare.run_wall_time_us":490,"raft.queue_time_us":331,"raft.run_cpu_time_us":409,"raft.run_wall_time_us":410,"replication_time_us":2271,"spinlock_wait_cycles":77696}]]}
I20251213 09:05:04.518373 17293 catalog_manager.cc:6199] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba] alter complete (version 1)
I20251213 09:05:04.520306 17293 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_d1445dc6dbb1441d82855de496280fd7" } modify_external_catalogs: true
I20251213 09:05:04.520435 17293 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_d1445dc6dbb1441d82855de496280fd7" } modify_external_catalogs: true
I20251213 09:05:04.522117 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 608f523767d946b18b8bbfe50ca23347 (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:04.522327 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 608f523767d946b18b8bbfe50ca23347 (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:04.522414 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608f523767d946b18b8bbfe50ca23347. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:04.522562 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608f523767d946b18b8bbfe50ca23347. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:04.522651 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 608f523767d946b18b8bbfe50ca23347 (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:04.522944 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608f523767d946b18b8bbfe50ca23347. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:04.524770 17804 tablet_bootstrap.cc:492] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:04.524777 17583 tablet_bootstrap.cc:492] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:04.525269 17803 tablet_bootstrap.cc:492] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:04.525838 17804 tablet_bootstrap.cc:654] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:04.525848 17583 tablet_bootstrap.cc:654] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:04.526278 17803 tablet_bootstrap.cc:654] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:04.526820 17583 tablet_bootstrap.cc:492] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:04.526906 17583 ts_tablet_manager.cc:1403] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251213 09:05:04.526927 17804 tablet_bootstrap.cc:492] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:04.527029 17804 ts_tablet_manager.cc:1403] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:04.527426 17583 raft_consensus.cc:359] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.527518 17583 raft_consensus.cc:385] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:04.527554 17583 raft_consensus.cc:740] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:04.527544 17804 raft_consensus.cc:359] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.527626 17803 tablet_bootstrap.cc:492] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:04.527657 17804 raft_consensus.cc:385] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:04.527690 17804 raft_consensus.cc:740] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:04.527696 17803 ts_tablet_manager.cc:1403] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:04.527684 17583 consensus_queue.cc:260] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.527810 17804 consensus_queue.cc:260] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.528007 17583 ts_tablet_manager.cc:1434] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:04.528085 17804 ts_tablet_manager.cc:1434] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:04.528136 17803 raft_consensus.cc:359] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.528230 17803 raft_consensus.cc:385] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:04.528280 17803 raft_consensus.cc:740] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:04.528388 17803 consensus_queue.cc:260] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.528695 17803 ts_tablet_manager.cc:1434] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:04.613829 17209 consensus_queue.cc:1048] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:04.617053 17209 consensus_queue.cc:1048] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:04.738699 17237 raft_consensus.cc:493] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:04.738817 17237 raft_consensus.cc:515] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.739198 17237 leader_election.cc:290] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:04.739560 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "608f523767d946b18b8bbfe50ca23347" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:04.739560 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "608f523767d946b18b8bbfe50ca23347" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:04.739704 17092 raft_consensus.cc:2468] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:04.739704 16819 raft_consensus.cc:2468] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:04.739984 16891 leader_election.cc:304] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:04.740216 17237 raft_consensus.cc:2804] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:04.740269 17237 raft_consensus.cc:493] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:04.740298 17237 raft_consensus.cc:3060] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:04.797166 17237 raft_consensus.cc:515] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:04.797715 17237 leader_election.cc:290] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:04.798166 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "608f523767d946b18b8bbfe50ca23347" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:04.798250 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "608f523767d946b18b8bbfe50ca23347" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:04.798365 16819 raft_consensus.cc:3060] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:04.798385 17092 raft_consensus.cc:3060] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:04.799686 16819 raft_consensus.cc:2468] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:04.799683 17092 raft_consensus.cc:2468] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:04.800050 16894 leader_election.cc:304] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:04.800348 17237 raft_consensus.cc:2804] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:04.800474 17237 raft_consensus.cc:697] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:04.800834 17237 consensus_queue.cc:237] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.022799 17831 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:05.022941 17831 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:05.023480 17831 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
I20251213 09:05:05.023963 17306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7f61ccb4ffd4066babfa94938e28b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 183 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" is_pre_election: true
I20251213 09:05:05.024003 17641 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7f61ccb4ffd4066babfa94938e28b87" candidate_term: 3 candidate_status { last_received { term: 2 index: 183 } } ignore_live_leader: false dest_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" is_pre_election: true
I20251213 09:05:05.024571 16613 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:05.024744 17831 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251213 09:05:05.113086 17294 catalog_manager.cc:2174] created HMS catalog entry for table [id=223b3f16b6974a988bd8c492248bb893]
I20251213 09:05:05.125468 17294 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 57) took 2280 ms. Trace:
I20251213 09:05:05.125573 17294 rpcz_store.cc:276] 1213 09:05:02.844786 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.157253 (+312467us) service_pool.cc:225] Handling call
1213 09:05:04.313985 (+1156732us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:04.314324 (+ 339us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:05.113074 (+798750us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:05.125256 (+ 12182us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:05.125348 (+ 92us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:05.125447 (+ 99us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.113957 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.114065 (+ 108us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.114070 (+ 5us) write_op.cc:435] Acquired schema lock
1213 09:05:05.114071 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:05.114143 (+ 72us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.114154 (+ 11us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.114157 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.114223 (+ 66us) tablet.cc:699] Row locks acquired
1213 09:05:05.114224 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:05.114252 (+ 28us) write_op.cc:270] Start()
1213 09:05:05.114278 (+ 26us) write_op.cc:276] Timestamp: P: 1765616705114188 usec, L: 0
1213 09:05:05.114280 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.114435 (+ 155us) log.cc:844] Serialized 433 byte log entry
1213 09:05:05.117353 (+ 2918us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.124842 (+ 7489us) write_op.cc:301] APPLY: starting
1213 09:05:05.124863 (+ 21us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.124897 (+ 34us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.124922 (+ 25us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.125006 (+ 84us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.125036 (+ 30us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:05.125043 (+ 7us) write_op.cc:312] APPLY: finished
1213 09:05:05.125112 (+ 69us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.125165 (+ 53us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.125189 (+ 24us) write_op.cc:454] Released schema lock
1213 09:05:05.125194 (+ 5us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.125263 (+ 69us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.125267 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":194685,"Hive Metastore.run_cpu_time_us":299,"Hive Metastore.run_wall_time_us":603912,"child_traces":[["op",{"apply.queue_time_us":7397,"apply.run_cpu_time_us":450,"apply.run_wall_time_us":449,"num_ops":2,"prepare.queue_time_us":380,"prepare.run_cpu_time_us":674,"prepare.run_wall_time_us":6794,"raft.queue_time_us":468,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":362,"replication_time_us":3047,"thread_start_us":280,"threads_started":3}]]}
I20251213 09:05:05.131871 16938 tablet_service.cc:1505] Processing CreateTablet for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (DEFAULT_TABLE table=default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.132222 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.132373 16800 tablet_service.cc:1505] Processing CreateTablet for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (DEFAULT_TABLE table=default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.132622 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.132961 17073 tablet_service.cc:1505] Processing CreateTablet for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (DEFAULT_TABLE table=default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.133266 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.135702 17294 catalog_manager.cc:6199] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce] alter complete (version 1)
I20251213 09:05:05.139330 17294 catalog_manager.cc:6199] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee] alter complete (version 3)
I20251213 09:05:05.141542 17842 tablet_bootstrap.cc:492] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.142244 17294 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_b3265ac4a94e4212945564c7137ada7c" } modify_external_catalogs: true
I20251213 09:05:05.142371 17294 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_b3265ac4a94e4212945564c7137ada7c" } modify_external_catalogs: true
I20251213 09:05:05.142939 17844 tablet_bootstrap.cc:492] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.142977 17842 tablet_bootstrap.cc:654] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.142987 17841 tablet_bootstrap.cc:492] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.144131 17841 tablet_bootstrap.cc:654] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.144191 17842 tablet_bootstrap.cc:492] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.144279 17842 ts_tablet_manager.cc:1403] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:05.144788 17844 tablet_bootstrap.cc:654] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.144837 17842 raft_consensus.cc:359] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.144956 17842 raft_consensus.cc:385] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.144994 17842 raft_consensus.cc:740] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.145119 17842 consensus_queue.cc:260] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.145287 17841 tablet_bootstrap.cc:492] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.145380 17841 ts_tablet_manager.cc:1403] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:05.145532 17842 ts_tablet_manager.cc:1434] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:05.145879 17841 raft_consensus.cc:359] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.145984 17841 raft_consensus.cc:385] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.146015 17841 raft_consensus.cc:740] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.146118 17841 consensus_queue.cc:260] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.146375 17841 ts_tablet_manager.cc:1434] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.148327 17844 tablet_bootstrap.cc:492] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.148439 17844 ts_tablet_manager.cc:1403] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:05.149569 17844 raft_consensus.cc:359] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.149675 17844 raft_consensus.cc:385] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.149709 17844 raft_consensus.cc:740] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.149816 17844 consensus_queue.cc:260] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.151311 17844 ts_tablet_manager.cc:1434] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:05.184026 17237 consensus_queue.cc:1048] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:05.187428 17237 consensus_queue.cc:1048] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:05.218276 16212 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu with pid 16594
I20251213 09:05:05.274989 17209 raft_consensus.cc:493] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:05.275153 17209 raft_consensus.cc:515] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.275565 17209 leader_election.cc:290] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:05.275939 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa2cb21fb1a64b9d9c13d31cb9f49a5e" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:05.275974 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa2cb21fb1a64b9d9c13d31cb9f49a5e" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:05.276084 16957 raft_consensus.cc:2468] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:05.276221 16819 raft_consensus.cc:2468] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:05.276547 17028 leader_election.cc:304] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:05.276775 17733 raft_consensus.cc:2804] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:05.276827 17733 raft_consensus.cc:493] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:05.276854 17733 raft_consensus.cc:3060] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.310793 17733 raft_consensus.cc:515] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.311312 17733 leader_election.cc:290] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:05.311818 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa2cb21fb1a64b9d9c13d31cb9f49a5e" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:05.311951 16819 raft_consensus.cc:3060] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.313133 16819 raft_consensus.cc:2468] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:05.313506 17026 leader_election.cc:304] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:05.313694 17733 raft_consensus.cc:2804] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:05.313772 17733 raft_consensus.cc:697] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:05.313925 17733 consensus_queue.cc:237] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.316677 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aa2cb21fb1a64b9d9c13d31cb9f49a5e" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:05.316815 16957 raft_consensus.cc:3060] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.409709 16957 raft_consensus.cc:2468] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:05.510495 17291 catalog_manager.cc:2174] created HMS catalog entry for table [id=17e6b0ba44da493cabdc06a4622e068d]
W20251213 09:05:05.514842 17283 consensus_peers.cc:597] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 -> Peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Couldn't send request to peer d7f61ccb4ffd4066babfa94938e28b87. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:05.515244 17291 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 58) took 2589 ms. Trace:
I20251213 09:05:05.515308 17291 rpcz_store.cc:276] 1213 09:05:02.925384 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.240941 (+315557us) service_pool.cc:225] Handling call
1213 09:05:04.314660 (+1073719us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:04.314938 (+ 278us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:05.510480 (+1195542us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:05.515025 (+ 4545us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:05.515145 (+ 120us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:05.515231 (+ 86us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.511196 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.511344 (+ 148us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.511351 (+ 7us) write_op.cc:435] Acquired schema lock
1213 09:05:05.511354 (+ 3us) tablet.cc:660] Decoding operations
1213 09:05:05.511437 (+ 83us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.511451 (+ 14us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.511457 (+ 6us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.511538 (+ 81us) tablet.cc:699] Row locks acquired
1213 09:05:05.511541 (+ 3us) write_op.cc:260] PREPARE: finished
1213 09:05:05.511575 (+ 34us) write_op.cc:270] Start()
1213 09:05:05.511608 (+ 33us) write_op.cc:276] Timestamp: P: 1765616705511519 usec, L: 0
1213 09:05:05.511611 (+ 3us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.511774 (+ 163us) log.cc:844] Serialized 433 byte log entry
1213 09:05:05.514263 (+ 2489us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.514349 (+ 86us) write_op.cc:301] APPLY: starting
1213 09:05:05.514363 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.514392 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.514404 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.514492 (+ 88us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.514528 (+ 36us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:05.514532 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:05.514589 (+ 57us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.514634 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.514647 (+ 13us) write_op.cc:454] Released schema lock
1213 09:05:05.514654 (+ 7us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.514709 (+ 55us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.514711 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":798054,"Hive Metastore.run_cpu_time_us":237,"Hive Metastore.run_wall_time_us":397360,"child_traces":[["op",{"apply.queue_time_us":47,"apply.run_cpu_time_us":353,"apply.run_wall_time_us":352,"num_ops":2,"prepare.queue_time_us":74,"prepare.run_cpu_time_us":675,"prepare.run_wall_time_us":676,"raft.queue_time_us":412,"raft.run_cpu_time_us":444,"raft.run_wall_time_us":443,"replication_time_us":2627}]]}
I20251213 09:05:05.516624 17291 catalog_manager.cc:5654] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:05.526377 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 604c2f416148499ab5651c43cd1491a1 (DEFAULT_TABLE table=default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.526726 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604c2f416148499ab5651c43cd1491a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.527292 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 604c2f416148499ab5651c43cd1491a1 (DEFAULT_TABLE table=default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.527596 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604c2f416148499ab5651c43cd1491a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.529161 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 604c2f416148499ab5651c43cd1491a1 (DEFAULT_TABLE table=default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.529431 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 604c2f416148499ab5651c43cd1491a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.529847 17841 tablet_bootstrap.cc:492] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.530941 17841 tablet_bootstrap.cc:654] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.531550 17842 tablet_bootstrap.cc:492] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.532560 17842 tablet_bootstrap.cc:654] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.533193 17844 tablet_bootstrap.cc:492] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.534183 17844 tablet_bootstrap.cc:654] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.534507 17841 tablet_bootstrap.cc:492] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.534581 17841 ts_tablet_manager.cc:1403] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:05.534493 17291 catalog_manager.cc:5654] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:05.535059 17841 raft_consensus.cc:359] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.535231 17841 raft_consensus.cc:385] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.535271 17841 raft_consensus.cc:740] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.535382 17841 consensus_queue.cc:260] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.535683 17841 ts_tablet_manager.cc:1434] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.536757 17842 tablet_bootstrap.cc:492] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.536839 17842 ts_tablet_manager.cc:1403] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:05.537328 17842 raft_consensus.cc:359] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.537449 17842 raft_consensus.cc:385] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.537489 17842 raft_consensus.cc:740] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.537593 17842 consensus_queue.cc:260] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.537678 17850 raft_consensus.cc:493] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:05.537761 17850 raft_consensus.cc:515] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.538131 17850 leader_election.cc:290] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:05.538370 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "604c2f416148499ab5651c43cd1491a1" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
W20251213 09:05:05.538839 16757 leader_election.cc:343] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): Illegal state: must be running to vote when last-logged opid is not known
I20251213 09:05:05.539243 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "604c2f416148499ab5651c43cd1491a1" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:05.539356 16957 raft_consensus.cc:2468] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:05.539592 17842 ts_tablet_manager.cc:1434] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:05.539638 16756 leader_election.cc:304] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters: 9714e48438da4ed8b629934850b1f7ce
I20251213 09:05:05.539907 17484 raft_consensus.cc:2804] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:05.539958 17484 raft_consensus.cc:493] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:05.539992 17484 raft_consensus.cc:3060] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.541797 17844 tablet_bootstrap.cc:492] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.541888 17844 ts_tablet_manager.cc:1403] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:05.542384 17844 raft_consensus.cc:359] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.542495 17844 raft_consensus.cc:385] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.542534 17844 raft_consensus.cc:740] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.542691 17844 consensus_queue.cc:260] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.542991 17844 ts_tablet_manager.cc:1434] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.546757 17291 master_service.cc:954] ReplaceTablet: received request to replace tablet 562701029f4a4988a4a7afd236def25e from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:05.549918 17291 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 562701029f4a4988a4a7afd236def25e
I20251213 09:05:05.550633 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 562701029f4a4988a4a7afd236def25e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e5ff40d6b24f51956d050c23d41eb7) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:05.550861 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet 562701029f4a4988a4a7afd236def25e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e5ff40d6b24f51956d050c23d41eb7) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:05.550920 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 562701029f4a4988a4a7afd236def25e with delete_type TABLET_DATA_DELETED (replaced by tablet 33e5ff40d6b24f51956d050c23d41eb7) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:05.551255 17868 tablet_replica.cc:333] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:05.551394 17867 tablet_replica.cc:333] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:05.551438 17868 raft_consensus.cc:2243] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:05.551558 17868 raft_consensus.cc:2272] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.551568 17867 raft_consensus.cc:2243] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:05.551813 17867 raft_consensus.cc:2272] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.551998 17868 ts_tablet_manager.cc:1916] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.552224 17867 ts_tablet_manager.cc:1916] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.552578 17291 catalog_manager.cc:6724] ReplaceTablet: tablet 562701029f4a4988a4a7afd236def25e deleted and replaced by tablet 33e5ff40d6b24f51956d050c23d41eb7
I20251213 09:05:05.552691 17291 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 67) took 2224 ms. Trace:
I20251213 09:05:05.552742 17291 rpcz_store.cc:276] 1213 09:05:03.327876 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.546730 (+2218854us) service_pool.cc:225] Handling call
1213 09:05:05.552681 (+ 5951us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.547489 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.547578 (+ 89us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.547581 (+ 3us) write_op.cc:435] Acquired schema lock
1213 09:05:05.547582 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:05.547644 (+ 62us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.547655 (+ 11us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.547657 (+ 2us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.547708 (+ 51us) tablet.cc:699] Row locks acquired
1213 09:05:05.547709 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:05.547735 (+ 26us) write_op.cc:270] Start()
1213 09:05:05.547759 (+ 24us) write_op.cc:276] Timestamp: P: 1765616705547678 usec, L: 0
1213 09:05:05.547763 (+ 4us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.547870 (+ 107us) log.cc:844] Serialized 659 byte log entry
1213 09:05:05.549388 (+ 1518us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.549473 (+ 85us) write_op.cc:301] APPLY: starting
1213 09:05:05.549487 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.549516 (+ 29us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.549530 (+ 14us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.549607 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.549640 (+ 33us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1213 09:05:05.549644 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:05.549690 (+ 46us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.549738 (+ 48us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.549748 (+ 10us) write_op.cc:454] Released schema lock
1213 09:05:05.549766 (+ 18us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.549825 (+ 59us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.549828 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":41,"apply.run_cpu_time_us":348,"apply.run_wall_time_us":348,"num_ops":2,"prepare.queue_time_us":56,"prepare.run_cpu_time_us":468,"prepare.run_wall_time_us":469,"raft.queue_time_us":120,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":161,"replication_time_us":1605}]]}
I20251213 09:05:05.553509 17291 master_service.cc:954] ReplaceTablet: received request to replace tablet 95c05f1a7c9a4448bd1e171090009768 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:05.554009 17866 tablet_replica.cc:333] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:05.554167 17866 raft_consensus.cc:2243] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:05.554278 17866 raft_consensus.cc:2272] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.554669 17866 ts_tablet_manager.cc:1916] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.556382 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 33e5ff40d6b24f51956d050c23d41eb7 (DEFAULT_TABLE table=default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.556789 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 33e5ff40d6b24f51956d050c23d41eb7 (DEFAULT_TABLE table=default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.556871 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 33e5ff40d6b24f51956d050c23d41eb7 (DEFAULT_TABLE table=default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.557473 17291 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 95c05f1a7c9a4448bd1e171090009768
I20251213 09:05:05.557754 17291 catalog_manager.cc:6724] ReplaceTablet: tablet 95c05f1a7c9a4448bd1e171090009768 deleted and replaced by tablet 5c7ab0cd8c694579824d2d41d0885731
I20251213 09:05:05.557829 17291 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 68) took 2227 ms. Trace:
I20251213 09:05:05.557991 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 95c05f1a7c9a4448bd1e171090009768 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c7ab0cd8c694579824d2d41d0885731) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:05.557988 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 95c05f1a7c9a4448bd1e171090009768 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c7ab0cd8c694579824d2d41d0885731) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:05.557875 17291 rpcz_store.cc:276] 1213 09:05:03.330789 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.553482 (+2222693us) service_pool.cc:225] Handling call
1213 09:05:05.557818 (+ 4336us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.554119 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.554199 (+ 80us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.554203 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:05.554204 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:05.554264 (+ 60us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.554272 (+ 8us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.554275 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.554323 (+ 48us) tablet.cc:699] Row locks acquired
1213 09:05:05.554327 (+ 4us) write_op.cc:260] PREPARE: finished
1213 09:05:05.554348 (+ 21us) write_op.cc:270] Start()
1213 09:05:05.554368 (+ 20us) write_op.cc:276] Timestamp: P: 1765616705554291 usec, L: 0
1213 09:05:05.554370 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.554483 (+ 113us) log.cc:844] Serialized 659 byte log entry
1213 09:05:05.556525 (+ 2042us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.556605 (+ 80us) write_op.cc:301] APPLY: starting
1213 09:05:05.556618 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.556641 (+ 23us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.556653 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.556723 (+ 70us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.556754 (+ 31us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1213 09:05:05.556758 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:05.556804 (+ 46us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.556849 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.556859 (+ 10us) write_op.cc:454] Released schema lock
1213 09:05:05.556862 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.556913 (+ 51us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.556916 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":28,"apply.run_cpu_time_us":307,"apply.run_wall_time_us":307,"mutex_wait_us":460,"num_ops":2,"prepare.queue_time_us":41,"prepare.run_cpu_time_us":451,"prepare.run_wall_time_us":902,"raft.queue_time_us":519,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":2134}]]}
I20251213 09:05:05.558219 17291 master_service.cc:954] ReplaceTablet: received request to replace tablet 61068bc606a641a78e3c61edb25443c1 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:05.558425 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 95c05f1a7c9a4448bd1e171090009768 with delete_type TABLET_DATA_DELETED (replaced by tablet 5c7ab0cd8c694579824d2d41d0885731) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:05.561681 17291 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 61068bc606a641a78e3c61edb25443c1
I20251213 09:05:05.562036 17291 catalog_manager.cc:6724] ReplaceTablet: tablet 61068bc606a641a78e3c61edb25443c1 deleted and replaced by tablet 4828619293414834b2596a782008a5ed
I20251213 09:05:05.562117 17291 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 69) took 2231 ms. Trace:
I20251213 09:05:05.562350 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet 61068bc606a641a78e3c61edb25443c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 4828619293414834b2596a782008a5ed) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:05.562186 17291 rpcz_store.cc:276] 1213 09:05:03.330860 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.558194 (+2227334us) service_pool.cc:225] Handling call
1213 09:05:05.562107 (+ 3913us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.558898 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.558984 (+ 86us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.558989 (+ 5us) write_op.cc:435] Acquired schema lock
1213 09:05:05.558991 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:05.559055 (+ 64us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.559064 (+ 9us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.559067 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.559109 (+ 42us) tablet.cc:699] Row locks acquired
1213 09:05:05.559110 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:05.559157 (+ 47us) write_op.cc:270] Start()
1213 09:05:05.559176 (+ 19us) write_op.cc:276] Timestamp: P: 1765616705559100 usec, L: 0
1213 09:05:05.559178 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.559284 (+ 106us) log.cc:844] Serialized 659 byte log entry
1213 09:05:05.560905 (+ 1621us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.560986 (+ 81us) write_op.cc:301] APPLY: starting
1213 09:05:05.560999 (+ 13us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.561113 (+ 114us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.561128 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.561230 (+ 102us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.561265 (+ 35us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1213 09:05:05.561269 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:05.561322 (+ 53us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.561367 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.561377 (+ 10us) write_op.cc:454] Released schema lock
1213 09:05:05.561381 (+ 4us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.561501 (+ 120us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.561504 (+ 3us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":40,"apply.run_cpu_time_us":505,"apply.run_wall_time_us":506,"num_ops":2,"prepare.queue_time_us":49,"prepare.run_cpu_time_us":461,"prepare.run_wall_time_us":462,"raft.queue_time_us":83,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"replication_time_us":1707}]]}
I20251213 09:05:05.562513 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 61068bc606a641a78e3c61edb25443c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 4828619293414834b2596a782008a5ed) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:05.562604 17291 master_service.cc:954] ReplaceTablet: received request to replace tablet 276f296aafef4965b27c89cb80ae323c from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:05.563838 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 5c7ab0cd8c694579824d2d41d0885731 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.564028 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 61068bc606a641a78e3c61edb25443c1 with delete_type TABLET_DATA_DELETED (replaced by tablet 4828619293414834b2596a782008a5ed) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:05.564944 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 5c7ab0cd8c694579824d2d41d0885731 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.565763 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 5c7ab0cd8c694579824d2d41d0885731 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.567219 17291 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 276f296aafef4965b27c89cb80ae323c
I20251213 09:05:05.567803 17291 catalog_manager.cc:6724] ReplaceTablet: tablet 276f296aafef4965b27c89cb80ae323c deleted and replaced by tablet 3afb8349ced4486d8a283966ac647965
I20251213 09:05:05.567890 17291 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 70) took 2235 ms. Trace:
I20251213 09:05:05.568104 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet 276f296aafef4965b27c89cb80ae323c with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb8349ced4486d8a283966ac647965) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:05.568123 17071 tablet_service.cc:1552] Processing DeleteTablet for tablet 276f296aafef4965b27c89cb80ae323c with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb8349ced4486d8a283966ac647965) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:05.568132 16799 tablet_service.cc:1552] Processing DeleteTablet for tablet 276f296aafef4965b27c89cb80ae323c with delete_type TABLET_DATA_DELETED (replaced by tablet 3afb8349ced4486d8a283966ac647965) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:05.567981 17291 rpcz_store.cc:276] 1213 09:05:03.331971 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.562578 (+2230607us) service_pool.cc:225] Handling call
1213 09:05:05.567878 (+ 5300us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.563919 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.563987 (+ 68us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.563991 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:05.563992 (+ 1us) tablet.cc:660] Decoding operations
1213 09:05:05.564049 (+ 57us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.564056 (+ 7us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.564058 (+ 2us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.564095 (+ 37us) tablet.cc:699] Row locks acquired
1213 09:05:05.564097 (+ 2us) write_op.cc:260] PREPARE: finished
1213 09:05:05.564116 (+ 19us) write_op.cc:270] Start()
1213 09:05:05.564136 (+ 20us) write_op.cc:276] Timestamp: P: 1765616705564059 usec, L: 0
1213 09:05:05.564138 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.564255 (+ 117us) log.cc:844] Serialized 659 byte log entry
1213 09:05:05.566609 (+ 2354us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.566712 (+ 103us) write_op.cc:301] APPLY: starting
1213 09:05:05.566728 (+ 16us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.566752 (+ 24us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.566764 (+ 12us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.566824 (+ 60us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.566853 (+ 29us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1213 09:05:05.566856 (+ 3us) write_op.cc:312] APPLY: finished
1213 09:05:05.566896 (+ 40us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.566943 (+ 47us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.566954 (+ 11us) write_op.cc:454] Released schema lock
1213 09:05:05.566958 (+ 4us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.567019 (+ 61us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.567023 (+ 4us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":52,"apply.run_cpu_time_us":300,"apply.run_wall_time_us":301,"num_ops":2,"prepare.queue_time_us":641,"prepare.run_cpu_time_us":403,"prepare.run_wall_time_us":403,"raft.queue_time_us":164,"raft.run_cpu_time_us":7,"raft.run_wall_time_us":8,"replication_time_us":2448}]]}
I20251213 09:05:05.568375 17291 master_service.cc:954] ReplaceTablet: received request to replace tablet 9c8aa26100c142c490e113579219a3cc from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:05.570258 16936 tablet_service.cc:1505] Processing CreateTablet for tablet 4828619293414834b2596a782008a5ed (DEFAULT_TABLE table=default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.570876 16799 tablet_service.cc:1505] Processing CreateTablet for tablet 4828619293414834b2596a782008a5ed (DEFAULT_TABLE table=default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.571511 17071 tablet_service.cc:1505] Processing CreateTablet for tablet 4828619293414834b2596a782008a5ed (DEFAULT_TABLE table=default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.572571 17291 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 9c8aa26100c142c490e113579219a3cc
I20251213 09:05:05.573076 17291 catalog_manager.cc:6724] ReplaceTablet: tablet 9c8aa26100c142c490e113579219a3cc deleted and replaced by tablet 0450a4a763a64dbaaa59efbfbd924713
I20251213 09:05:05.573099 17070 tablet_service.cc:1552] Processing DeleteTablet for tablet 9c8aa26100c142c490e113579219a3cc with delete_type TABLET_DATA_DELETED (replaced by tablet 0450a4a763a64dbaaa59efbfbd924713) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:05.573153 17291 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 71) took 2241 ms. Trace:
I20251213 09:05:05.573168 16935 tablet_service.cc:1552] Processing DeleteTablet for tablet 9c8aa26100c142c490e113579219a3cc with delete_type TABLET_DATA_DELETED (replaced by tablet 0450a4a763a64dbaaa59efbfbd924713) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:05.573186 17291 rpcz_store.cc:276] 1213 09:05:03.332035 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.568345 (+2236310us) service_pool.cc:225] Handling call
1213 09:05:05.573143 (+ 4798us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.569124 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.569200 (+ 76us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.569203 (+ 3us) write_op.cc:435] Acquired schema lock
1213 09:05:05.569205 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:05.569274 (+ 69us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.569281 (+ 7us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.569284 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.569324 (+ 40us) tablet.cc:699] Row locks acquired
1213 09:05:05.569326 (+ 2us) write_op.cc:260] PREPARE: finished
1213 09:05:05.569350 (+ 24us) write_op.cc:270] Start()
1213 09:05:05.569368 (+ 18us) write_op.cc:276] Timestamp: P: 1765616705569291 usec, L: 0
1213 09:05:05.569369 (+ 1us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.569459 (+ 90us) log.cc:844] Serialized 659 byte log entry
1213 09:05:05.572008 (+ 2549us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.572108 (+ 100us) write_op.cc:301] APPLY: starting
1213 09:05:05.572122 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.572148 (+ 26us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.572164 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.572241 (+ 77us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.572274 (+ 33us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1213 09:05:05.572278 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:05.572322 (+ 44us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.572366 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.572375 (+ 9us) write_op.cc:454] Released schema lock
1213 09:05:05.572378 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.572427 (+ 49us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.572429 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":56,"apply.run_cpu_time_us":316,"apply.run_wall_time_us":316,"num_ops":2,"prepare.queue_time_us":27,"prepare.run_cpu_time_us":405,"prepare.run_wall_time_us":405,"raft.queue_time_us":51,"raft.run_cpu_time_us":4,"raft.run_wall_time_us":4,"replication_time_us":2617}]]}
I20251213 09:05:05.573609 16798 tablet_service.cc:1552] Processing DeleteTablet for tablet 9c8aa26100c142c490e113579219a3cc with delete_type TABLET_DATA_DELETED (replaced by tablet 0450a4a763a64dbaaa59efbfbd924713) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:05.573841 17291 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_82ff078f92894308a9243b01684306d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:05.575616 16935 tablet_service.cc:1505] Processing CreateTablet for tablet 3afb8349ced4486d8a283966ac647965 (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.575991 17070 tablet_service.cc:1505] Processing CreateTablet for tablet 3afb8349ced4486d8a283966ac647965 (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.576304 16798 tablet_service.cc:1505] Processing CreateTablet for tablet 3afb8349ced4486d8a283966ac647965 (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.579636 16934 tablet_service.cc:1505] Processing CreateTablet for tablet 0450a4a763a64dbaaa59efbfbd924713 (DEFAULT_TABLE table=default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.579828 16797 tablet_service.cc:1505] Processing CreateTablet for tablet 0450a4a763a64dbaaa59efbfbd924713 (DEFAULT_TABLE table=default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.580425 17069 tablet_service.cc:1505] Processing CreateTablet for tablet 0450a4a763a64dbaaa59efbfbd924713 (DEFAULT_TABLE table=default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.612462 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e5ff40d6b24f51956d050c23d41eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.612422 17484 raft_consensus.cc:515] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.612944 17484 leader_election.cc:290] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:05.612946 16799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4828619293414834b2596a782008a5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.613443 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0450a4a763a64dbaaa59efbfbd924713. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.613718 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7ab0cd8c694579824d2d41d0885731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.613857 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "604c2f416148499ab5651c43cd1491a1" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:05.613986 17092 raft_consensus.cc:3060] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.615036 17092 raft_consensus.cc:2468] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:05.616423 17069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0450a4a763a64dbaaa59efbfbd924713. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.616561 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7ab0cd8c694579824d2d41d0885731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.616905 16757 leader_election.cc:304] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:05.617043 17071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4828619293414834b2596a782008a5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.617251 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e5ff40d6b24f51956d050c23d41eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.618006 17484 raft_consensus.cc:2804] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:05.618106 17484 raft_consensus.cc:697] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:05.618250 17484 consensus_queue.cc:237] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:05.618983 17287 catalog_manager.cc:2174] created HMS catalog entry for table [id=50e0912ce3374a73b75bad413c427253]
I20251213 09:05:05.619158 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afb8349ced4486d8a283966ac647965. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.619798 17070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afb8349ced4486d8a283966ac647965. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.621536 17842 tablet_bootstrap.cc:492] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.622745 17842 tablet_bootstrap.cc:654] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.623884 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "604c2f416148499ab5651c43cd1491a1" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:05.624001 16957 raft_consensus.cc:3060] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.626185 17842 tablet_bootstrap.cc:492] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.626288 17842 ts_tablet_manager.cc:1403] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:05.626791 17842 raft_consensus.cc:359] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.626899 17842 raft_consensus.cc:385] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.626928 17842 raft_consensus.cc:740] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.627040 17842 consensus_queue.cc:260] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.627343 17842 ts_tablet_manager.cc:1434] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.627539 17842 tablet_bootstrap.cc:492] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.627696 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7ab0cd8c694579824d2d41d0885731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.628067 16934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0450a4a763a64dbaaa59efbfbd924713. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.628533 17842 tablet_bootstrap.cc:654] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.629529 16935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3afb8349ced4486d8a283966ac647965. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.630410 17842 tablet_bootstrap.cc:492] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.630483 17842 ts_tablet_manager.cc:1403] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:05.630800 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e5ff40d6b24f51956d050c23d41eb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.630949 17842 raft_consensus.cc:359] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.631042 17842 raft_consensus.cc:385] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.631079 17842 raft_consensus.cc:740] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.631215 16936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4828619293414834b2596a782008a5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.631217 17842 consensus_queue.cc:260] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.631479 17842 ts_tablet_manager.cc:1434] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.631644 17842 tablet_bootstrap.cc:492] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.632594 17842 tablet_bootstrap.cc:654] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.634759 17287 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 56) took 2891 ms. Trace:
I20251213 09:05:05.634835 17287 rpcz_store.cc:276] 1213 09:05:02.743071 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.104418 (+361347us) service_pool.cc:225] Handling call
1213 09:05:04.315068 (+1210650us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:04.315387 (+ 319us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:05.618974 (+1303587us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:05.634568 (+ 15594us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:05.634658 (+ 90us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:05.634741 (+ 83us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.619842 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.619946 (+ 104us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.619950 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:05.619952 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:05.620026 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.620040 (+ 14us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.620043 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.620101 (+ 58us) tablet.cc:699] Row locks acquired
1213 09:05:05.620102 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:05.620129 (+ 27us) write_op.cc:270] Start()
1213 09:05:05.620155 (+ 26us) write_op.cc:276] Timestamp: P: 1765616705620065 usec, L: 0
1213 09:05:05.620157 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.620290 (+ 133us) log.cc:844] Serialized 433 byte log entry
1213 09:05:05.633947 (+ 13657us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.634042 (+ 95us) write_op.cc:301] APPLY: starting
1213 09:05:05.634060 (+ 18us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.634090 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.634107 (+ 17us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.634190 (+ 83us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.634262 (+ 72us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:05.634268 (+ 6us) write_op.cc:312] APPLY: finished
1213 09:05:05.634335 (+ 67us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.634393 (+ 58us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.634404 (+ 11us) write_op.cc:454] Released schema lock
1213 09:05:05.634409 (+ 5us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.634474 (+ 65us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.634489 (+ 15us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1195014,"Hive Metastore.run_cpu_time_us":197,"Hive Metastore.run_wall_time_us":108419,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":34,"apply.run_cpu_time_us":429,"apply.run_wall_time_us":429,"num_ops":2,"prepare.queue_time_us":288,"prepare.run_cpu_time_us":555,"prepare.run_wall_time_us":554,"raft.queue_time_us":2360,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"replication_time_us":13758}]]}
I20251213 09:05:05.635350 17842 tablet_bootstrap.cc:492] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.635428 17842 ts_tablet_manager.cc:1403] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:05.635913 17842 raft_consensus.cc:359] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.636020 17842 raft_consensus.cc:385] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.636062 17842 raft_consensus.cc:740] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.636176 17842 consensus_queue.cc:260] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.636430 17842 ts_tablet_manager.cc:1434] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.636405 17287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_af6c4a1282d24b2283671da41b9b0400"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:05.636607 17842 tablet_bootstrap.cc:492] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.637960 17842 tablet_bootstrap.cc:654] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.645478 17842 tablet_bootstrap.cc:492] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.645596 17842 ts_tablet_manager.cc:1403] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:05.646126 17842 raft_consensus.cc:359] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.646235 17842 raft_consensus.cc:385] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.646271 17842 raft_consensus.cc:740] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.646410 17842 consensus_queue.cc:260] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.646730 17842 ts_tablet_manager.cc:1434] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.650032 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 13b11eb6cf6b4560b693797ca18292e4 (DEFAULT_TABLE table=default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.650511 16933 tablet_service.cc:1505] Processing CreateTablet for tablet 13b11eb6cf6b4560b693797ca18292e4 (DEFAULT_TABLE table=default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.651643 17068 tablet_service.cc:1505] Processing CreateTablet for tablet 13b11eb6cf6b4560b693797ca18292e4 (DEFAULT_TABLE table=default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.711912 16957 raft_consensus.cc:2468] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:05.712028 17868 ts_tablet_manager.cc:1929] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:05.712025 17866 ts_tablet_manager.cc:1929] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:05.712108 17868 log.cc:1199] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/562701029f4a4988a4a7afd236def25e
I20251213 09:05:05.712121 17866 log.cc:1199] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/562701029f4a4988a4a7afd236def25e
I20251213 09:05:05.712393 17868 ts_tablet_manager.cc:1950] T 562701029f4a4988a4a7afd236def25e P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:05.712419 17866 ts_tablet_manager.cc:1950] T 562701029f4a4988a4a7afd236def25e P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:05.712687 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b11eb6cf6b4560b693797ca18292e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.712741 17867 ts_tablet_manager.cc:1929] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:05.712810 17867 log.cc:1199] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/562701029f4a4988a4a7afd236def25e
I20251213 09:05:05.713078 17867 ts_tablet_manager.cc:1950] T 562701029f4a4988a4a7afd236def25e P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:05.714301 17842 tablet_bootstrap.cc:492] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.715432 17842 tablet_bootstrap.cc:654] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.715863 17844 tablet_bootstrap.cc:492] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.716924 17844 tablet_bootstrap.cc:654] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.717130 17841 tablet_bootstrap.cc:492] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.717585 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b11eb6cf6b4560b693797ca18292e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.717816 17842 tablet_bootstrap.cc:492] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.717900 17842 ts_tablet_manager.cc:1403] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:05.718180 17841 tablet_bootstrap.cc:654] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.718358 17842 raft_consensus.cc:359] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.718472 17842 raft_consensus.cc:385] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.718508 17842 raft_consensus.cc:740] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.718626 17842 consensus_queue.cc:260] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.719779 17842 ts_tablet_manager.cc:1434] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:05.721153 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13b11eb6cf6b4560b693797ca18292e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.721405 17868 tablet_replica.cc:333] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:05.721549 17868 raft_consensus.cc:2243] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:05.721645 17868 raft_consensus.cc:2272] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.721660 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 562701029f4a4988a4a7afd236def25e (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]) successfully deleted
I20251213 09:05:05.722030 17868 ts_tablet_manager.cc:1916] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.722308 17866 tablet_replica.cc:333] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:05.722460 17866 raft_consensus.cc:2243] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:05.722649 17866 raft_consensus.cc:2272] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.722698 17841 tablet_bootstrap.cc:492] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.722792 17841 ts_tablet_manager.cc:1403] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:05.723006 17866 ts_tablet_manager.cc:1916] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.723234 17841 raft_consensus.cc:359] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.723331 17841 raft_consensus.cc:385] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.723361 17841 raft_consensus.cc:740] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.723488 17841 consensus_queue.cc:260] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.723726 17841 ts_tablet_manager.cc:1434] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.723810 17844 tablet_bootstrap.cc:492] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.723884 17844 ts_tablet_manager.cc:1403] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251213 09:05:05.723899 17841 tablet_bootstrap.cc:492] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.724171 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 562701029f4a4988a4a7afd236def25e (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]) successfully deleted
I20251213 09:05:05.724321 17844 raft_consensus.cc:359] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.724426 17844 raft_consensus.cc:385] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.724458 17844 raft_consensus.cc:740] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.724571 17844 consensus_queue.cc:260] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.724740 17842 tablet_bootstrap.cc:492] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.724845 17841 tablet_bootstrap.cc:654] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.724848 17844 ts_tablet_manager.cc:1434] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.725031 17844 tablet_bootstrap.cc:492] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.725853 17842 tablet_bootstrap.cc:654] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.726037 17844 tablet_bootstrap.cc:654] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.727319 17842 tablet_bootstrap.cc:492] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.727394 17842 ts_tablet_manager.cc:1403] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:05.727883 17842 raft_consensus.cc:359] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.728343 17844 tablet_bootstrap.cc:492] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.728411 17844 ts_tablet_manager.cc:1403] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:05.728866 17844 raft_consensus.cc:359] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.728958 17844 raft_consensus.cc:385] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.728988 17844 raft_consensus.cc:740] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.729089 17844 consensus_queue.cc:260] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.729352 17844 ts_tablet_manager.cc:1434] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:05.729516 17844 tablet_bootstrap.cc:492] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.727985 17842 raft_consensus.cc:385] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.730393 17842 raft_consensus.cc:740] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.730512 17733 consensus_queue.cc:1048] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:05.730610 17844 tablet_bootstrap.cc:654] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.730537 17842 consensus_queue.cc:260] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.730886 17842 ts_tablet_manager.cc:1434] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:05.732268 17841 tablet_bootstrap.cc:492] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.732367 17841 ts_tablet_manager.cc:1403] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:05.733103 17841 raft_consensus.cc:359] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.733240 17841 raft_consensus.cc:385] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.733276 17841 raft_consensus.cc:740] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.733381 17841 consensus_queue.cc:260] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.733671 17841 ts_tablet_manager.cc:1434] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:05.733855 17841 tablet_bootstrap.cc:492] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.734357 17844 tablet_bootstrap.cc:492] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.734673 17844 ts_tablet_manager.cc:1403] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:05.735574 17841 tablet_bootstrap.cc:654] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.735736 17844 raft_consensus.cc:359] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.735844 17844 raft_consensus.cc:385] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.735886 17844 raft_consensus.cc:740] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.735991 17844 consensus_queue.cc:260] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.736236 17733 consensus_queue.cc:1048] T aa2cb21fb1a64b9d9c13d31cb9f49a5e P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:05.736244 17844 ts_tablet_manager.cc:1434] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:05.738926 17844 tablet_bootstrap.cc:492] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.738993 17841 tablet_bootstrap.cc:492] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.739077 17841 ts_tablet_manager.cc:1403] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:05.740371 17844 tablet_bootstrap.cc:654] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.740316 17841 raft_consensus.cc:359] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.740428 17841 raft_consensus.cc:385] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.740474 17841 raft_consensus.cc:740] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.740618 17841 consensus_queue.cc:260] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.741009 17841 ts_tablet_manager.cc:1434] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251213 09:05:05.741331 17841 tablet_bootstrap.cc:492] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.741555 17844 tablet_bootstrap.cc:492] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.741626 17844 ts_tablet_manager.cc:1403] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:05.742089 17844 raft_consensus.cc:359] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.742175 17844 raft_consensus.cc:385] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.742237 17844 raft_consensus.cc:740] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.742319 17841 tablet_bootstrap.cc:654] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.742380 17844 consensus_queue.cc:260] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.742703 17844 ts_tablet_manager.cc:1434] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.742877 17844 tablet_bootstrap.cc:492] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.743830 17844 tablet_bootstrap.cc:654] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.744419 17841 tablet_bootstrap.cc:492] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.744565 17841 ts_tablet_manager.cc:1403] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251213 09:05:05.744910 17844 tablet_bootstrap.cc:492] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.744999 17844 ts_tablet_manager.cc:1403] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251213 09:05:05.745052 17841 raft_consensus.cc:359] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.745170 17841 raft_consensus.cc:385] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.745215 17841 raft_consensus.cc:740] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.745339 17841 consensus_queue.cc:260] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.745467 17844 raft_consensus.cc:359] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.745568 17844 raft_consensus.cc:385] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.745601 17844 raft_consensus.cc:740] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.745713 17844 consensus_queue.cc:260] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.745985 17844 ts_tablet_manager.cc:1434] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:05.746155 17844 tablet_bootstrap.cc:492] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.745636 17841 ts_tablet_manager.cc:1434] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:05.747304 17844 tablet_bootstrap.cc:654] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.747309 17867 tablet_replica.cc:333] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:05.747439 17867 raft_consensus.cc:2243] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:05.747562 17867 raft_consensus.cc:2272] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.747988 17867 ts_tablet_manager.cc:1916] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.748198 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 562701029f4a4988a4a7afd236def25e (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]) successfully deleted
I20251213 09:05:05.748314 17841 tablet_bootstrap.cc:492] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.748495 17844 tablet_bootstrap.cc:492] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.748608 17844 ts_tablet_manager.cc:1403] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251213 09:05:05.749119 17844 raft_consensus.cc:359] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.749205 17841 tablet_bootstrap.cc:654] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.749306 17844 raft_consensus.cc:385] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.749389 17844 raft_consensus.cc:740] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.749557 17844 consensus_queue.cc:260] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.750437 17844 ts_tablet_manager.cc:1434] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:05.750610 17841 tablet_bootstrap.cc:492] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.750698 17841 ts_tablet_manager.cc:1403] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:05.751191 17841 raft_consensus.cc:359] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.751879 17841 raft_consensus.cc:385] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.751924 17841 raft_consensus.cc:740] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.752063 17841 consensus_queue.cc:260] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.752359 17841 ts_tablet_manager.cc:1434] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:05.752593 17841 tablet_bootstrap.cc:492] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.754148 17841 tablet_bootstrap.cc:654] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.756001 17841 tablet_bootstrap.cc:492] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.756115 17841 ts_tablet_manager.cc:1403] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:05.756584 17841 raft_consensus.cc:359] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.756685 17841 raft_consensus.cc:385] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.756718 17841 raft_consensus.cc:740] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.756814 17841 consensus_queue.cc:260] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.757012 17841 ts_tablet_manager.cc:1434] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:05.761978 17875 raft_consensus.cc:493] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:05.762084 17875 raft_consensus.cc:515] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.762457 17875 leader_election.cc:290] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.762756 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3afb8349ced4486d8a283966ac647965" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:05.762844 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3afb8349ced4486d8a283966ac647965" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:05.762904 16820 raft_consensus.cc:2468] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:05.762976 17092 raft_consensus.cc:2468] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:05.763307 16894 leader_election.cc:304] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:05.763486 17875 raft_consensus.cc:2804] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:05.763561 17875 raft_consensus.cc:493] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:05.763609 17875 raft_consensus.cc:3060] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.766635 17757 raft_consensus.cc:493] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:05.766706 17757 raft_consensus.cc:515] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.766955 17757 leader_election.cc:290] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.767346 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c7ab0cd8c694579824d2d41d0885731" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:05.767354 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c7ab0cd8c694579824d2d41d0885731" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:05.767495 16820 raft_consensus.cc:2468] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:05.767495 17092 raft_consensus.cc:2468] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:05.767786 16894 leader_election.cc:304] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:05.767952 17757 raft_consensus.cc:2804] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:05.768008 17757 raft_consensus.cc:493] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:05.768054 17757 raft_consensus.cc:3060] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.800844 17850 raft_consensus.cc:493] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:05.800964 17850 raft_consensus.cc:515] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.801349 17850 leader_election.cc:290] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.801740 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4828619293414834b2596a782008a5ed" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:05.801795 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4828619293414834b2596a782008a5ed" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:05.801883 17092 raft_consensus.cc:2468] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:05.801982 16957 raft_consensus.cc:2468] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:05.802165 16757 leader_election.cc:304] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:05.802335 17850 raft_consensus.cc:2804] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:05.802433 17850 raft_consensus.cc:493] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:05.802479 17850 raft_consensus.cc:3060] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.811362 17866 ts_tablet_manager.cc:1929] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:05.811362 17868 ts_tablet_manager.cc:1929] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:05.811441 17866 log.cc:1199] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/95c05f1a7c9a4448bd1e171090009768
I20251213 09:05:05.811441 17868 log.cc:1199] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/95c05f1a7c9a4448bd1e171090009768
I20251213 09:05:05.811703 17866 ts_tablet_manager.cc:1950] T 95c05f1a7c9a4448bd1e171090009768 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:05.811703 17868 ts_tablet_manager.cc:1950] T 95c05f1a7c9a4448bd1e171090009768 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:05.811707 17867 ts_tablet_manager.cc:1929] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:05.811800 17867 log.cc:1199] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/95c05f1a7c9a4448bd1e171090009768
I20251213 09:05:05.812044 17867 ts_tablet_manager.cc:1950] T 95c05f1a7c9a4448bd1e171090009768 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:05.812124 17850 raft_consensus.cc:515] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.812263 17875 raft_consensus.cc:515] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.812350 17866 tablet_replica.cc:333] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:05.812489 17866 raft_consensus.cc:2243] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:05.812508 17850 leader_election.cc:290] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.812597 17866 raft_consensus.cc:2272] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.812696 17875 leader_election.cc:290] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.812956 17866 ts_tablet_manager.cc:1916] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.813550 17757 raft_consensus.cc:515] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.813860 17757 leader_election.cc:290] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.815057 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 95c05f1a7c9a4448bd1e171090009768 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]) successfully deleted
I20251213 09:05:05.815843 17091 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c7ab0cd8c694579824d2d41d0885731" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:05.815966 17091 raft_consensus.cc:3060] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.816555 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3afb8349ced4486d8a283966ac647965" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:05.816660 17092 raft_consensus.cc:3060] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.816767 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4828619293414834b2596a782008a5ed" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:05.816843 17093 raft_consensus.cc:3060] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.817332 17868 tablet_replica.cc:333] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:05.817423 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 95c05f1a7c9a4448bd1e171090009768 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]) successfully deleted
I20251213 09:05:05.817466 17868 raft_consensus.cc:2243] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:05.817636 17868 raft_consensus.cc:2272] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.817790 17867 tablet_replica.cc:333] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:05.817975 17868 ts_tablet_manager.cc:1916] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.818204 17292 catalog_manager.cc:2174] created HMS catalog entry for table [id=c5c8c2c3dae848b1afff2fc38230a65f]
I20251213 09:05:05.818487 17850 raft_consensus.cc:493] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:05.818562 17850 raft_consensus.cc:515] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.818871 17850 leader_election.cc:290] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.819212 17867 raft_consensus.cc:2243] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:05.819314 17867 raft_consensus.cc:2272] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.819613 17733 raft_consensus.cc:493] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:05.819702 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 95c05f1a7c9a4448bd1e171090009768 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]) successfully deleted
I20251213 09:05:05.819717 17733 raft_consensus.cc:515] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.819868 17867 ts_tablet_manager.cc:1916] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.819977 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0450a4a763a64dbaaa59efbfbd924713" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:05.820050 17733 leader_election.cc:290] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:05.820072 16958 raft_consensus.cc:2468] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:05.820188 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4828619293414834b2596a782008a5ed" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:05.820299 16957 raft_consensus.cc:3060] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.820483 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13b11eb6cf6b4560b693797ca18292e4" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:05.820585 16820 raft_consensus.cc:2468] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:05.820888 17026 leader_election.cc:304] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:05.820930 16756 leader_election.cc:304] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:05.821066 17850 raft_consensus.cc:2804] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:05.821108 17850 raft_consensus.cc:493] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:05.821142 17850 raft_consensus.cc:3060] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.821137 17733 raft_consensus.cc:2804] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:05.821190 17733 raft_consensus.cc:493] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:05.821226 17733 raft_consensus.cc:3060] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.821434 17090 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0450a4a763a64dbaaa59efbfbd924713" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:05.821525 17090 raft_consensus.cc:2468] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:05.821878 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3afb8349ced4486d8a283966ac647965" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:05.821903 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5c7ab0cd8c694579824d2d41d0885731" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:05.821967 16820 raft_consensus.cc:3060] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.822002 16819 raft_consensus.cc:3060] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.824466 17292 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 59) took 2832 ms. Trace:
I20251213 09:05:05.824537 17292 rpcz_store.cc:276] 1213 09:05:02.992465 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:03.691053 (+698588us) service_pool.cc:225] Handling call
1213 09:05:04.350406 (+659353us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:04.350758 (+ 352us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:05.818197 (+1467439us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:05.824294 (+ 6097us) catalog_manager.cc:2207] Wrote table and tablets to system table
1213 09:05:05.824380 (+ 86us) catalog_manager.cc:2241] Inserted table and tablets into CatalogManager maps
1213 09:05:05.824452 (+ 72us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:05.818716 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1213 09:05:05.818835 (+ 119us) write_op.cc:432] Acquiring schema lock in shared mode
1213 09:05:05.818839 (+ 4us) write_op.cc:435] Acquired schema lock
1213 09:05:05.818841 (+ 2us) tablet.cc:660] Decoding operations
1213 09:05:05.818915 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
1213 09:05:05.818923 (+ 8us) write_op.cc:641] Partition lock acquired for write op
1213 09:05:05.818926 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1213 09:05:05.818975 (+ 49us) tablet.cc:699] Row locks acquired
1213 09:05:05.818976 (+ 1us) write_op.cc:260] PREPARE: finished
1213 09:05:05.819002 (+ 26us) write_op.cc:270] Start()
1213 09:05:05.819026 (+ 24us) write_op.cc:276] Timestamp: P: 1765616705818964 usec, L: 0
1213 09:05:05.819028 (+ 2us) op_driver.cc:348] REPLICATION: starting
1213 09:05:05.819179 (+ 151us) log.cc:844] Serialized 433 byte log entry
1213 09:05:05.823473 (+ 4294us) op_driver.cc:464] REPLICATION: finished
1213 09:05:05.823582 (+ 109us) write_op.cc:301] APPLY: starting
1213 09:05:05.823596 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
1213 09:05:05.823626 (+ 30us) tablet.cc:1368] finished BulkCheckPresence
1213 09:05:05.823642 (+ 16us) tablet.cc:1370] starting ApplyRowOperation cycle
1213 09:05:05.823709 (+ 67us) tablet.cc:1381] finished ApplyRowOperation cycle
1213 09:05:05.823736 (+ 27us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1213 09:05:05.823740 (+ 4us) write_op.cc:312] APPLY: finished
1213 09:05:05.823793 (+ 53us) log.cc:844] Serialized 29 byte log entry
1213 09:05:05.823836 (+ 43us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.823859 (+ 23us) write_op.cc:454] Released schema lock
1213 09:05:05.823863 (+ 4us) write_op.cc:341] FINISH: Updating metrics
1213 09:05:05.823931 (+ 68us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:05.823933 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"Hive Metastore.queue_time_us":1277498,"Hive Metastore.run_cpu_time_us":165,"Hive Metastore.run_wall_time_us":188861,"child_traces":[["op",{"apply.queue_time_us":71,"apply.run_cpu_time_us":342,"apply.run_wall_time_us":342,"num_ops":2,"prepare.queue_time_us":53,"prepare.run_cpu_time_us":556,"prepare.run_wall_time_us":556,"raft.queue_time_us":128,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":151,"replication_time_us":4404}]]}
I20251213 09:05:05.827126 16958 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13b11eb6cf6b4560b693797ca18292e4" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:05.827280 16958 raft_consensus.cc:2468] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:05.830489 16936 tablet_service.cc:1505] Processing CreateTablet for tablet ecd3bbba1b1b4529bfea1fac9ca704bf (DEFAULT_TABLE table=default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.830922 16801 tablet_service.cc:1505] Processing CreateTablet for tablet ecd3bbba1b1b4529bfea1fac9ca704bf (DEFAULT_TABLE table=default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.831248 17070 tablet_service.cc:1505] Processing CreateTablet for tablet ecd3bbba1b1b4529bfea1fac9ca704bf (DEFAULT_TABLE table=default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:05.831260 17292 catalog_manager.cc:5654] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:05.831538 17292 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
W20251213 09:05:05.835201 17292 catalog_manager.cc:5846] Failed to send AlterTable RPC for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 0450a4a763a64dbaaa59efbfbd924713 consensus state has no leader
I20251213 09:05:05.837286 17292 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_cfb419171a574069b4e41856a31a16f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:05.853623 17757 raft_consensus.cc:493] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:05.853746 17757 raft_consensus.cc:515] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.854176 17757 leader_election.cc:290] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.854629 16821 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33e5ff40d6b24f51956d050c23d41eb7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:05.854629 17090 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33e5ff40d6b24f51956d050c23d41eb7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:05.854773 16821 raft_consensus.cc:2468] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:05.854773 17090 raft_consensus.cc:2468] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:05.855060 16891 leader_election.cc:304] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:05.855300 17757 raft_consensus.cc:2804] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:05.855382 17757 raft_consensus.cc:493] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:05.855425 17757 raft_consensus.cc:3060] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.875931 17866 ts_tablet_manager.cc:1929] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:05.875931 17070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd3bbba1b1b4529bfea1fac9ca704bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.876034 17866 log.cc:1199] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/61068bc606a641a78e3c61edb25443c1
I20251213 09:05:05.876237 17866 ts_tablet_manager.cc:1950] T 61068bc606a641a78e3c61edb25443c1 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
W20251213 09:05:05.894244 17282 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0450a4a763a64dbaaa59efbfbd924713 consensus state has no leader
I20251213 09:05:05.897286 17834 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:05.897465 17834 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:05.905855 17091 raft_consensus.cc:2468] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:05.906150 17850 raft_consensus.cc:515] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.906283 16936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd3bbba1b1b4529bfea1fac9ca704bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.906584 17850 leader_election.cc:290] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:05.906759 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecd3bbba1b1b4529bfea1fac9ca704bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:05.907269 16957 raft_consensus.cc:2468] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:05.907567 17093 raft_consensus.cc:2468] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:05.908708 17841 tablet_bootstrap.cc:492] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:05.909451 17092 raft_consensus.cc:2468] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:05.909684 16820 raft_consensus.cc:2468] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:05.909986 17842 tablet_bootstrap.cc:492] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:05.910341 17841 tablet_bootstrap.cc:654] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.910748 17733 raft_consensus.cc:515] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.911096 17842 tablet_bootstrap.cc:654] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.912460 16819 raft_consensus.cc:2468] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:05.912541 17867 ts_tablet_manager.cc:1929] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:05.912609 17867 log.cc:1199] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/61068bc606a641a78e3c61edb25443c1
I20251213 09:05:05.912689 16894 leader_election.cc:304] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:05.912853 17867 ts_tablet_manager.cc:1950] T 61068bc606a641a78e3c61edb25443c1 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:05.912876 17733 leader_election.cc:290] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:05.912885 16894 leader_election.cc:304] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:05.913106 17874 raft_consensus.cc:2804] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:05.913277 17874 raft_consensus.cc:697] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:05.913434 17874 consensus_queue.cc:237] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.913920 17842 tablet_bootstrap.cc:492] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:05.913996 17842 ts_tablet_manager.cc:1403] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:05.914083 17874 raft_consensus.cc:2804] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:05.914149 17874 raft_consensus.cc:697] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:05.914263 17874 consensus_queue.cc:237] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.914379 17866 tablet_replica.cc:333] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:05.914511 17866 raft_consensus.cc:2243] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:05.914444 17842 raft_consensus.cc:359] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:05.914567 17842 raft_consensus.cc:385] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.914601 17842 raft_consensus.cc:740] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.914604 17866 raft_consensus.cc:2272] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.914702 17842 consensus_queue.cc:260] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:05.914749 16757 leader_election.cc:304] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:05.914956 17866 ts_tablet_manager.cc:1916] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:05.915014 17842 ts_tablet_manager.cc:1434] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:05.915122 17484 raft_consensus.cc:2804] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:05.915210 17484 raft_consensus.cc:697] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:05.915334 17484 consensus_queue.cc:237] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:05.915958 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13b11eb6cf6b4560b693797ca18292e4" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:05.916069 16957 raft_consensus.cc:3060] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.916049 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0450a4a763a64dbaaa59efbfbd924713" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:05.916145 17092 raft_consensus.cc:3060] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.916915 17844 tablet_bootstrap.cc:492] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:05.917778 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "13b11eb6cf6b4560b693797ca18292e4" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:05.917906 17844 tablet_bootstrap.cc:654] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:05.917899 16819 raft_consensus.cc:3060] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.917936 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 61068bc606a641a78e3c61edb25443c1 (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]) successfully deleted
I20251213 09:05:05.919134 17844 tablet_bootstrap.cc:492] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:05.919382 17844 ts_tablet_manager.cc:1403] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251213 09:05:05.919888 17844 raft_consensus.cc:359] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:05.919977 17844 raft_consensus.cc:385] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.920007 17844 raft_consensus.cc:740] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.920117 17844 consensus_queue.cc:260] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:05.920221 17841 tablet_bootstrap.cc:492] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:05.920308 17841 ts_tablet_manager.cc:1403] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251213 09:05:05.920809 17841 raft_consensus.cc:359] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:05.920902 17841 raft_consensus.cc:385] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:05.920941 17841 raft_consensus.cc:740] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:05.920956 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0450a4a763a64dbaaa59efbfbd924713" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:05.921054 16956 raft_consensus.cc:3060] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:05.921140 17844 ts_tablet_manager.cc:1434] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251213 09:05:05.921077 17841 consensus_queue.cc:260] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:05.921547 17841 ts_tablet_manager.cc:1434] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:05.987071 17867 tablet_replica.cc:333] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:05.987273 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 61068bc606a641a78e3c61edb25443c1 (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]) successfully deleted
I20251213 09:05:05.987336 17867 raft_consensus.cc:2243] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:05.987468 17867 raft_consensus.cc:2272] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:05.987902 17867 ts_tablet_manager.cc:1916] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:06.005703 16957 raft_consensus.cc:2468] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:06.005791 17868 ts_tablet_manager.cc:1929] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:06.005887 17868 log.cc:1199] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/61068bc606a641a78e3c61edb25443c1
I20251213 09:05:06.006146 17868 ts_tablet_manager.cc:1950] T 61068bc606a641a78e3c61edb25443c1 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:06.006376 16819 raft_consensus.cc:2468] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:06.006420 17028 leader_election.cc:304] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:06.006742 17733 raft_consensus.cc:2804] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:06.006830 17733 raft_consensus.cc:697] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:06.006996 17733 consensus_queue.cc:237] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:06.008140 17092 raft_consensus.cc:2468] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:06.008785 17757 raft_consensus.cc:515] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:06.009148 16956 raft_consensus.cc:2468] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:06.009182 17757 leader_election.cc:290] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:06.010454 16757 leader_election.cc:304] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:06.010485 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33e5ff40d6b24f51956d050c23d41eb7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:06.010589 17092 raft_consensus.cc:3060] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:06.010702 17484 raft_consensus.cc:2804] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:06.010798 17484 raft_consensus.cc:697] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:06.010924 17484 consensus_queue.cc:237] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:06.012449 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33e5ff40d6b24f51956d050c23d41eb7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:06.012560 16819 raft_consensus.cc:3060] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:06.012660 17868 tablet_replica.cc:333] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:06.012811 17868 raft_consensus.cc:2243] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:06.012854 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 61068bc606a641a78e3c61edb25443c1 (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]) successfully deleted
I20251213 09:05:06.012984 17868 raft_consensus.cc:2272] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:06.013186 17866 ts_tablet_manager.cc:1929] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:06.013257 17866 log.cc:1199] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/276f296aafef4965b27c89cb80ae323c
I20251213 09:05:06.013453 17868 ts_tablet_manager.cc:1916] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:06.013528 17866 ts_tablet_manager.cc:1950] T 276f296aafef4965b27c89cb80ae323c P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:06.021973 17867 ts_tablet_manager.cc:1929] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:06.022087 17867 log.cc:1199] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/276f296aafef4965b27c89cb80ae323c
I20251213 09:05:06.022374 17867 ts_tablet_manager.cc:1950] T 276f296aafef4965b27c89cb80ae323c P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:06.048995 17850 raft_consensus.cc:493] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:06.049116 17850 raft_consensus.cc:515] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:06.049470 17850 leader_election.cc:290] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:06.049918 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ecd3bbba1b1b4529bfea1fac9ca704bf" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:06.049913 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ecd3bbba1b1b4529bfea1fac9ca704bf" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:06.050064 17093 raft_consensus.cc:2468] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:06.050064 16956 raft_consensus.cc:2468] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:06.050386 16756 leader_election.cc:304] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:06.050566 17850 raft_consensus.cc:2804] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:06.050637 17850 raft_consensus.cc:493] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:06.050693 17850 raft_consensus.cc:3060] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:06.053155 17867 tablet_replica.cc:333] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:06.053252 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 276f296aafef4965b27c89cb80ae323c (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]) successfully deleted
I20251213 09:05:06.053315 17867 raft_consensus.cc:2243] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:06.053504 17867 raft_consensus.cc:2272] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:06.053870 17867 ts_tablet_manager.cc:1916] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:06.102653 17092 raft_consensus.cc:2468] T 33e5ff40d6b24f51956d050c23d41eb7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:06.103744 17866 tablet_replica.cc:333] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:06.103941 17866 raft_consensus.cc:2243] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:06.104090 17866 raft_consensus.cc:2272] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:06.104606 17866 ts_tablet_manager.cc:1916] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:06.105731 17290 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]
I20251213 09:05:06.106209 17484 consensus_queue.cc:1048] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.106801 16819 raft_consensus.cc:2468] T 33e5ff40d6b24f51956d050c23d41eb7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:06.107191 16891 leader_election.cc:304] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:06.107576 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 276f296aafef4965b27c89cb80ae323c (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]) successfully deleted
I20251213 09:05:06.108057 17757 raft_consensus.cc:2804] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:06.108179 17757 raft_consensus.cc:697] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:06.108348 17757 consensus_queue.cc:237] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:06.113059 17358 catalog_manager.cc:2772] Deleting table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df] in response to Hive Metastore notification log event 64
I20251213 09:05:06.114878 17484 consensus_queue.cc:1048] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.117934 17358 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet eef16afe8d5c4a6babb602765783b8c6
W20251213 09:05:06.118687 17288 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_e3c10aee5e2044a5b15b49197906acde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:06.119083 17287 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_af6c4a1282d24b2283671da41b9b0400 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:06.119720 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet eef16afe8d5c4a6babb602765783b8c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:06 UTC) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:06.119964 17070 tablet_service.cc:1552] Processing DeleteTablet for tablet eef16afe8d5c4a6babb602765783b8c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:06 UTC) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:06.120545 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet eef16afe8d5c4a6babb602765783b8c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:06 UTC) from {username='slave'} at 127.0.0.1:51876
W20251213 09:05:06.120262 17291 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_82ff078f92894308a9243b01684306d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:06.174206 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.60:37605
--webserver_interface=127.15.213.60
--webserver_port=39639
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251213 09:05:06.199461 17850 raft_consensus.cc:515] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:06.199934 17850 leader_election.cc:290] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:06.200291 17866 ts_tablet_manager.cc:1929] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:06.200372 17866 log.cc:1199] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/9c8aa26100c142c490e113579219a3cc
I20251213 09:05:06.200631 17866 ts_tablet_manager.cc:1950] T 9c8aa26100c142c490e113579219a3cc P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:06.200949 17868 ts_tablet_manager.cc:1929] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:06.201025 17868 log.cc:1199] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/276f296aafef4965b27c89cb80ae323c
I20251213 09:05:06.201260 17868 ts_tablet_manager.cc:1950] T 276f296aafef4965b27c89cb80ae323c P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:06.202081 17867 ts_tablet_manager.cc:1929] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:06.202160 17867 log.cc:1199] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/9c8aa26100c142c490e113579219a3cc
I20251213 09:05:06.202399 17867 ts_tablet_manager.cc:1950] T 9c8aa26100c142c490e113579219a3cc P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:06.202927 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ecd3bbba1b1b4529bfea1fac9ca704bf" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:06.203064 16956 raft_consensus.cc:3060] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:06.203068 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ecd3bbba1b1b4529bfea1fac9ca704bf" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:06.203212 17093 raft_consensus.cc:3060] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:06.208104 17866 tablet_replica.cc:333] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:06.208245 17866 raft_consensus.cc:2243] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:06.208228 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 9c8aa26100c142c490e113579219a3cc (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]) successfully deleted
I20251213 09:05:06.208334 17866 raft_consensus.cc:2272] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:06.208719 17866 ts_tablet_manager.cc:1916] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:06.240684 17868 tablet_replica.cc:333] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:06.240685 17867 tablet_replica.cc:333] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:06.240859 17868 raft_consensus.cc:2243] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:06.240871 17867 raft_consensus.cc:2243] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:06.240869 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 276f296aafef4965b27c89cb80ae323c (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]) successfully deleted
I20251213 09:05:06.240980 17867 raft_consensus.cc:2272] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:06.240988 17868 raft_consensus.cc:2272] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:06.241204 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 9c8aa26100c142c490e113579219a3cc (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]) successfully deleted
I20251213 09:05:06.241345 17867 ts_tablet_manager.cc:1916] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:06.242020 17868 ts_tablet_manager.cc:1916] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251213 09:05:06.289513 17910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:05:06.289785 17910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:05:06.289853 17910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:05:06.293309 17910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:05:06.293390 17910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:05:06.293426 17910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:05:06.293466 17910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:05:06.297760 17910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.60:37605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.213.60
--webserver_port=39639
--never_fsync=true
--heap_profile_path=/tmp/kudu.17910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:05:06.298969 17910 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:05:06.299868 17093 raft_consensus.cc:2468] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:06.300472 17910 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251213 09:05:06.304610 16956 raft_consensus.cc:2468] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:06.305752 16757 leader_election.cc:304] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:06.306006 17850 raft_consensus.cc:2804] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:06.306092 17850 raft_consensus.cc:697] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:06.306236 17850 consensus_queue.cc:237] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:06.311465 17289 catalog_manager.cc:3485] renamed table default.table_2d8ae593f178467881752483962712b3 [id=6d12506ceb06414dbd055e0a048c1907] in HMS: new name default.table_9875930af7074cd8b3baeb132c88b19a
I20251213 09:05:06.320173 17866 ts_tablet_manager.cc:1929] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:06.320298 17866 log.cc:1199] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/eef16afe8d5c4a6babb602765783b8c6
I20251213 09:05:06.320609 17866 ts_tablet_manager.cc:1950] T eef16afe8d5c4a6babb602765783b8c6 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
W20251213 09:05:06.324229 17292 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_cfb419171a574069b4e41856a31a16f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:06.324566 17290 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58844 (request call id 60) took 3297 ms. Trace:
I20251213 09:05:06.324623 17290 rpcz_store.cc:276] 1213 09:05:03.026609 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:04.125677 (+1099068us) service_pool.cc:225] Handling call
1213 09:05:04.352745 (+227068us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:06.324552 (+1971807us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":1464403,"Hive Metastore.run_cpu_time_us":144,"Hive Metastore.run_wall_time_us":288299}
I20251213 09:05:06.326176 17290 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
I20251213 09:05:06.329515 17290 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
I20251213 09:05:06.332355 17290 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
I20251213 09:05:06.335713 17290 catalog_manager.cc:5654] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce reported cstate change: term changed from 0 to 1, leader changed from <none> to 9714e48438da4ed8b629934850b1f7ce (127.15.213.3). New cstate: current_term: 1 leader_uuid: "9714e48438da4ed8b629934850b1f7ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:06.338486 17925 tablet.cc:1722] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251213 09:05:06.339162 17917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:06.339262 17910 server_base.cc:1047] running on GCE node
W20251213 09:05:06.339169 17919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:06.339586 17926 tablet.cc:1722] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:06.340292 17899 consensus_queue.cc:1048] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.340677 17867 ts_tablet_manager.cc:1929] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:06.340754 17867 log.cc:1199] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/eef16afe8d5c4a6babb602765783b8c6
I20251213 09:05:06.341039 17867 ts_tablet_manager.cc:1950] T eef16afe8d5c4a6babb602765783b8c6 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:06.341640 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet eef16afe8d5c4a6babb602765783b8c6 (table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]) successfully deleted
I20251213 09:05:06.343111 17899 consensus_queue.cc:1048] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251213 09:05:06.345275 17916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:06.346074 17910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:05:06.347442 17910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:05:06.349593 17927 tablet.cc:1722] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:06.350164 17290 catalog_manager.cc:5654] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:06.350533 17290 catalog_manager.cc:5654] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:06.350749 17290 catalog_manager.cc:5746] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147) does not have the latest schema for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]). Expected version 1 got 0
I20251213 09:05:06.350946 17290 catalog_manager.cc:5654] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:06.354887 17910 hybrid_clock.cc:648] HybridClock initialized: now 1765616706354808 us; error 97 us; skew 500 ppm
I20251213 09:05:06.357388 17910 webserver.cc:492] Webserver started at http://127.15.213.60:39639/ using document root <none> and password file <none>
I20251213 09:05:06.358147 17910 fs_manager.cc:362] Metadata directory not provided
I20251213 09:05:06.358227 17910 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:05:06.359576 17757 consensus_queue.cc:1048] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.362319 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet eef16afe8d5c4a6babb602765783b8c6 (table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]) successfully deleted
I20251213 09:05:06.363767 17899 consensus_queue.cc:1048] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.367331 17910 fs_manager.cc:714] Time spent opening directory manager: real 0.007s user 0.003s sys 0.000s
I20251213 09:05:06.369026 17290 catalog_manager.cc:5654] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:06.369282 17290 catalog_manager.cc:5654] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:06.369482 17290 catalog_manager.cc:5654] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:06.371565 17936 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:05:06.373091 17910 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20251213 09:05:06.373297 17910 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
uuid: "d7f61ccb4ffd4066babfa94938e28b87"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:05:06.373857 17910 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:05:06.380040 17290 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_a211b679083e4e4294bf4c97874b2d60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:06.395296 17910 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:05:06.395918 17910 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:05:06.396093 17910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:05:06.396648 17868 ts_tablet_manager.cc:1929] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:06.396734 17868 log.cc:1199] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/9c8aa26100c142c490e113579219a3cc
I20251213 09:05:06.397001 17868 ts_tablet_manager.cc:1950] T 9c8aa26100c142c490e113579219a3cc P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:06.404191 17868 tablet_replica.cc:333] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:06.404378 17868 raft_consensus.cc:2243] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:06.404485 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 9c8aa26100c142c490e113579219a3cc (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]) successfully deleted
I20251213 09:05:06.404603 17868 raft_consensus.cc:2272] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:06.405045 17868 ts_tablet_manager.cc:1916] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:06.420260 17209 consensus_queue.cc:1048] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.424269 17733 consensus_queue.cc:1048] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.430987 17908 consensus_queue.cc:1048] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.433811 17908 consensus_queue.cc:1048] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.468703 17927 tablet.cc:1722] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:06.469153 17926 tablet.cc:1722] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:06.470227 17925 tablet.cc:1722] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251213 09:05:06.497584 17992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.60:37605 every 8 connection(s)
I20251213 09:05:06.497591 17910 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.60:37605
I20251213 09:05:06.503595 17910 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
I20251213 09:05:06.510468 17995 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:05:06.511914 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 17910
I20251213 09:05:06.513003 17868 ts_tablet_manager.cc:1929] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:06.513116 17868 log.cc:1199] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/eef16afe8d5c4a6babb602765783b8c6
I20251213 09:05:06.513378 17868 ts_tablet_manager.cc:1950] T eef16afe8d5c4a6babb602765783b8c6 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:06.513536 17004 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:05:06.513919 17139 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:05:06.514276 17995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Bootstrap starting.
I20251213 09:05:06.516893 17850 consensus_queue.cc:1048] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.521420 17484 consensus_queue.cc:1048] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.530967 16868 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:05:06.535825 17995 log.cc:826] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Log is configured to *not* fsync() on all Append() calls
I20251213 09:05:06.556810 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet eef16afe8d5c4a6babb602765783b8c6 (table default.table_cf83acd5b1a641a192b2c9592488faca [id=f579b0c783bd4db4920fe2246c04d0df]) successfully deleted
I20251213 09:05:06.592725 17899 consensus_queue.cc:1048] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.596673 17004 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:05:06.596637 17875 consensus_queue.cc:1048] T 33e5ff40d6b24f51956d050c23d41eb7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.603008 17139 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:05:06.632041 17995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Bootstrap replayed 1/1 log segments. Stats: ops{read=187 overwritten=0 applied=187 ignored=0} inserts{seen=121 ignored=0} mutations{seen=161 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251213 09:05:06.632453 17995 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Bootstrap complete.
I20251213 09:05:06.636013 17995 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:06.636478 17995 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7f61ccb4ffd4066babfa94938e28b87, State: Initialized, Role: FOLLOWER
I20251213 09:05:06.636994 17995 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 187, Last appended: 2.187, Last appended by leader: 187, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:06.637444 18002 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:06.637573 18002 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:06.638165 17995 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:05:06.644955 18016 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:06.645062 18016 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: loading cluster ID for follower catalog manager: success
I20251213 09:05:06.648245 18016 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: acquiring CA information for follower catalog manager: success
I20251213 09:05:06.651613 18016 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:05:06.693562 17484 consensus_queue.cc:1048] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.698400 17953 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:39967; Asking this server to re-register.
I20251213 09:05:06.698734 17908 consensus_queue.cc:1048] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:06.699061 16868 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:06.703387 17953 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:06.704721 17952 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:58555; Asking this server to re-register.
I20251213 09:05:06.705426 17951 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:42853; Asking this server to re-register.
I20251213 09:05:06.705870 17004 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:06.706672 17139 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:06.707172 17951 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:06.708025 17951 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:06.800016 17295 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb]
I20251213 09:05:06.875588 18025 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:06.875908 18025 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:06.877497 18025 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:06.877943 17306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 3 candidate_status { last_received { term: 2 index: 212 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" is_pre_election: true
I20251213 09:05:06.881247 17963 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 3 candidate_status { last_received { term: 2 index: 212 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87" is_pre_election: true
I20251213 09:05:06.881551 17963 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 2.
I20251213 09:05:06.881882 17622 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87; no voters: f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:06.882098 18025 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251213 09:05:06.882169 18025 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:06.882200 18025 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 2 FOLLOWER]: Advancing to term 3
I20251213 09:05:06.896407 18025 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:06.896953 18025 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 3 election: Requested vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:06.897358 17306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 3 candidate_status { last_received { term: 2 index: 212 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
I20251213 09:05:06.897370 17963 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 3 candidate_status { last_received { term: 2 index: 212 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87"
I20251213 09:05:06.897508 17963 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 2 FOLLOWER]: Advancing to term 3
I20251213 09:05:06.899413 17963 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 3.
I20251213 09:05:06.899708 17622 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87; no voters: f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:06.899871 18025 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 FOLLOWER]: Leader election won for term 3
I20251213 09:05:06.900040 18025 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 LEADER]: Becoming Leader. State: Replica: 8fe04e8d31ac4cd9bca8f96335ff1982, State: Running, Role: LEADER
I20251213 09:05:06.900389 18025 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 212, Committed index: 212, Last appended: 2.212, Last appended by leader: 212, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:06.901989 18027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 3 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:06.902100 18027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:06.902431 18028 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:05:06.904589 18028 catalog_manager.cc:679] Loaded metadata for table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:06.905059 18028 catalog_manager.cc:679] Loaded metadata for table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]
I20251213 09:05:06.905282 18028 catalog_manager.cc:679] Loaded metadata for table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]
I20251213 09:05:06.905488 18028 catalog_manager.cc:679] Loaded metadata for table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]
I20251213 09:05:06.905701 18028 catalog_manager.cc:679] Loaded metadata for table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]
I20251213 09:05:06.905987 18028 catalog_manager.cc:679] Loaded metadata for table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:06.906266 18028 catalog_manager.cc:679] Loaded metadata for table default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]
I20251213 09:05:06.906462 18028 catalog_manager.cc:679] Loaded metadata for table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]
I20251213 09:05:06.906736 18028 catalog_manager.cc:679] Loaded metadata for table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:06.906929 18028 catalog_manager.cc:679] Loaded metadata for table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]
I20251213 09:05:06.907158 18028 catalog_manager.cc:679] Loaded metadata for table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]
I20251213 09:05:06.907402 18028 catalog_manager.cc:679] Loaded metadata for table default.table_1b2da3534d4d457a886358d9b231dea8 [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:05:06.907616 18028 catalog_manager.cc:679] Loaded metadata for table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]
I20251213 09:05:06.907823 18028 catalog_manager.cc:679] Loaded metadata for table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:05:06.908107 18028 catalog_manager.cc:679] Loaded metadata for table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb]
I20251213 09:05:06.908310 18028 catalog_manager.cc:679] Loaded metadata for table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]
I20251213 09:05:06.908509 18028 catalog_manager.cc:679] Loaded metadata for table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]
I20251213 09:05:06.908715 18028 catalog_manager.cc:679] Loaded metadata for table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:06.908903 18028 catalog_manager.cc:679] Loaded metadata for table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]
I20251213 09:05:06.909173 18028 catalog_manager.cc:679] Loaded metadata for table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]
I20251213 09:05:06.909425 18028 catalog_manager.cc:679] Loaded metadata for table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]
I20251213 09:05:06.909749 18028 catalog_manager.cc:679] Loaded metadata for table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]
I20251213 09:05:06.909976 18028 catalog_manager.cc:679] Loaded metadata for table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:06.910200 18028 catalog_manager.cc:679] Loaded metadata for table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]
I20251213 09:05:06.910439 18028 catalog_manager.cc:679] Loaded metadata for table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:06.910679 18028 catalog_manager.cc:679] Loaded metadata for table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:06.910904 18028 catalog_manager.cc:679] Loaded metadata for table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:06.911218 18028 catalog_manager.cc:679] Loaded metadata for table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]
I20251213 09:05:06.913341 18028 tablet_loader.cc:96] loaded metadata for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d])
I20251213 09:05:06.913736 18028 tablet_loader.cc:96] loaded metadata for tablet 0e15d3e0580943cfa60041729f1bff62 (table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074])
I20251213 09:05:06.913997 18028 tablet_loader.cc:96] loaded metadata for tablet 1391d28e1e4046b4af9f0b06ae539c0d (table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d])
I20251213 09:05:06.914168 18028 tablet_loader.cc:96] loaded metadata for tablet 13b11eb6cf6b4560b693797ca18292e4 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253])
I20251213 09:05:06.914420 18028 tablet_loader.cc:96] loaded metadata for tablet 33e5ff40d6b24f51956d050c23d41eb7 (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454])
I20251213 09:05:06.914669 18028 tablet_loader.cc:96] loaded metadata for tablet 3afb8349ced4486d8a283966ac647965 (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8])
I20251213 09:05:06.914978 18028 tablet_loader.cc:96] loaded metadata for tablet 466ce39a1a5d4037b9ce27eaba467266 (table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9])
I20251213 09:05:06.915180 18028 tablet_loader.cc:96] loaded metadata for tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb])
I20251213 09:05:06.915360 18028 tablet_loader.cc:96] loaded metadata for tablet 4a86f3d6176a4a4681c0fb31649e0eab (table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907])
I20251213 09:05:06.915695 18028 tablet_loader.cc:96] loaded metadata for tablet 5c38f6e874044009a4656efa5dddd9a7 (table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb])
I20251213 09:05:06.915930 18028 tablet_loader.cc:96] loaded metadata for tablet 5c7ab0cd8c694579824d2d41d0885731 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd])
I20251213 09:05:06.916122 18028 tablet_loader.cc:96] loaded metadata for tablet 604c2f416148499ab5651c43cd1491a1 (table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d])
I20251213 09:05:06.916363 18028 tablet_loader.cc:96] loaded metadata for tablet 608f523767d946b18b8bbfe50ca23347 (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5])
I20251213 09:05:06.916778 18028 tablet_loader.cc:96] loaded metadata for tablet 62236955121e49ec800c5e37a40c5b19 (table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644])
I20251213 09:05:06.917351 18028 tablet_loader.cc:96] loaded metadata for tablet 79d28675183f4fb1ad9a573cab3bba32 (table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a])
I20251213 09:05:06.917562 18028 tablet_loader.cc:96] loaded metadata for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c])
I20251213 09:05:06.917850 18028 tablet_loader.cc:96] loaded metadata for tablet 8a9c4e8b224d440dbab9d693bbba9e37 (table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce])
I20251213 09:05:06.918663 18028 tablet_loader.cc:96] loaded metadata for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893])
I20251213 09:05:06.918879 18028 tablet_loader.cc:96] loaded metadata for tablet b3c914dd363847b2a5730feb0c3e9c11 (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d])
I20251213 09:05:06.919061 18028 tablet_loader.cc:96] loaded metadata for tablet bd00dd09b602490ea10b92795bbc2b82 (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1])
I20251213 09:05:06.919334 18028 tablet_loader.cc:96] loaded metadata for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07])
I20251213 09:05:06.919471 18028 tablet_loader.cc:96] loaded metadata for tablet c5adcb68c5b9438da10370479acbed52 (table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba])
I20251213 09:05:06.919591 18028 tablet_loader.cc:96] loaded metadata for tablet c5dfe56534c5486a868b4d28aa494d0b (table default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75])
I20251213 09:05:06.919708 18028 tablet_loader.cc:96] loaded metadata for tablet c8276392af2740258e804f72f7529d16 (table default.table_1b2da3534d4d457a886358d9b231dea8 [id=57463d6c4bc24d45ab54ddf180a102cd])
I20251213 09:05:06.920120 18028 tablet_loader.cc:96] loaded metadata for tablet eb95522d80454b48af6bfdd05fb684d6 (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46])
I20251213 09:05:06.920245 18028 tablet_loader.cc:96] loaded metadata for tablet ecd3bbba1b1b4529bfea1fac9ca704bf (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f])
I20251213 09:05:06.920454 18028 tablet_loader.cc:96] loaded metadata for tablet f3b4a3ff63414a5da3faa9023644c677 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f])
I20251213 09:05:06.920675 18028 tablet_loader.cc:96] loaded metadata for tablet fb68b603c201419491b09993080789b5 (table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee])
I20251213 09:05:06.920835 18028 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:05:06.921789 18028 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:06.921833 18028 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:05:06.922887 18028 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:05:06.923774 18028 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Loaded TSK: 0
I20251213 09:05:06.924484 18028 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:05:06.925503 18028 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:05:06.926404 18028 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 65
I20251213 09:05:06.933477 17641 raft_consensus.cc:1240] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 LEADER]: Rejecting Update request from peer f0ef4ffe02ab44248dc97cb1c5cceac1 for earlier term 2. Current term is 3. Ops: []
I20251213 09:05:06.933902 18029 consensus_queue.cc:1059] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 }, Status: INVALID_TERM, Last received: 2.212, Next index: 213, Last known committed idx: 212, Time since last communication: 0.000s
I20251213 09:05:06.934165 18029 consensus_queue.cc:1243] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [LEADER]: Peer 8fe04e8d31ac4cd9bca8f96335ff1982 log is divergent from this leader: its last log entry 3.213 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 212
I20251213 09:05:06.934295 18029 raft_consensus.cc:3055] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 2 LEADER]: Stepping down as leader of term 2
I20251213 09:05:06.934346 18029 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Running, Role: LEADER
I20251213 09:05:06.934506 18029 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 212, Committed index: 212, Last appended: 2.212, Last appended by leader: 212, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:06.934741 18029 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 2 FOLLOWER]: Advancing to term 3
I20251213 09:05:06.935637 17963 raft_consensus.cc:1240] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 3 FOLLOWER]: Rejecting Update request from peer f0ef4ffe02ab44248dc97cb1c5cceac1 for earlier term 2. Current term is 3. Ops: [2.188-2.212]
I20251213 09:05:06.943256 17296 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]
I20251213 09:05:06.972290 17293 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]
I20251213 09:05:06.989073 17288 catalog_manager.cc:2174] created HMS catalog entry for table [id=e980912308a64e02b8214c0a3dd22a82]
W20251213 09:05:06.989763 17288 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER
I20251213 09:05:07.011633 17294 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]
I20251213 09:05:07.031543 17287 catalog_manager.cc:2174] created HMS catalog entry for table [id=d200aba93522490ca20c90b9387df943]
W20251213 09:05:07.032112 17287 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER
I20251213 09:05:07.046953 17291 catalog_manager.cc:2174] created HMS catalog entry for table [id=9e2a6770e19d4fde8081928cfa9612bd]
W20251213 09:05:07.047665 17291 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER
I20251213 09:05:07.049608 17358 catalog_manager.cc:2772] Deleting table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb] in response to Hive Metastore notification log event 66
W20251213 09:05:07.050403 17358 catalog_manager.cc:2848] Illegal state: an error occurred while updating the sys-catalog: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER
W20251213 09:05:07.050551 17358 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 66 DROP_TABLE default.table_2c647fd17c384b5a81ffdb84f9d5dc8e: Illegal state: an error occurred while updating the sys-catalog: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER
W20251213 09:05:07.050632 17358 hms_notification_log_listener.cc:143] Hive Metastore notification log listener poll failed: Service unavailable: lost leadership while handling Hive Metastore notification log events: an error occurred while updating the sys-catalog: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER
I20251213 09:05:07.050827 17289 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 61) took 4024 ms. Trace:
I20251213 09:05:07.050895 17295 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58844 (request call id 62) took 4024 ms. Trace:
I20251213 09:05:07.050945 17296 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58844 (request call id 64) took 3828 ms. Trace:
I20251213 09:05:07.050985 17293 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58844 (request call id 65) took 3826 ms. Trace:
I20251213 09:05:07.051085 17293 rpcz_store.cc:276] 1213 09:05:03.224931 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:04.520242 (+1295311us) service_pool.cc:225] Handling call
1213 09:05:06.118802 (+1598560us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:07.050979 (+932177us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":824375,"Hive Metastore.run_cpu_time_us":229,"Hive Metastore.run_wall_time_us":28995}
W20251213 09:05:07.051231 17290 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a211b679083e4e4294bf4c97874b2d60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:07.053324 17293 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 76) took 2535 ms. Trace:
I20251213 09:05:07.053390 17293 rpcz_store.cc:276] 1213 09:05:04.517416 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.053179 (+2535763us) service_pool.cc:225] Handling call
1213 09:05:07.053312 (+ 133us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.053653 17293 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 77) took 2499 ms. Trace:
I20251213 09:05:07.053701 17293 rpcz_store.cc:276] 1213 09:05:04.554185 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.053527 (+2499342us) service_pool.cc:225] Handling call
1213 09:05:07.053643 (+ 116us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.053900 17293 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 78) took 2499 ms. Trace:
I20251213 09:05:07.053952 17293 rpcz_store.cc:276] 1213 09:05:04.554238 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.053785 (+2499547us) service_pool.cc:225] Handling call
1213 09:05:07.053892 (+ 107us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.054148 17293 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:58844 (request call id 79) took 2499 ms. Trace:
I20251213 09:05:07.054188 17293 rpcz_store.cc:276] 1213 09:05:04.554779 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.054035 (+2499256us) service_pool.cc:225] Handling call
1213 09:05:07.054141 (+ 106us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.055065 17293 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 80) took 2338 ms. Trace:
W20251213 09:05:07.057215 17148 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.15.213.61:38171)
I20251213 09:05:07.051029 17294 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:58844 (request call id 66) took 3783 ms. Trace:
I20251213 09:05:07.059216 17294 rpcz_store.cc:276] 1213 09:05:03.267970 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.142188 (+1874218us) service_pool.cc:225] Handling call
1213 09:05:06.119272 (+977084us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:07.051024 (+931752us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":869678,"Hive Metastore.run_cpu_time_us":141,"Hive Metastore.run_wall_time_us":22557}
I20251213 09:05:07.060817 17294 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 81) took 1732 ms. Trace:
I20251213 09:05:07.060870 17294 rpcz_store.cc:276] 1213 09:05:05.328216 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.060662 (+1732446us) service_pool.cc:225] Handling call
1213 09:05:07.060806 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.061110 17294 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 82) took 1339 ms. Trace:
I20251213 09:05:07.061156 17294 rpcz_store.cc:276] 1213 09:05:05.721270 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.060983 (+1339713us) service_pool.cc:225] Handling call
1213 09:05:07.061101 (+ 118us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.061266 17294 master_service.cc:954] ReplaceTablet: received request to replace tablet 608f523767d946b18b8bbfe50ca23347 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:07.061405 17294 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 83) took 1304 ms. Trace:
I20251213 09:05:07.061442 17294 rpcz_store.cc:276] 1213 09:05:05.756551 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.061235 (+1304684us) service_pool.cc:225] Handling call
1213 09:05:07.061395 (+ 160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.061568 17294 master_service.cc:954] ReplaceTablet: received request to replace tablet 5c7ab0cd8c694579824d2d41d0885731 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:07.061704 17294 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 84) took 1299 ms. Trace:
I20251213 09:05:07.061741 17294 rpcz_store.cc:276] 1213 09:05:05.762062 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.061553 (+1299491us) service_pool.cc:225] Handling call
1213 09:05:07.061696 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.061836 17294 master_service.cc:954] ReplaceTablet: received request to replace tablet 276f296aafef4965b27c89cb80ae323c from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:07.061970 17294 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 85) took 1236 ms. Trace:
I20251213 09:05:07.062011 17294 rpcz_store.cc:276] 1213 09:05:05.825895 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.061822 (+1235927us) service_pool.cc:225] Handling call
1213 09:05:07.061954 (+ 132us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.062104 17294 master_service.cc:954] ReplaceTablet: received request to replace tablet 0e15d3e0580943cfa60041729f1bff62 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:07.062237 17294 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 86) took 1236 ms. Trace:
I20251213 09:05:07.062289 17294 rpcz_store.cc:276] 1213 09:05:05.826007 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.062089 (+1236082us) service_pool.cc:225] Handling call
1213 09:05:07.062228 (+ 139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.062387 17294 master_service.cc:954] ReplaceTablet: received request to replace tablet bd00dd09b602490ea10b92795bbc2b82 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:07.062526 17294 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:58844 (request call id 87) took 1236 ms. Trace:
I20251213 09:05:07.062563 17294 rpcz_store.cc:276] 1213 09:05:05.826071 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.062373 (+1236302us) service_pool.cc:225] Handling call
1213 09:05:07.062517 (+ 144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.062767 17294 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 88) took 1224 ms. Trace:
I20251213 09:05:07.062806 17294 rpcz_store.cc:276] 1213 09:05:05.837913 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.062641 (+1224728us) service_pool.cc:225] Handling call
1213 09:05:07.062758 (+ 117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.063001 17294 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 89) took 1035 ms. Trace:
I20251213 09:05:07.063041 17294 rpcz_store.cc:276] 1213 09:05:06.027293 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.062883 (+1035590us) service_pool.cc:225] Handling call
1213 09:05:07.062994 (+ 111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.050995 17296 rpcz_store.cc:276] 1213 09:05:03.222789 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:04.357429 (+1134640us) service_pool.cc:225] Handling call
1213 09:05:06.118728 (+1761299us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:07.050938 (+932210us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":681228,"Hive Metastore.run_cpu_time_us":191,"Hive Metastore.run_wall_time_us":143200}
I20251213 09:05:07.063701 17296 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:58866 (request call id 0) took 4252 ms. Trace:
I20251213 09:05:07.063755 17296 rpcz_store.cc:276] 1213 09:05:02.811112 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.063427 (+4252315us) service_pool.cc:225] Handling call
1213 09:05:07.063688 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.050953 17295 rpcz_store.cc:276] 1213 09:05:03.026710 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:04.353083 (+1326373us) service_pool.cc:225] Handling call
1213 09:05:06.118612 (+1765529us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:07.050881 (+932269us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":189399,"Hive Metastore.run_cpu_time_us":192,"Hive Metastore.run_wall_time_us":491852}
I20251213 09:05:07.050904 17289 rpcz_store.cc:276] 1213 09:05:03.026654 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:04.344550 (+1317896us) service_pool.cc:225] Handling call
1213 09:05:05.638977 (+1294427us) catalog_manager.cc:2393] Looking up, locking, and authorizing table
1213 09:05:07.050806 (+1411829us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":473426,"Hive Metastore.run_cpu_time_us":511,"Hive Metastore.run_wall_time_us":192870}
I20251213 09:05:07.066092 17640 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_1b2da3534d4d457a886358d9b231dea8" } new_table_name: "default.Table_48ccfd3f31d24cd282be05bf417cd050" modify_external_catalogs: true
I20251213 09:05:07.065958 17639 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_a90e27bac3a946e5bdd85f229deeb4be" } new_table_name: "default.Table_08f61de8c46c467ba64e2ccbc392e100" modify_external_catalogs: true
I20251213 09:05:07.066216 17637 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_731dc67a6a2b407180abef538691c40c" } new_table_name: "default.Table_77ba98ea391f495daa07e314094f52c2" modify_external_catalogs: true
I20251213 09:05:07.066790 17638 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_7bb124a916904ca5b08081aae9ac54a0" } new_table_name: "default.Table_8ad4a38d0dcc447fb137dd4e3701421e" modify_external_catalogs: true
I20251213 09:05:07.071053 17292 catalog_manager.cc:2174] created HMS catalog entry for table [id=75537d22d2274862a5106e7a3cdf7992]
W20251213 09:05:07.071583 17292 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER
I20251213 09:05:07.072954 17703 catalog_manager.cc:2772] Deleting table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb] in response to Hive Metastore notification log event 66
I20251213 09:05:07.075831 17253 master_runner.cc:232] Existing masters have differing terms: 2 vs 3
I20251213 09:05:07.075941 17253 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:07.076157 17577 master_runner.cc:263] No leader master found from master 8fe04e8d31ac4cd9bca8f96335ff1982
I20251213 09:05:07.076238 17577 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:05:07.076733 17148 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:07.076977 17148 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.62:42117)
I20251213 09:05:07.079890 17910 master_runner.cc:232] Existing masters have differing terms: 2 vs 3
I20251213 09:05:07.079993 17910 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:07.080358 17635 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39634:
name: "default.Table_c92c10038983476b9e3c8db243dcd67a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:07.080732 17634 master_service.cc:954] ReplaceTablet: received request to replace tablet 608f523767d946b18b8bbfe50ca23347 from {username='slave'} at 127.0.0.1:39634
W20251213 09:05:07.080790 17148 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.15.213.62:42117)
I20251213 09:05:07.081203 17293 rpcz_store.cc:276] 1213 09:05:04.716523 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:07.054916 (+2338393us) service_pool.cc:225] Handling call
1213 09:05:07.055054 (+ 138us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20251213 09:05:07.081657 17633 master_service.cc:954] ReplaceTablet: received request to replace tablet 5c7ab0cd8c694579824d2d41d0885731 from {username='slave'} at 127.0.0.1:39634
I20251213 09:05:07.082284 17632 master_service.cc:954] ReplaceTablet: received request to replace tablet 276f296aafef4965b27c89cb80ae323c from {username='slave'} at 127.0.0.1:39634
I20251213 09:05:07.082691 17632 master_service.cc:954] ReplaceTablet: received request to replace tablet bd00dd09b602490ea10b92795bbc2b82 from {username='slave'} at 127.0.0.1:39634
I20251213 09:05:07.083302 17631 master_service.cc:954] ReplaceTablet: received request to replace tablet 0e15d3e0580943cfa60041729f1bff62 from {username='slave'} at 127.0.0.1:39634
I20251213 09:05:07.085566 17636 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39634:
name: "default.Table_a4cb549ba70e4c568666a6ff2e2c0cfb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:07.085608 17306 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 3 FOLLOWER]: Refusing update from remote peer 8fe04e8d31ac4cd9bca8f96335ff1982: Log matching property violated. Preceding OpId in replica: term: 2 index: 212. Preceding OpId from leader: term: 3 index: 214. (index mismatch)
I20251213 09:05:07.086086 18027 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 213, Last known committed idx: 212, Time since last communication: 0.000s
I20251213 09:05:07.087808 18029 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 3 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:07.087900 18029 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:07.089808 18025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:07.089913 18025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:07.090276 18029 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:07.090358 18029 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:07.093590 17703 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 5c38f6e874044009a4656efa5dddd9a7
I20251213 09:05:07.095280 17703 catalog_manager.cc:2772] Deleting table default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75] in response to Hive Metastore notification log event 67
I20251213 09:05:07.096587 17963 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 3 FOLLOWER]: Refusing update from remote peer 8fe04e8d31ac4cd9bca8f96335ff1982: Log matching property violated. Preceding OpId in replica: term: 2 index: 187. Preceding OpId from leader: term: 3 index: 214. (index mismatch)
I20251213 09:05:07.097129 17633 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 5c7ab0cd8c694579824d2d41d0885731
I20251213 09:05:07.097389 17633 catalog_manager.cc:6724] ReplaceTablet: tablet 5c7ab0cd8c694579824d2d41d0885731 deleted and replaced by tablet e8b33140a56b49cf9068eb6b09613998
I20251213 09:05:07.098500 18027 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 213, Last known committed idx: 187, Time since last communication: 0.000s
I20251213 09:05:07.098579 17633 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39634:
name: "default.Table_a8f6f2502bcb441eb0710b3dbbc5aad3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:07.102622 17634 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 608f523767d946b18b8bbfe50ca23347
I20251213 09:05:07.102869 17634 catalog_manager.cc:6724] ReplaceTablet: tablet 608f523767d946b18b8bbfe50ca23347 deleted and replaced by tablet 9d0400b5bf3946de8ab82596a94b99ae
I20251213 09:05:07.103022 17634 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39634:
name: "default.Table_b120cf88360b42c5a8a808744097cded"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:07.103890 17631 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 0e15d3e0580943cfa60041729f1bff62
I20251213 09:05:07.104089 17631 catalog_manager.cc:6724] ReplaceTablet: tablet 0e15d3e0580943cfa60041729f1bff62 deleted and replaced by tablet 204b940a48ad4365921ae475f04f3b9c
I20251213 09:05:07.104218 17631 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_2d8ae593f178467881752483962712b3" } new_table_name: "default.Table_9875930af7074cd8b3baeb132c88b19a" modify_external_catalogs: true
I20251213 09:05:07.104549 17632 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet bd00dd09b602490ea10b92795bbc2b82
I20251213 09:05:07.104745 17632 catalog_manager.cc:6724] ReplaceTablet: tablet bd00dd09b602490ea10b92795bbc2b82 deleted and replaced by tablet f394b4d388cd43a49ae4c3db293a893c
I20251213 09:05:07.105707 17703 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet c5dfe56534c5486a868b4d28aa494d0b
I20251213 09:05:07.106279 17703 catalog_manager.cc:2772] Deleting table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9] in response to Hive Metastore notification log event 68
I20251213 09:05:07.108412 17632 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_20afd9b96f7e403d9c185f93b6567f19" } modify_external_catalogs: true
I20251213 09:05:07.108533 17632 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_20afd9b96f7e403d9c185f93b6567f19" } modify_external_catalogs: true
I20251213 09:05:07.109300 18035 mvcc.cc:204] Tried to move back new op lower bound from 7231966032223133696 to 7231966031467335680. Current Snapshot: MvccSnapshot[applied={T|T < 7231966032191315968}]
I20251213 09:05:07.109926 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c38f6e874044009a4656efa5dddd9a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.110179 16935 tablet_service.cc:1552] Processing DeleteTablet for tablet 608f523767d946b18b8bbfe50ca23347 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d0400b5bf3946de8ab82596a94b99ae) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.110144 16934 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c7ab0cd8c694579824d2d41d0885731 with delete_type TABLET_DATA_DELETED (replaced by tablet e8b33140a56b49cf9068eb6b09613998) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.110144 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet bd00dd09b602490ea10b92795bbc2b82 with delete_type TABLET_DATA_DELETED (replaced by tablet f394b4d388cd43a49ae4c3db293a893c) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.110230 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e15d3e0580943cfa60041729f1bff62 with delete_type TABLET_DATA_DELETED (replaced by tablet 204b940a48ad4365921ae475f04f3b9c) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.110311 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet c5dfe56534c5486a868b4d28aa494d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.112149 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c38f6e874044009a4656efa5dddd9a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.112434 16799 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c7ab0cd8c694579824d2d41d0885731 with delete_type TABLET_DATA_DELETED (replaced by tablet e8b33140a56b49cf9068eb6b09613998) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.112596 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet 608f523767d946b18b8bbfe50ca23347 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d0400b5bf3946de8ab82596a94b99ae) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.112699 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e15d3e0580943cfa60041729f1bff62 with delete_type TABLET_DATA_DELETED (replaced by tablet 204b940a48ad4365921ae475f04f3b9c) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.112785 16798 tablet_service.cc:1552] Processing DeleteTablet for tablet bd00dd09b602490ea10b92795bbc2b82 with delete_type TABLET_DATA_DELETED (replaced by tablet f394b4d388cd43a49ae4c3db293a893c) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.112900 16796 tablet_service.cc:1552] Processing DeleteTablet for tablet c5dfe56534c5486a868b4d28aa494d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.113245 18051 tablet_replica.cc:333] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.113435 18051 raft_consensus.cc:2243] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.113620 18051 raft_consensus.cc:2272] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.113909 18049 tablet_replica.cc:333] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.114113 18049 raft_consensus.cc:2243] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.114264 18049 raft_consensus.cc:2272] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.114615 18002 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 3 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:07.114694 18049 ts_tablet_manager.cc:1916] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.114758 18002 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:07.114871 18002 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:07.114960 18002 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:07.115513 18051 ts_tablet_manager.cc:1916] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.116216 17069 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e15d3e0580943cfa60041729f1bff62 with delete_type TABLET_DATA_DELETED (replaced by tablet 204b940a48ad4365921ae475f04f3b9c) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.116448 17071 tablet_service.cc:1552] Processing DeleteTablet for tablet bd00dd09b602490ea10b92795bbc2b82 with delete_type TABLET_DATA_DELETED (replaced by tablet f394b4d388cd43a49ae4c3db293a893c) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.116532 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet c5dfe56534c5486a868b4d28aa494d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.117965 18051 ts_tablet_manager.cc:1929] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.118022 17070 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c38f6e874044009a4656efa5dddd9a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.118157 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c7ab0cd8c694579824d2d41d0885731 with delete_type TABLET_DATA_DELETED (replaced by tablet e8b33140a56b49cf9068eb6b09613998) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.118135 18051 log.cc:1199] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/5c38f6e874044009a4656efa5dddd9a7
I20251213 09:05:07.118289 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 608f523767d946b18b8bbfe50ca23347 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d0400b5bf3946de8ab82596a94b99ae) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.118647 18051 ts_tablet_manager.cc:1950] T 5c38f6e874044009a4656efa5dddd9a7 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:07.118891 17073 tablet_service.cc:1505] Processing CreateTablet for tablet e8b33140a56b49cf9068eb6b09613998 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.119161 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b33140a56b49cf9068eb6b09613998. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.119112 16796 tablet_service.cc:1505] Processing CreateTablet for tablet e8b33140a56b49cf9068eb6b09613998 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.119380 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b33140a56b49cf9068eb6b09613998. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.119415 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 5c38f6e874044009a4656efa5dddd9a7 (table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb]) successfully deleted
I20251213 09:05:07.119701 18051 tablet_replica.cc:333] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.119812 18051 raft_consensus.cc:2243] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.119900 18051 raft_consensus.cc:2272] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.120411 18051 ts_tablet_manager.cc:1916] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.122220 18051 ts_tablet_manager.cc:1929] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.122295 18051 log.cc:1199] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/5c7ab0cd8c694579824d2d41d0885731
I20251213 09:05:07.122800 18051 ts_tablet_manager.cc:1950] T 5c7ab0cd8c694579824d2d41d0885731 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:07.122932 16936 tablet_service.cc:1505] Processing CreateTablet for tablet e8b33140a56b49cf9068eb6b09613998 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.123241 16936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8b33140a56b49cf9068eb6b09613998. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.123445 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 5c7ab0cd8c694579824d2d41d0885731 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]) successfully deleted
I20251213 09:05:07.123647 18051 tablet_replica.cc:333] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.124015 18051 raft_consensus.cc:2243] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.124128 18051 raft_consensus.cc:2272] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.124456 18051 ts_tablet_manager.cc:1916] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.125236 17703 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 466ce39a1a5d4037b9ce27eaba467266
I20251213 09:05:07.125981 17703 catalog_manager.cc:2772] Deleting table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074] in response to Hive Metastore notification log event 70
I20251213 09:05:07.126041 16796 tablet_service.cc:1552] Processing DeleteTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.127035 18051 ts_tablet_manager.cc:1929] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.127094 18051 log.cc:1199] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/608f523767d946b18b8bbfe50ca23347
I20251213 09:05:07.127386 18051 ts_tablet_manager.cc:1950] T 608f523767d946b18b8bbfe50ca23347 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:07.127763 16869 heartbeater.cc:499] Master 127.15.213.62:42117 was elected leader, sending a full tablet report...
I20251213 09:05:07.128114 16796 tablet_service.cc:1505] Processing CreateTablet for tablet f394b4d388cd43a49ae4c3db293a893c (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.128445 17068 tablet_service.cc:1505] Processing CreateTablet for tablet f394b4d388cd43a49ae4c3db293a893c (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.128706 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f394b4d388cd43a49ae4c3db293a893c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.130051 16933 tablet_service.cc:1505] Processing CreateTablet for tablet f394b4d388cd43a49ae4c3db293a893c (DEFAULT_TABLE table=default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.130306 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f394b4d388cd43a49ae4c3db293a893c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.130278 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.130467 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.132499 16798 tablet_service.cc:1505] Processing CreateTablet for tablet 204b940a48ad4365921ae475f04f3b9c (DEFAULT_TABLE table=default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]), partition=RANGE (key) PARTITION UNBOUNDED
W20251213 09:05:07.132833 17026 consensus_peers.cc:597] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c38f6e874044009a4656efa5dddd9a7. This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:07.133790 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 9d0400b5bf3946de8ab82596a94b99ae (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.134029 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0400b5bf3946de8ab82596a94b99ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.135200 17703 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 204b940a48ad4365921ae475f04f3b9c
I20251213 09:05:07.135948 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f394b4d388cd43a49ae4c3db293a893c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.136538 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 204b940a48ad4365921ae475f04f3b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.136682 16933 tablet_service.cc:1505] Processing CreateTablet for tablet 204b940a48ad4365921ae475f04f3b9c (DEFAULT_TABLE table=default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.136905 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204b940a48ad4365921ae475f04f3b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.136896 17070 tablet_service.cc:1552] Processing DeleteTablet for tablet 204b940a48ad4365921ae475f04f3b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.137257 17068 tablet_service.cc:1505] Processing CreateTablet for tablet 204b940a48ad4365921ae475f04f3b9c (DEFAULT_TABLE table=default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.137480 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204b940a48ad4365921ae475f04f3b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.138646 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 204b940a48ad4365921ae475f04f3b9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.139775 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 204b940a48ad4365921ae475f04f3b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.140185 18049 ts_tablet_manager.cc:1929] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.141851 18054 tablet_replica.cc:333] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.141894 18056 tablet_bootstrap.cc:492] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:07.141999 18049 log.cc:1199] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/5c38f6e874044009a4656efa5dddd9a7
I20251213 09:05:07.142186 18054 raft_consensus.cc:2243] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.142551 18049 ts_tablet_manager.cc:1950] T 5c38f6e874044009a4656efa5dddd9a7 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.142709 18054 raft_consensus.cc:2272] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.145010 18054 ts_tablet_manager.cc:1916] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.145870 18025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:07.145988 18025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:07.146147 18049 tablet_replica.cc:333] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.146332 18049 raft_consensus.cc:2243] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:07.145954 18055 tablet_bootstrap.cc:492] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.147140 18049 raft_consensus.cc:2272] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.148116 17621 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 5c38f6e874044009a4656efa5dddd9a7 (table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb]) successfully deleted
I20251213 09:05:07.149215 18055 tablet_bootstrap.cc:654] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.149631 18056 tablet_bootstrap.cc:654] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.147388 18057 tablet_bootstrap.cc:492] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:07.148519 16933 tablet_service.cc:1505] Processing CreateTablet for tablet 9d0400b5bf3946de8ab82596a94b99ae (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.149796 16796 tablet_service.cc:1505] Processing CreateTablet for tablet 9d0400b5bf3946de8ab82596a94b99ae (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.149981 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0400b5bf3946de8ab82596a94b99ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.150033 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d0400b5bf3946de8ab82596a94b99ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.152493 18056 tablet_bootstrap.cc:492] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.152606 18056 ts_tablet_manager.cc:1403] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251213 09:05:07.152999 18049 ts_tablet_manager.cc:1916] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.153267 18056 raft_consensus.cc:359] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.153383 18056 raft_consensus.cc:385] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.153426 18056 raft_consensus.cc:740] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.153607 18056 consensus_queue.cc:260] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.155426 18056 ts_tablet_manager.cc:1434] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:07.158309 18051 tablet_replica.cc:333] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.158442 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 608f523767d946b18b8bbfe50ca23347 (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]) successfully deleted
I20251213 09:05:07.158509 18051 raft_consensus.cc:2243] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.158722 18051 raft_consensus.cc:2272] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.159164 18051 ts_tablet_manager.cc:1916] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.163384 18056 tablet_bootstrap.cc:492] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:07.165462 18056 tablet_bootstrap.cc:654] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.166204 18051 ts_tablet_manager.cc:1929] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:07.171890 18051 log.cc:1199] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/0e15d3e0580943cfa60041729f1bff62
I20251213 09:05:07.172808 18051 ts_tablet_manager.cc:1950] T 0e15d3e0580943cfa60041729f1bff62 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:07.173964 18051 tablet_replica.cc:333] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.174150 18051 raft_consensus.cc:2243] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:07.174450 18051 raft_consensus.cc:2272] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.167677 18054 ts_tablet_manager.cc:1929] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:07.174633 18054 log.cc:1199] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/0e15d3e0580943cfa60041729f1bff62
I20251213 09:05:07.174976 18054 ts_tablet_manager.cc:1950] T 0e15d3e0580943cfa60041729f1bff62 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.175522 18057 tablet_bootstrap.cc:654] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.176342 18045 mvcc.cc:204] Tried to move back new op lower bound from 7231966032228536320 to 7231966031467335680. Current Snapshot: MvccSnapshot[applied={T|T < 7231966032191315968}]
I20251213 09:05:07.176846 18051 ts_tablet_manager.cc:1916] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.177943 18054 tablet_replica.cc:333] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.178088 18054 raft_consensus.cc:2243] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.178211 18054 raft_consensus.cc:2272] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.178598 18054 ts_tablet_manager.cc:1916] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.180850 18054 ts_tablet_manager.cc:1929] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.180931 18054 log.cc:1199] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/bd00dd09b602490ea10b92795bbc2b82
I20251213 09:05:07.183599 18049 ts_tablet_manager.cc:1929] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.183693 18049 log.cc:1199] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/608f523767d946b18b8bbfe50ca23347
I20251213 09:05:07.184352 18049 ts_tablet_manager.cc:1950] T 608f523767d946b18b8bbfe50ca23347 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.185139 17621 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 608f523767d946b18b8bbfe50ca23347 (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]) successfully deleted
I20251213 09:05:07.185760 18055 tablet_bootstrap.cc:492] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.185871 18055 ts_tablet_manager.cc:1403] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20251213 09:05:07.186415 18055 raft_consensus.cc:359] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.186558 18055 raft_consensus.cc:385] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.186607 18055 raft_consensus.cc:740] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.186816 18055 consensus_queue.cc:260] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.187131 17140 heartbeater.cc:499] Master 127.15.213.62:42117 was elected leader, sending a full tablet report...
W20251213 09:05:07.190043 16891 consensus_peers.cc:597] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e15d3e0580943cfa60041729f1bff62. This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:07.190747 18055 ts_tablet_manager.cc:1434] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:07.191581 18055 tablet_bootstrap.cc:492] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.192442 18055 tablet_bootstrap.cc:654] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.193202 18056 tablet_bootstrap.cc:492] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.193357 18056 ts_tablet_manager.cc:1403] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20251213 09:05:07.193490 18051 ts_tablet_manager.cc:1929] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.193683 18049 tablet_replica.cc:333] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.194373 18049 raft_consensus.cc:2243] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:07.194757 18055 tablet_bootstrap.cc:492] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.194862 18055 ts_tablet_manager.cc:1403] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:07.194643 18049 raft_consensus.cc:2272] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.195467 18055 raft_consensus.cc:359] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.195580 18055 raft_consensus.cc:385] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.195641 18055 raft_consensus.cc:740] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.195479 18057 tablet_bootstrap.cc:492] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.195755 18057 ts_tablet_manager.cc:1403] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.000s
I20251213 09:05:07.195775 18055 consensus_queue.cc:260] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.196074 18055 ts_tablet_manager.cc:1434] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.196272 18057 raft_consensus.cc:359] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.196573 18057 raft_consensus.cc:385] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.196655 18057 raft_consensus.cc:740] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.196803 18055 tablet_bootstrap.cc:492] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.196861 18057 consensus_queue.cc:260] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.197211 17005 heartbeater.cc:499] Master 127.15.213.62:42117 was elected leader, sending a full tablet report...
I20251213 09:05:07.198144 18055 tablet_bootstrap.cc:654] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.200158 17288 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=e980912308a64e02b8214c0a3dd22a82]
I20251213 09:05:07.200474 17288 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 63) took 4143 ms. Trace:
I20251213 09:05:07.200531 17288 rpcz_store.cc:276] 1213 09:05:03.057402 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:04.353309 (+1295907us) service_pool.cc:225] Handling call
1213 09:05:06.118769 (+1765460us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:06.119099 (+ 330us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:06.989060 (+869961us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:06.989667 (+ 607us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:06.989670 (+ 3us) write_op.cc:454] Released schema lock
1213 09:05:06.989833 (+ 163us) catalog_manager.cc:2181] Rolling back HMS table creation
1213 09:05:07.200459 (+210626us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:06.989592 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER)
1213 09:05:06.989602 (+ 10us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:06.989607 (+ 5us) write_op.cc:454] Released schema lock
1213 09:05:06.989610 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":933733,"Hive Metastore.run_cpu_time_us":338,"Hive Metastore.run_wall_time_us":146174,"child_traces":[["op",{}]]}
I20251213 09:05:07.202226 18055 tablet_bootstrap.cc:492] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.202311 18055 ts_tablet_manager.cc:1403] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:07.202759 18055 raft_consensus.cc:359] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.202886 18055 raft_consensus.cc:385] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.202920 18055 raft_consensus.cc:740] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.203033 18055 consensus_queue.cc:260] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.203316 18055 ts_tablet_manager.cc:1434] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:07.203490 18055 tablet_bootstrap.cc:492] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.204491 18055 tablet_bootstrap.cc:654] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.205760 18057 ts_tablet_manager.cc:1434] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20251213 09:05:07.206336 18055 tablet_bootstrap.cc:492] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.206414 18055 ts_tablet_manager.cc:1403] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251213 09:05:07.206672 18057 tablet_bootstrap.cc:492] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:07.206830 18055 raft_consensus.cc:359] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.206912 18055 raft_consensus.cc:385] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.206943 18055 raft_consensus.cc:740] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.207053 18055 consensus_queue.cc:260] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.207413 18055 ts_tablet_manager.cc:1434] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:07.208029 18057 tablet_bootstrap.cc:654] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.208796 18049 ts_tablet_manager.cc:1916] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.209892 18051 log.cc:1199] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/bd00dd09b602490ea10b92795bbc2b82
I20251213 09:05:07.193959 18056 raft_consensus.cc:359] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.210060 18056 raft_consensus.cc:385] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.210114 18056 raft_consensus.cc:740] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.210238 18051 ts_tablet_manager.cc:1950] T bd00dd09b602490ea10b92795bbc2b82 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:07.210294 18056 consensus_queue.cc:260] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.210604 18056 ts_tablet_manager.cc:1434] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.017s user 0.001s sys 0.000s
I20251213 09:05:07.210800 18056 tablet_bootstrap.cc:492] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:07.211747 18056 tablet_bootstrap.cc:654] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.213001 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet bd00dd09b602490ea10b92795bbc2b82 (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]) successfully deleted
I20251213 09:05:07.213270 18051 tablet_replica.cc:333] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.215624 18051 raft_consensus.cc:2243] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:07.217061 18054 ts_tablet_manager.cc:1950] T bd00dd09b602490ea10b92795bbc2b82 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.217801 17622 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet bd00dd09b602490ea10b92795bbc2b82 (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]) successfully deleted
I20251213 09:05:07.219303 18049 ts_tablet_manager.cc:1929] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.219391 18049 log.cc:1199] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/5c7ab0cd8c694579824d2d41d0885731
I20251213 09:05:07.219645 18049 ts_tablet_manager.cc:1950] T 5c7ab0cd8c694579824d2d41d0885731 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.220314 17621 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 5c7ab0cd8c694579824d2d41d0885731 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]) successfully deleted
I20251213 09:05:07.220546 18051 raft_consensus.cc:2272] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.220985 18051 ts_tablet_manager.cc:1916] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.223265 18051 ts_tablet_manager.cc:1929] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.223469 18054 tablet_replica.cc:333] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.223623 18054 raft_consensus.cc:2243] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.223754 18054 raft_consensus.cc:2272] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.224208 18054 ts_tablet_manager.cc:1916] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.224740 18057 tablet_bootstrap.cc:492] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.224839 18057 ts_tablet_manager.cc:1403] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251213 09:05:07.225360 18057 raft_consensus.cc:359] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.225631 18057 raft_consensus.cc:385] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.225725 18057 raft_consensus.cc:740] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.225574 18049 tablet_replica.cc:333] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.226023 18049 raft_consensus.cc:2243] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.226176 18049 raft_consensus.cc:2272] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.226531 18054 ts_tablet_manager.cc:1929] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.224121 18056 tablet_bootstrap.cc:492] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.226661 18051 log.cc:1199] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/c5dfe56534c5486a868b4d28aa494d0b
I20251213 09:05:07.226706 18056 ts_tablet_manager.cc:1403] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251213 09:05:07.226940 18051 ts_tablet_manager.cc:1950] T c5dfe56534c5486a868b4d28aa494d0b P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:07.227445 18056 raft_consensus.cc:359] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.227569 18056 raft_consensus.cc:385] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.227604 18056 raft_consensus.cc:740] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.227721 18056 consensus_queue.cc:260] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.227934 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet c5dfe56534c5486a868b4d28aa494d0b (table default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]) successfully deleted
I20251213 09:05:07.228034 18056 ts_tablet_manager.cc:1434] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.228179 18051 tablet_replica.cc:333] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.228212 18056 tablet_bootstrap.cc:492] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:07.228296 18051 raft_consensus.cc:2243] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.228434 18054 log.cc:1199] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/c5dfe56534c5486a868b4d28aa494d0b
I20251213 09:05:07.228739 18054 ts_tablet_manager.cc:1950] T c5dfe56534c5486a868b4d28aa494d0b P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.229369 18056 tablet_bootstrap.cc:654] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.230170 18051 raft_consensus.cc:2272] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.230562 18051 ts_tablet_manager.cc:1916] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.231058 17622 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet c5dfe56534c5486a868b4d28aa494d0b (table default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]) successfully deleted
I20251213 09:05:07.231168 18049 ts_tablet_manager.cc:1916] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.233000 18057 consensus_queue.cc:260] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.233371 18057 ts_tablet_manager.cc:1434] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s
I20251213 09:05:07.233580 18057 tablet_bootstrap.cc:492] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:07.234812 18057 tablet_bootstrap.cc:654] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.237004 18049 ts_tablet_manager.cc:1929] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.237097 18049 log.cc:1199] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/bd00dd09b602490ea10b92795bbc2b82
I20251213 09:05:07.237358 18049 ts_tablet_manager.cc:1950] T bd00dd09b602490ea10b92795bbc2b82 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.238075 18049 tablet_replica.cc:333] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.238212 18049 raft_consensus.cc:2243] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:07.238404 18049 raft_consensus.cc:2272] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.238598 17621 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet bd00dd09b602490ea10b92795bbc2b82 (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]) successfully deleted
I20251213 09:05:07.238826 18049 ts_tablet_manager.cc:1916] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.241197 18049 ts_tablet_manager.cc:1929] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:07.241282 18049 log.cc:1199] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/0e15d3e0580943cfa60041729f1bff62
I20251213 09:05:07.241478 18054 tablet_replica.cc:333] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.241709 18054 raft_consensus.cc:2243] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:07.242034 18054 raft_consensus.cc:2272] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.242615 18054 ts_tablet_manager.cc:1916] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.243372 18049 ts_tablet_manager.cc:1950] T 0e15d3e0580943cfa60041729f1bff62 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.244099 18049 tablet_replica.cc:333] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.244238 18049 raft_consensus.cc:2243] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.244359 18049 raft_consensus.cc:2272] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.244756 18049 ts_tablet_manager.cc:1916] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.246803 18056 tablet_bootstrap.cc:492] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.246923 18056 ts_tablet_manager.cc:1403] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251213 09:05:07.246932 18049 ts_tablet_manager.cc:1929] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.246992 18049 log.cc:1199] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/c5dfe56534c5486a868b4d28aa494d0b
I20251213 09:05:07.247277 18049 ts_tablet_manager.cc:1950] T c5dfe56534c5486a868b4d28aa494d0b P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.247629 18056 raft_consensus.cc:359] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.247745 18056 raft_consensus.cc:385] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.247776 18056 raft_consensus.cc:740] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.247937 18049 tablet_replica.cc:333] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.247917 18056 consensus_queue.cc:260] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.248067 18049 raft_consensus.cc:2243] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:07.248194 18056 ts_tablet_manager.cc:1434] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.248248 18049 raft_consensus.cc:2272] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.248225 17621 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet c5dfe56534c5486a868b4d28aa494d0b (table default.table_e15a5e101cf24bec9b2ecc545598c4b2 [id=376eb0d381ae4ef7bf1a1c0fa4bd8b75]) successfully deleted
I20251213 09:05:07.248636 18049 ts_tablet_manager.cc:1916] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.250593 18049 ts_tablet_manager.cc:1929] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.250679 18049 log.cc:1199] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/466ce39a1a5d4037b9ce27eaba467266
I20251213 09:05:07.250923 18049 ts_tablet_manager.cc:1950] T 466ce39a1a5d4037b9ce27eaba467266 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.251690 18051 ts_tablet_manager.cc:1929] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.251749 17621 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 466ce39a1a5d4037b9ce27eaba467266 (table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]) successfully deleted
I20251213 09:05:07.251842 18051 log.cc:1199] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/466ce39a1a5d4037b9ce27eaba467266
I20251213 09:05:07.252121 18051 ts_tablet_manager.cc:1950] T 466ce39a1a5d4037b9ce27eaba467266 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
W20251213 09:05:07.252364 17621 catalog_manager.cc:4965] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): delete failed for tablet 204b940a48ad4365921ae475f04f3b9c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 204b940a48ad4365921ae475f04f3b9c already in progress: creating tablet
I20251213 09:05:07.253217 18054 ts_tablet_manager.cc:1929] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.253332 18054 log.cc:1199] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/5c38f6e874044009a4656efa5dddd9a7
I20251213 09:05:07.253809 18057 tablet_bootstrap.cc:492] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.253918 18057 ts_tablet_manager.cc:1403] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251213 09:05:07.254453 18057 raft_consensus.cc:359] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.254591 18057 raft_consensus.cc:385] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.254634 18057 raft_consensus.cc:740] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.254518 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 466ce39a1a5d4037b9ce27eaba467266 (table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]) successfully deleted
I20251213 09:05:07.254771 18057 consensus_queue.cc:260] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.254982 18051 tablet_replica.cc:333] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.255095 18057 ts_tablet_manager.cc:1434] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:07.255335 18057 tablet_bootstrap.cc:492] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:07.255617 18054 ts_tablet_manager.cc:1950] T 5c38f6e874044009a4656efa5dddd9a7 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.256601 18057 tablet_bootstrap.cc:654] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.255332 18051 raft_consensus.cc:2243] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.257573 18051 raft_consensus.cc:2272] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.260084 17850 raft_consensus.cc:493] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:07.260452 17850 raft_consensus.cc:515] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.262315 17850 leader_election.cc:290] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:07.262527 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f394b4d388cd43a49ae4c3db293a893c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:07.262672 16956 raft_consensus.cc:2468] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:07.262941 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f394b4d388cd43a49ae4c3db293a893c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:07.263372 17622 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 5c38f6e874044009a4656efa5dddd9a7 (table default.table_2c647fd17c384b5a81ffdb84f9d5dc8e [id=a6e855d0c53c4082922304bfbecd3cfb]) successfully deleted
I20251213 09:05:07.263427 18054 tablet_replica.cc:333] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.263665 18054 raft_consensus.cc:2243] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.263728 16756 leader_election.cc:304] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.263906 17850 raft_consensus.cc:2804] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:07.263957 17850 raft_consensus.cc:493] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:07.263993 17850 raft_consensus.cc:3060] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.264171 18054 raft_consensus.cc:2272] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.264880 18054 ts_tablet_manager.cc:1916] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.265085 17850 raft_consensus.cc:515] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.265492 17850 leader_election.cc:290] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:07.263101 17093 raft_consensus.cc:2468] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:07.266271 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f394b4d388cd43a49ae4c3db293a893c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:07.266403 16957 raft_consensus.cc:3060] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.267431 16957 raft_consensus.cc:2468] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:07.268097 18054 ts_tablet_manager.cc:1929] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.268239 18054 log.cc:1199] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/5c7ab0cd8c694579824d2d41d0885731
I20251213 09:05:07.268402 16756 leader_election.cc:304] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.268626 18054 ts_tablet_manager.cc:1950] T 5c7ab0cd8c694579824d2d41d0885731 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.268115 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f394b4d388cd43a49ae4c3db293a893c" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:07.268920 17093 raft_consensus.cc:3060] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.269241 18051 ts_tablet_manager.cc:1916] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.269524 18054 tablet_replica.cc:333] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.269691 18054 raft_consensus.cc:2243] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.269829 17093 raft_consensus.cc:2468] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:07.270098 17622 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 5c7ab0cd8c694579824d2d41d0885731 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]) successfully deleted
I20251213 09:05:07.270503 17287 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=d200aba93522490ca20c90b9387df943]
I20251213 09:05:07.270747 17287 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 73) took 3858 ms. Trace:
I20251213 09:05:07.270810 17287 rpcz_store.cc:276] 1213 09:05:03.411968 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.636274 (+2224306us) service_pool.cc:225] Handling call
1213 09:05:06.119171 (+482897us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:06.119446 (+ 275us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:07.031533 (+912087us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:07.032061 (+ 528us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:07.032063 (+ 2us) write_op.cc:454] Released schema lock
1213 09:05:07.032205 (+ 142us) catalog_manager.cc:2181] Rolling back HMS table creation
1213 09:05:07.270731 (+238526us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:07.032014 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER)
1213 09:05:07.032022 (+ 8us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:07.032026 (+ 4us) write_op.cc:454] Released schema lock
1213 09:05:07.032029 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1059882,"Hive Metastore.run_cpu_time_us":404,"Hive Metastore.run_wall_time_us":90157,"child_traces":[["op",{}]]}
I20251213 09:05:07.271327 17850 raft_consensus.cc:2804] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:07.271435 17850 raft_consensus.cc:697] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:07.271488 18051 ts_tablet_manager.cc:1929] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:05:07.271586 18051 log.cc:1199] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/204b940a48ad4365921ae475f04f3b9c
I20251213 09:05:07.271569 17850 consensus_queue.cc:237] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.271792 18051 ts_tablet_manager.cc:1950] T 204b940a48ad4365921ae475f04f3b9c P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:07.273120 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 204b940a48ad4365921ae475f04f3b9c (table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]) successfully deleted
I20251213 09:05:07.269831 18054 raft_consensus.cc:2272] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.275612 18054 ts_tablet_manager.cc:1916] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.278577 18054 ts_tablet_manager.cc:1929] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.278668 18054 log.cc:1199] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/608f523767d946b18b8bbfe50ca23347
I20251213 09:05:07.278930 18054 ts_tablet_manager.cc:1950] T 608f523767d946b18b8bbfe50ca23347 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.279739 17622 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 608f523767d946b18b8bbfe50ca23347 (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]) successfully deleted
I20251213 09:05:07.280014 18054 tablet_replica.cc:333] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.280171 18054 raft_consensus.cc:2243] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.280309 18054 raft_consensus.cc:2272] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.280718 18054 ts_tablet_manager.cc:1916] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.283939 18057 tablet_bootstrap.cc:492] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.284127 18057 ts_tablet_manager.cc:1403] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20251213 09:05:07.284307 18054 ts_tablet_manager.cc:1929] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.284368 18054 log.cc:1199] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/466ce39a1a5d4037b9ce27eaba467266
I20251213 09:05:07.284623 18054 ts_tablet_manager.cc:1950] T 466ce39a1a5d4037b9ce27eaba467266 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.284771 18057 raft_consensus.cc:359] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.284914 18057 raft_consensus.cc:385] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.284955 18057 raft_consensus.cc:740] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.285106 18057 consensus_queue.cc:260] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.285413 18057 ts_tablet_manager.cc:1434] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:07.286752 17622 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 466ce39a1a5d4037b9ce27eaba467266 (table default.table_d1445dc6dbb1441d82855de496280fd7 [id=ad6f8e7d521942ceb1a70bd4515486d9]) successfully deleted
I20251213 09:05:07.287043 18054 tablet_replica.cc:333] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.287333 18054 raft_consensus.cc:2243] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.287457 18054 raft_consensus.cc:2272] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.288674 18054 ts_tablet_manager.cc:1916] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.290823 18054 ts_tablet_manager.cc:1929] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:05:07.290958 18054 log.cc:1199] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/204b940a48ad4365921ae475f04f3b9c
I20251213 09:05:07.291280 18054 ts_tablet_manager.cc:1950] T 204b940a48ad4365921ae475f04f3b9c P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.292114 17622 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 204b940a48ad4365921ae475f04f3b9c (table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]) successfully deleted
I20251213 09:05:07.305235 17640 catalog_manager.cc:3485] renamed table default.table_1b2da3534d4d457a886358d9b231dea8 [id=57463d6c4bc24d45ab54ddf180a102cd] in HMS: new name default.table_48ccfd3f31d24cd282be05bf417cd050
W20251213 09:05:07.308609 17636 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:07.309475 17703 catalog_manager.cc:2772] Deleting table default.table_e3c10aee5e2044a5b15b49197906acde [id=e980912308a64e02b8214c0a3dd22a82] in response to Hive Metastore notification log event 74
W20251213 09:05:07.309666 17703 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 74 DROP_TABLE default.table_e3c10aee5e2044a5b15b49197906acde: Not found: the table does not exist: table_id: "e980912308a64e02b8214c0a3dd22a82" table_name: "default.table_e3c10aee5e2044a5b15b49197906acde"
W20251213 09:05:07.309787 17633 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:07.310001 17703 catalog_manager.cc:2772] Deleting table default.table_af6c4a1282d24b2283671da41b9b0400 [id=d200aba93522490ca20c90b9387df943] in response to Hive Metastore notification log event 75
W20251213 09:05:07.310076 17703 hms_notification_log_listener.cc:329] Failed to handle Hive Metastore notification: 75 DROP_TABLE default.table_af6c4a1282d24b2283671da41b9b0400: Not found: the table does not exist: table_id: "d200aba93522490ca20c90b9387df943" table_name: "default.table_af6c4a1282d24b2283671da41b9b0400"
W20251213 09:05:07.310472 17634 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_b120cf88360b42c5a8a808744097cded in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251213 09:05:07.316409 17635 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c92c10038983476b9e3c8db243dcd67a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251213 09:05:07.323683 17640 catalog_manager.cc:5746] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367) does not have the latest schema for tablet c8276392af2740258e804f72f7529d16 (table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd]). Expected version 3 got 2
I20251213 09:05:07.328995 17631 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907] alter complete (version 1)
I20251213 09:05:07.331566 16796 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e15d3e0580943cfa60041729f1bff62 with delete_type TABLET_DATA_DELETED (replaced by tablet 204b940a48ad4365921ae475f04f3b9c) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.331784 16798 tablet_service.cc:1552] Processing DeleteTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.331902 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet c5dfe56534c5486a868b4d28aa494d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.332033 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet bd00dd09b602490ea10b92795bbc2b82 with delete_type TABLET_DATA_DELETED (replaced by tablet f394b4d388cd43a49ae4c3db293a893c) from {username='slave'} at 127.0.0.1:34192
W20251213 09:05:07.332846 17619 catalog_manager.cc:4952] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): delete failed for tablet 0e15d3e0580943cfa60041729f1bff62 because the tablet was not found. No further retry: Not found: Tablet not found: 0e15d3e0580943cfa60041729f1bff62
W20251213 09:05:07.333009 17619 catalog_manager.cc:4952] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): delete failed for tablet 466ce39a1a5d4037b9ce27eaba467266 because the tablet was not found. No further retry: Not found: Tablet not found: 466ce39a1a5d4037b9ce27eaba467266
W20251213 09:05:07.333132 17619 catalog_manager.cc:4952] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): delete failed for tablet c5dfe56534c5486a868b4d28aa494d0b because the tablet was not found. No further retry: Not found: Tablet not found: c5dfe56534c5486a868b4d28aa494d0b
W20251213 09:05:07.333245 17619 catalog_manager.cc:4952] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): delete failed for tablet bd00dd09b602490ea10b92795bbc2b82 because the tablet was not found. No further retry: Not found: Tablet not found: bd00dd09b602490ea10b92795bbc2b82
I20251213 09:05:07.333999 17631 catalog_manager.cc:5746] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345) does not have the latest schema for tablet c8276392af2740258e804f72f7529d16 (table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd]). Expected version 3 got 2
I20251213 09:05:07.342125 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e15d3e0580943cfa60041729f1bff62 with delete_type TABLET_DATA_DELETED (replaced by tablet 204b940a48ad4365921ae475f04f3b9c) from {username='slave'} at 127.0.0.1:57786
W20251213 09:05:07.342721 17621 catalog_manager.cc:4952] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): delete failed for tablet 0e15d3e0580943cfa60041729f1bff62 because the tablet was not found. No further retry: Not found: Tablet not found: 0e15d3e0580943cfa60041729f1bff62
I20251213 09:05:07.344621 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c7ab0cd8c694579824d2d41d0885731 with delete_type TABLET_DATA_DELETED (replaced by tablet e8b33140a56b49cf9068eb6b09613998) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.344832 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.345064 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet bd00dd09b602490ea10b92795bbc2b82 with delete_type TABLET_DATA_DELETED (replaced by tablet f394b4d388cd43a49ae4c3db293a893c) from {username='slave'} at 127.0.0.1:53838
W20251213 09:05:07.345127 17622 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet 5c7ab0cd8c694579824d2d41d0885731 because the tablet was not found. No further retry: Not found: Tablet not found: 5c7ab0cd8c694579824d2d41d0885731
W20251213 09:05:07.345304 17622 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet 466ce39a1a5d4037b9ce27eaba467266 because the tablet was not found. No further retry: Not found: Tablet not found: 466ce39a1a5d4037b9ce27eaba467266
I20251213 09:05:07.345316 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet c5dfe56534c5486a868b4d28aa494d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.345517 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 204b940a48ad4365921ae475f04f3b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.345497 17484 raft_consensus.cc:493] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:07.345606 17484 raft_consensus.cc:515] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.346022 17484 leader_election.cc:290] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
W20251213 09:05:07.346334 17622 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet bd00dd09b602490ea10b92795bbc2b82 because the tablet was not found. No further retry: Not found: Tablet not found: bd00dd09b602490ea10b92795bbc2b82
W20251213 09:05:07.346457 17622 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet c5dfe56534c5486a868b4d28aa494d0b because the tablet was not found. No further retry: Not found: Tablet not found: c5dfe56534c5486a868b4d28aa494d0b
I20251213 09:05:07.346513 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b33140a56b49cf9068eb6b09613998" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
W20251213 09:05:07.346563 17622 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet 204b940a48ad4365921ae475f04f3b9c because the tablet was not found. No further retry: Not found: Tablet not found: 204b940a48ad4365921ae475f04f3b9c
I20251213 09:05:07.346645 17093 raft_consensus.cc:2468] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:07.346947 16757 leader_election.cc:304] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:07.347379 17875 raft_consensus.cc:493] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:07.347491 17875 raft_consensus.cc:515] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.347877 17875 leader_election.cc:290] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.348052 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b33140a56b49cf9068eb6b09613998" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:07.348181 16956 raft_consensus.cc:2468] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:07.348615 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d0400b5bf3946de8ab82596a94b99ae" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:07.348732 17093 raft_consensus.cc:2468] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:07.349007 16894 leader_election.cc:304] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.349565 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d0400b5bf3946de8ab82596a94b99ae" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:07.349694 16819 raft_consensus.cc:2468] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:07.350100 17875 raft_consensus.cc:2804] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:07.350169 17875 raft_consensus.cc:493] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:07.350219 17875 raft_consensus.cc:3060] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.351210 17484 raft_consensus.cc:2804] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:07.351279 17484 raft_consensus.cc:493] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:07.351321 17484 raft_consensus.cc:3060] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.352298 17484 raft_consensus.cc:515] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.352658 17484 leader_election.cc:290] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:07.353145 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b33140a56b49cf9068eb6b09613998" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:07.353288 17093 raft_consensus.cc:3060] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.354202 17093 raft_consensus.cc:2468] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:07.354677 16757 leader_election.cc:304] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:07.355492 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8b33140a56b49cf9068eb6b09613998" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:07.355620 16956 raft_consensus.cc:3060] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.356629 16956 raft_consensus.cc:2468] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:07.357712 17875 raft_consensus.cc:515] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.358078 17875 leader_election.cc:290] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.358847 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d0400b5bf3946de8ab82596a94b99ae" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:07.358976 16819 raft_consensus.cc:3060] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.360037 16819 raft_consensus.cc:2468] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:07.360720 16891 leader_election.cc:304] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.361085 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9d0400b5bf3946de8ab82596a94b99ae" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:07.361204 17093 raft_consensus.cc:3060] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.362116 17093 raft_consensus.cc:2468] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:07.362686 17484 raft_consensus.cc:2804] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:07.362780 17484 raft_consensus.cc:697] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:07.362924 17484 consensus_queue.cc:237] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.363793 17875 raft_consensus.cc:2804] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:07.363898 17875 raft_consensus.cc:697] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:07.364037 17875 consensus_queue.cc:237] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.366448 17291 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=9e2a6770e19d4fde8081928cfa9612bd]
I20251213 09:05:07.366680 17291 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 72) took 4017 ms. Trace:
I20251213 09:05:07.366741 17291 rpcz_store.cc:276] 1213 09:05:03.349135 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.573745 (+2224610us) service_pool.cc:225] Handling call
1213 09:05:06.121064 (+547319us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:06.121410 (+ 346us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:07.046938 (+925528us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:07.047587 (+ 649us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:07.047590 (+ 3us) write_op.cc:454] Released schema lock
1213 09:05:07.047746 (+ 156us) catalog_manager.cc:2181] Rolling back HMS table creation
1213 09:05:07.366665 (+318919us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:07.047538 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER)
1213 09:05:07.047545 (+ 7us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:07.047550 (+ 5us) write_op.cc:454] Released schema lock
1213 09:05:07.047553 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1132594,"Hive Metastore.run_cpu_time_us":395,"Hive Metastore.run_wall_time_us":111175,"child_traces":[["op",{}]]}
I20251213 09:05:07.368700 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 608f523767d946b18b8bbfe50ca23347 with delete_type TABLET_DATA_DELETED (replaced by tablet 9d0400b5bf3946de8ab82596a94b99ae) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.368906 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c38f6e874044009a4656efa5dddd9a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.369153 17640 catalog_manager.cc:5654] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:07.370540 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 5c7ab0cd8c694579824d2d41d0885731 with delete_type TABLET_DATA_DELETED (replaced by tablet e8b33140a56b49cf9068eb6b09613998) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.370918 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 466ce39a1a5d4037b9ce27eaba467266 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:57786
W20251213 09:05:07.371030 17621 catalog_manager.cc:4952] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): delete failed for tablet 5c7ab0cd8c694579824d2d41d0885731 because the tablet was not found. No further retry: Not found: Tablet not found: 5c7ab0cd8c694579824d2d41d0885731
W20251213 09:05:07.371336 17621 catalog_manager.cc:4952] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): delete failed for tablet 466ce39a1a5d4037b9ce27eaba467266 because the tablet was not found. No further retry: Not found: Tablet not found: 466ce39a1a5d4037b9ce27eaba467266
I20251213 09:05:07.371812 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet c5dfe56534c5486a868b4d28aa494d0b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.372090 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 204b940a48ad4365921ae475f04f3b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:57786
W20251213 09:05:07.372233 17622 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet 608f523767d946b18b8bbfe50ca23347 because the tablet was not found. No further retry: Not found: Tablet not found: 608f523767d946b18b8bbfe50ca23347
I20251213 09:05:07.372282 18049 tablet_replica.cc:333] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.372412 18049 raft_consensus.cc:2243] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Raft consensus shutting down.
W20251213 09:05:07.372431 17622 catalog_manager.cc:4952] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): delete failed for tablet 5c38f6e874044009a4656efa5dddd9a7 because the tablet was not found. No further retry: Not found: Tablet not found: 5c38f6e874044009a4656efa5dddd9a7
I20251213 09:05:07.372534 18049 raft_consensus.cc:2272] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Raft consensus is shut down!
W20251213 09:05:07.373095 17621 catalog_manager.cc:4952] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): delete failed for tablet c5dfe56534c5486a868b4d28aa494d0b because the tablet was not found. No further retry: Not found: Tablet not found: c5dfe56534c5486a868b4d28aa494d0b
I20251213 09:05:07.373528 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet bd00dd09b602490ea10b92795bbc2b82 with delete_type TABLET_DATA_DELETED (replaced by tablet f394b4d388cd43a49ae4c3db293a893c) from {username='slave'} at 127.0.0.1:57786
I20251213 09:05:07.373996 18049 ts_tablet_manager.cc:1916] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.374172 17631 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39634:
name: "default.Table_a19aae3ffc1441ad9d2a8082df491a94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:07.376453 18049 ts_tablet_manager.cc:1929] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251213 09:05:07.377339 18049 log.cc:1199] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/204b940a48ad4365921ae475f04f3b9c
I20251213 09:05:07.377656 18049 ts_tablet_manager.cc:1950] T 204b940a48ad4365921ae475f04f3b9c P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.379076 17621 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 204b940a48ad4365921ae475f04f3b9c (table default.table_b3265ac4a94e4212945564c7137ada7c [id=bac9e29e59e64238a969a0bca23f9074]) successfully deleted
W20251213 09:05:07.379328 17621 catalog_manager.cc:4952] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): delete failed for tablet bd00dd09b602490ea10b92795bbc2b82 because the tablet was not found. No further retry: Not found: Tablet not found: bd00dd09b602490ea10b92795bbc2b82
I20251213 09:05:07.383522 17640 catalog_manager.cc:5654] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba49ca51d8eb4be288091d19e7114792 (127.15.213.2). New cstate: current_term: 1 leader_uuid: "ba49ca51d8eb4be288091d19e7114792" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: UNKNOWN } } }
I20251213 09:05:07.389794 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 204b940a48ad4365921ae475f04f3b9c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-12-13 09:05:07 UTC) from {username='slave'} at 127.0.0.1:57786
W20251213 09:05:07.390285 17621 catalog_manager.cc:4952] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): delete failed for tablet 204b940a48ad4365921ae475f04f3b9c because the tablet was not found. No further retry: Not found: Tablet not found: 204b940a48ad4365921ae475f04f3b9c
I20251213 09:05:07.390661 17290 catalog_manager.cc:2174] created HMS catalog entry for table [id=a6b238f424744d26948f94e973ea18cb]
W20251213 09:05:07.391166 17290 catalog_manager.cc:2202] Illegal state: an error occurred while writing to the sys-catalog: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER
I20251213 09:05:07.392357 17640 catalog_manager.cc:5654] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1). New cstate: current_term: 1 leader_uuid: "42c0ccabbfc1460685086e58e05cd152" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } health_report { overall_health: HEALTHY } } }
I20251213 09:05:07.393961 17637 catalog_manager.cc:3485] renamed table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb] in HMS: new name default.table_77ba98ea391f495daa07e314094f52c2
I20251213 09:05:07.399814 17640 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_430d04b174a84f139dae2021743273d2" } modify_external_catalogs: true
I20251213 09:05:07.399962 17640 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_430d04b174a84f139dae2021743273d2" } modify_external_catalogs: true
I20251213 09:05:07.404568 18086 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P 9714e48438da4ed8b629934850b1f7ce: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251213 09:05:07.406409 18085 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P 42c0ccabbfc1460685086e58e05cd152: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251213 09:05:07.409893 18084 tablet.cc:1722] T c8276392af2740258e804f72f7529d16 P ba49ca51d8eb4be288091d19e7114792: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251213 09:05:07.421105 17292 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=75537d22d2274862a5106e7a3cdf7992]
I20251213 09:05:07.421339 17292 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 74) took 3602 ms. Trace:
I20251213 09:05:07.421420 17292 rpcz_store.cc:276] 1213 09:05:03.819284 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:05.837201 (+2017917us) service_pool.cc:225] Handling call
1213 09:05:06.324367 (+487166us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:06.324753 (+ 386us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:07.071045 (+746292us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:07.071540 (+ 495us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:07.071542 (+ 2us) write_op.cc:454] Released schema lock
1213 09:05:07.071638 (+ 96us) catalog_manager.cc:2181] Rolling back HMS table creation
1213 09:05:07.421322 (+349684us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:07.071496 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER)
1213 09:05:07.071505 (+ 9us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:07.071509 (+ 4us) write_op.cc:454] Released schema lock
1213 09:05:07.071512 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":1043334,"Hive Metastore.run_cpu_time_us":287,"Hive Metastore.run_wall_time_us":51621,"child_traces":[["op",{}]]}
I20251213 09:05:07.446753 17290 catalog_manager.cc:2184] deleted orphaned HMS catalog entry for table [id=a6b238f424744d26948f94e973ea18cb]
I20251213 09:05:07.447022 17290 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:58844 (request call id 75) took 3118 ms. Trace:
I20251213 09:05:07.447082 17290 rpcz_store.cc:276] 1213 09:05:04.328799 (+ 0us) service_pool.cc:168] Inserting onto call queue
1213 09:05:06.379960 (+2051161us) service_pool.cc:225] Handling call
1213 09:05:07.051297 (+671337us) catalog_manager.cc:2101] Acquired catalog manager lock
1213 09:05:07.051645 (+ 348us) catalog_manager.cc:2147] Created new table and tablet info
1213 09:05:07.390652 (+339007us) catalog_manager.cc:2173] Created new table in HMS catalog
1213 09:05:07.391089 (+ 437us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:07.391092 (+ 3us) write_op.cc:454] Released schema lock
1213 09:05:07.391242 (+ 150us) catalog_manager.cc:2181] Rolling back HMS table creation
1213 09:05:07.447004 (+ 55762us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1213 09:05:07.391040 (+ 0us) op_driver.cc:389] HandleFailure(Illegal state: replica f0ef4ffe02ab44248dc97cb1c5cceac1 is not leader of this config: current role FOLLOWER)
1213 09:05:07.391049 (+ 9us) write_op.cc:489] Releasing partition, row and schema locks
1213 09:05:07.391054 (+ 5us) write_op.cc:454] Released schema lock
1213 09:05:07.391057 (+ 3us) write_op.cc:335] FINISH: Op aborted
Metrics: {"Hive Metastore.queue_time_us":344303,"Hive Metastore.run_cpu_time_us":394,"Hive Metastore.run_wall_time_us":49907,"child_traces":[["op",{}]]}
I20251213 09:05:07.448100 17639 catalog_manager.cc:3485] renamed table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1] in HMS: new name default.table_08f61de8c46c467ba64e2ccbc392e100
I20251213 09:05:07.480398 17638 catalog_manager.cc:3485] renamed table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8] in HMS: new name default.table_8ad4a38d0dcc447fb137dd4e3701421e
I20251213 09:05:07.498250 17636 catalog_manager.cc:2174] created HMS catalog entry for table [id=b271eec18bd34fccb6b89ababb0c66ad]
I20251213 09:05:07.515923 16797 tablet_service.cc:1505] Processing CreateTablet for tablet c75672e770be41aeb9fe180521d3f7af (DEFAULT_TABLE table=default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.516291 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75672e770be41aeb9fe180521d3f7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.518790 18056 tablet_bootstrap.cc:492] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:07.519948 18056 tablet_bootstrap.cc:654] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.521425 16933 tablet_service.cc:1505] Processing CreateTablet for tablet c75672e770be41aeb9fe180521d3f7af (DEFAULT_TABLE table=default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.521642 17068 tablet_service.cc:1505] Processing CreateTablet for tablet c75672e770be41aeb9fe180521d3f7af (DEFAULT_TABLE table=default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.521752 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75672e770be41aeb9fe180521d3f7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.521914 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c75672e770be41aeb9fe180521d3f7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.524219 18055 tablet_bootstrap.cc:492] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.524430 18056 tablet_bootstrap.cc:492] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.524525 18056 ts_tablet_manager.cc:1403] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:07.524585 17636 catalog_manager.cc:6199] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd] alter complete (version 3)
I20251213 09:05:07.525036 18056 raft_consensus.cc:359] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.525152 18056 raft_consensus.cc:385] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.525197 18056 raft_consensus.cc:740] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.525252 18055 tablet_bootstrap.cc:654] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.525339 18057 tablet_bootstrap.cc:492] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:07.525329 18056 consensus_queue.cc:260] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.526332 18057 tablet_bootstrap.cc:654] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.527374 18056 ts_tablet_manager.cc:1434] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:07.528213 18057 tablet_bootstrap.cc:492] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.528301 18057 ts_tablet_manager.cc:1403] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:07.528761 18057 raft_consensus.cc:359] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.528856 18057 raft_consensus.cc:385] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.528908 18057 raft_consensus.cc:740] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.529014 18057 consensus_queue.cc:260] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.529269 18057 ts_tablet_manager.cc:1434] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.532115 17633 catalog_manager.cc:2174] created HMS catalog entry for table [id=f4e627a281b14e5f8d99e77e64f3162a]
I20251213 09:05:07.537685 17633 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_fd1d1908e83b4925a03e655168a92b9e" } modify_external_catalogs: true
I20251213 09:05:07.537825 17633 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_fd1d1908e83b4925a03e655168a92b9e" } modify_external_catalogs: true
I20251213 09:05:07.538286 18055 tablet_bootstrap.cc:492] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.538307 17636 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" } modify_external_catalogs: true
I20251213 09:05:07.538369 18055 ts_tablet_manager.cc:1403] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20251213 09:05:07.538406 17636 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" } modify_external_catalogs: true
I20251213 09:05:07.538758 18055 raft_consensus.cc:359] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.538829 18055 raft_consensus.cc:385] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.538847 18055 raft_consensus.cc:740] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.538946 18055 consensus_queue.cc:260] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.539197 18055 ts_tablet_manager.cc:1434] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.546025 16933 tablet_service.cc:1505] Processing CreateTablet for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (DEFAULT_TABLE table=default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.546356 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5982bb569c3d48c0aeb7bc4018cfa533. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.547448 17068 tablet_service.cc:1505] Processing CreateTablet for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (DEFAULT_TABLE table=default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.547708 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5982bb569c3d48c0aeb7bc4018cfa533. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.548734 18057 tablet_bootstrap.cc:492] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:07.549799 18057 tablet_bootstrap.cc:654] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.549804 16797 tablet_service.cc:1505] Processing CreateTablet for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (DEFAULT_TABLE table=default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.550091 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5982bb569c3d48c0aeb7bc4018cfa533. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.551193 18057 tablet_bootstrap.cc:492] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.551270 18057 ts_tablet_manager.cc:1403] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:07.551695 18057 raft_consensus.cc:359] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.551786 18057 raft_consensus.cc:385] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.551813 18057 raft_consensus.cc:740] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.551923 18057 consensus_queue.cc:260] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.552152 18057 ts_tablet_manager.cc:1434] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.554878 18055 tablet_bootstrap.cc:492] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.556128 18055 tablet_bootstrap.cc:654] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.557050 18056 tablet_bootstrap.cc:492] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:07.557971 18056 tablet_bootstrap.cc:654] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.559132 18056 tablet_bootstrap.cc:492] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.559265 18056 ts_tablet_manager.cc:1403] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:07.559648 18056 raft_consensus.cc:359] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.559777 18056 raft_consensus.cc:385] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.559830 18056 raft_consensus.cc:740] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.559962 18056 consensus_queue.cc:260] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.560299 18056 ts_tablet_manager.cc:1434] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:07.561026 18055 tablet_bootstrap.cc:492] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.561120 18055 ts_tablet_manager.cc:1403] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:07.561606 18055 raft_consensus.cc:359] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.561717 18055 raft_consensus.cc:385] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.561750 18055 raft_consensus.cc:740] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.561865 18055 consensus_queue.cc:260] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.562129 18055 ts_tablet_manager.cc:1434] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.569566 17632 catalog_manager.cc:2731] deleted HMS catalog entry for table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:07.584918 17635 catalog_manager.cc:2174] created HMS catalog entry for table [id=f22159672ee7408e9a2fa8683784b63e]
I20251213 09:05:07.597360 16933 tablet_service.cc:1505] Processing CreateTablet for tablet 33c857d1903b479bb62d8173a4e6f22e (DEFAULT_TABLE table=default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.597386 16797 tablet_service.cc:1505] Processing CreateTablet for tablet 33c857d1903b479bb62d8173a4e6f22e (DEFAULT_TABLE table=default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.597699 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c857d1903b479bb62d8173a4e6f22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.597702 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c857d1903b479bb62d8173a4e6f22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.599956 18056 tablet_bootstrap.cc:492] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:07.601042 18056 tablet_bootstrap.cc:654] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.601734 18057 tablet_bootstrap.cc:492] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:07.602703 18057 tablet_bootstrap.cc:654] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.603065 17635 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_9dc2b6abe24f4a86ade24c79c38fa2e3" } modify_external_catalogs: true
I20251213 09:05:07.603286 17635 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39634:
table { table_name: "default.Table_9dc2b6abe24f4a86ade24c79c38fa2e3" } modify_external_catalogs: true
I20251213 09:05:07.605139 17068 tablet_service.cc:1505] Processing CreateTablet for tablet 33c857d1903b479bb62d8173a4e6f22e (DEFAULT_TABLE table=default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.605432 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33c857d1903b479bb62d8173a4e6f22e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.607596 18055 tablet_bootstrap.cc:492] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.608595 18055 tablet_bootstrap.cc:654] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.611227 18055 tablet_bootstrap.cc:492] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.611315 18055 ts_tablet_manager.cc:1403] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:07.611809 18055 raft_consensus.cc:359] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.611925 18055 raft_consensus.cc:385] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.611959 18055 raft_consensus.cc:740] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.612082 18055 consensus_queue.cc:260] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.612399 18055 ts_tablet_manager.cc:1434] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.612985 18056 tablet_bootstrap.cc:492] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.613137 18056 ts_tablet_manager.cc:1403] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251213 09:05:07.613672 18056 raft_consensus.cc:359] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.613776 18056 raft_consensus.cc:385] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.613806 18056 raft_consensus.cc:740] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.613916 18056 consensus_queue.cc:260] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.614183 18056 ts_tablet_manager.cc:1434] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:07.616669 18057 tablet_bootstrap.cc:492] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.616761 18057 ts_tablet_manager.cc:1403] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251213 09:05:07.617199 18057 raft_consensus.cc:359] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.617326 18057 raft_consensus.cc:385] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.617355 18057 raft_consensus.cc:740] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.617479 18057 consensus_queue.cc:260] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.617760 18057 ts_tablet_manager.cc:1434] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:07.622860 17634 catalog_manager.cc:2174] created HMS catalog entry for table [id=19c22abba4b545659b28e8e9eda9a7aa]
F20251213 09:05:07.627843 17703 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 6 out of 12 received events: NotificationEvent(eventId=77, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_82ff078f92894308a9243b01684306d0, message={"server":"","servicePrincipal":"","db":"default","table":"table_82ff078f92894308a9243b01684306d0","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_82ff078f92894308a9243b01684306d0\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_82ff078f92894308a9243b01684306d0\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_82ff078f92894308a9243b01684306d0\",\"transient_lastDdlTime\":\"1765616707\",\"kudu.table_id\":\"9e2a6770e19d4fde8081928cfa9612bd\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1765616707, eventType=CREATE_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_77ba98ea391f495daa07e314094f52c2, message={"server":"","servicePrincipal":"","db":"default","table":"table_731dc67a6a2b407180abef538691c40c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_731dc67a6a2b407180abef538691c40c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_731dc67a6a2b407180abef538691c40c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_731dc67a6a2b407180abef538691c40c\",\"transient_lastDdlTime\":\"1765616703\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_77ba98ea391f495daa07e314094f52c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_77ba98ea391f495daa07e314094f52c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_77ba98ea391f495daa07e314094f52c2\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"transient_lastDdlTime\":\"1765616703\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_cfb419171a574069b4e41856a31a16f7, message={"server":"","servicePrincipal":"","db":"default","table":"table_cfb419171a574069b4e41856a31a16f7","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_cfb419171a574069b4e41856a31a16f7\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_cfb419171a574069b4e41856a31a16f7\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_cfb419171a574069b4e41856a31a16f7\",\"kudu.table_id\":\"75537d22d2274862a5106e7a3cdf7992\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_08f61de8c46c467ba64e2ccbc392e100, message={"server":"","servicePrincipal":"","db":"default","table":"table_a90e27bac3a946e5bdd85f229deeb4be","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_a90e27bac3a946e5bdd85f229deeb4be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a90e27bac3a946e5bdd85f229deeb4be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a90e27bac3a946e5bdd85f229deeb4be\",\"transient_lastDdlTime\":\"1765616701\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_08f61de8c46c467ba64e2ccbc392e100\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_08f61de8c46c467ba64e2ccbc392e100\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_08f61de8c46c467ba64e2ccbc392e100\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"transient_lastDdlTime\":\"1765616701\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20251213 09:05:07.631470 17634 master_service.cc:954] ReplaceTablet: received request to replace tablet ecd3bbba1b1b4529bfea1fac9ca704bf from {username='slave'} at 127.0.0.1:39634
I20251213 09:05:07.638949 17634 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet ecd3bbba1b1b4529bfea1fac9ca704bf
I20251213 09:05:07.638904 16797 tablet_service.cc:1505] Processing CreateTablet for tablet d49fcf75fc57485fa8ab3ee432aa3772 (DEFAULT_TABLE table=default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.639029 17068 tablet_service.cc:1505] Processing CreateTablet for tablet d49fcf75fc57485fa8ab3ee432aa3772 (DEFAULT_TABLE table=default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.639245 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49fcf75fc57485fa8ab3ee432aa3772. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.639307 17634 catalog_manager.cc:6724] ReplaceTablet: tablet ecd3bbba1b1b4529bfea1fac9ca704bf deleted and replaced by tablet 12254c0d95144f8e8d958647924a5ee2
I20251213 09:05:07.639338 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49fcf75fc57485fa8ab3ee432aa3772. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.641350 17634 master_service.cc:954] ReplaceTablet: received request to replace tablet 8a9c4e8b224d440dbab9d693bbba9e37 from {username='slave'} at 127.0.0.1:39634
I20251213 09:05:07.642697 16933 tablet_service.cc:1505] Processing CreateTablet for tablet d49fcf75fc57485fa8ab3ee432aa3772 (DEFAULT_TABLE table=default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.642997 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d49fcf75fc57485fa8ab3ee432aa3772. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.643937 17757 raft_consensus.cc:493] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:07.644038 17757 raft_consensus.cc:515] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.644460 17757 leader_election.cc:290] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.645756 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5982bb569c3d48c0aeb7bc4018cfa533" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:07.645895 17093 raft_consensus.cc:2468] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:07.646219 16894 leader_election.cc:304] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.646247 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5982bb569c3d48c0aeb7bc4018cfa533" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:07.646379 16819 raft_consensus.cc:2468] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:07.646780 17757 raft_consensus.cc:2804] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:07.646842 17757 raft_consensus.cc:493] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:07.646871 18057 tablet_bootstrap.cc:492] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:07.646893 17757 raft_consensus.cc:3060] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.648028 18057 tablet_bootstrap.cc:654] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.648097 17757 raft_consensus.cc:515] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.648475 17757 leader_election.cc:290] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.648942 18056 tablet_bootstrap.cc:492] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:07.649202 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5982bb569c3d48c0aeb7bc4018cfa533" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:07.649312 17093 raft_consensus.cc:3060] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.649914 18056 tablet_bootstrap.cc:654] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.650297 17093 raft_consensus.cc:2468] T 5982bb569c3d48c0aeb7bc4018cfa533 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:07.650645 18055 tablet_bootstrap.cc:492] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.650736 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5982bb569c3d48c0aeb7bc4018cfa533" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:07.650846 16819 raft_consensus.cc:3060] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.651613 18055 tablet_bootstrap.cc:654] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.651816 16819 raft_consensus.cc:2468] T 5982bb569c3d48c0aeb7bc4018cfa533 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:07.652302 18056 tablet_bootstrap.cc:492] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.652423 18056 ts_tablet_manager.cc:1403] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:07.652806 16894 leader_election.cc:304] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.652992 18056 raft_consensus.cc:359] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.653092 17874 raft_consensus.cc:2804] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:07.653213 17874 raft_consensus.cc:697] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:07.653215 18056 raft_consensus.cc:385] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.653321 18056 raft_consensus.cc:740] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.653384 17874 consensus_queue.cc:237] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.653573 18056 consensus_queue.cc:260] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
@ 0x7ff8278f5dcd google::LogMessage::Fail() at ??:0
I20251213 09:05:07.656997 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet ecd3bbba1b1b4529bfea1fac9ca704bf with delete_type TABLET_DATA_DELETED (replaced by tablet 12254c0d95144f8e8d958647924a5ee2) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.657179 18051 tablet_replica.cc:333] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.657181 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet ecd3bbba1b1b4529bfea1fac9ca704bf with delete_type TABLET_DATA_DELETED (replaced by tablet 12254c0d95144f8e8d958647924a5ee2) from {username='slave'} at 127.0.0.1:53838
I20251213 09:05:07.657490 18051 raft_consensus.cc:2243] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:07.657725 18051 raft_consensus.cc:2272] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.657920 18054 tablet_replica.cc:333] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:07.658064 18054 raft_consensus.cc:2243] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.658182 18054 raft_consensus.cc:2272] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.659381 18054 ts_tablet_manager.cc:1916] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.659432 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet ecd3bbba1b1b4529bfea1fac9ca704bf with delete_type TABLET_DATA_DELETED (replaced by tablet 12254c0d95144f8e8d958647924a5ee2) from {username='slave'} at 127.0.0.1:57786
@ 0x7ff8278f9b93 google::LogMessage::SendToLog() at ??:0
I20251213 09:05:07.659956 18049 tablet_replica.cc:333] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:07.660115 18049 raft_consensus.cc:2243] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.660228 18049 raft_consensus.cc:2272] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.660859 18049 ts_tablet_manager.cc:1916] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:07.661723 18054 ts_tablet_manager.cc:1929] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.661791 18054 log.cc:1199] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/ecd3bbba1b1b4529bfea1fac9ca704bf
@ 0x7ff8278f57cc google::LogMessage::Flush() at ??:0
I20251213 09:05:07.661955 18056 ts_tablet_manager.cc:1434] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20251213 09:05:07.662063 18054 ts_tablet_manager.cc:1950] T ecd3bbba1b1b4529bfea1fac9ca704bf P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:07.662909 17622 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet ecd3bbba1b1b4529bfea1fac9ca704bf (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]) successfully deleted
I20251213 09:05:07.664209 18051 ts_tablet_manager.cc:1916] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7ff8278f5a11 google::LogMessage::~LogMessage() at ??:0
I20251213 09:05:07.665679 18055 tablet_bootstrap.cc:492] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.665766 18055 ts_tablet_manager.cc:1403] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251213 09:05:07.666391 18055 raft_consensus.cc:359] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.666467 18051 ts_tablet_manager.cc:1929] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.666510 18055 raft_consensus.cc:385] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.666534 18051 log.cc:1199] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/ecd3bbba1b1b4529bfea1fac9ca704bf
I20251213 09:05:07.666560 18055 raft_consensus.cc:740] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.666703 18055 consensus_queue.cc:260] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.666807 18051 ts_tablet_manager.cc:1950] T ecd3bbba1b1b4529bfea1fac9ca704bf P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:07.667076 18055 ts_tablet_manager.cc:1434] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:07.667550 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet ecd3bbba1b1b4529bfea1fac9ca704bf (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]) successfully deleted
@ 0x7ff82ca69279 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20251213 09:05:07.671587 17068 tablet_service.cc:1505] Processing CreateTablet for tablet 12254c0d95144f8e8d958647924a5ee2 (DEFAULT_TABLE table=default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.671711 16933 tablet_service.cc:1505] Processing CreateTablet for tablet 12254c0d95144f8e8d958647924a5ee2 (DEFAULT_TABLE table=default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.671844 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12254c0d95144f8e8d958647924a5ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.673997 18055 tablet_bootstrap.cc:492] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:07.674081 16797 tablet_service.cc:1505] Processing CreateTablet for tablet 12254c0d95144f8e8d958647924a5ee2 (DEFAULT_TABLE table=default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:07.674425 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12254c0d95144f8e8d958647924a5ee2. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff82ca68190 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20251213 09:05:07.675096 18055 tablet_bootstrap.cc:654] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.675290 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12254c0d95144f8e8d958647924a5ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:07.677460 18056 tablet_bootstrap.cc:492] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
@ 0x7ff82ca678f3 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20251213 09:05:07.678303 18049 ts_tablet_manager.cc:1929] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:07.678382 18049 log.cc:1199] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/ecd3bbba1b1b4529bfea1fac9ca704bf
I20251213 09:05:07.678702 18049 ts_tablet_manager.cc:1950] T ecd3bbba1b1b4529bfea1fac9ca704bf P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:07.678982 18056 tablet_bootstrap.cc:654] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.679550 17621 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet ecd3bbba1b1b4529bfea1fac9ca704bf (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]) successfully deleted
I20251213 09:05:07.680161 18057 tablet_bootstrap.cc:492] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.680202 18055 tablet_bootstrap.cc:492] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:07.680253 18057 ts_tablet_manager.cc:1403] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20251213 09:05:07.680291 18055 ts_tablet_manager.cc:1403] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s
I20251213 09:05:07.680814 18055 raft_consensus.cc:359] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.680924 18055 raft_consensus.cc:385] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.680959 18055 raft_consensus.cc:740] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
@ 0x7ff82ca6cffa _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20251213 09:05:07.681118 18055 consensus_queue.cc:260] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.681509 18055 ts_tablet_manager.cc:1434] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
@ 0x561a0cdb3a0a std::function<>::operator()() at ??:0
I20251213 09:05:07.682753 17634 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 8a9c4e8b224d440dbab9d693bbba9e37
I20251213 09:05:07.683293 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet 8a9c4e8b224d440dbab9d693bbba9e37 with delete_type TABLET_DATA_DELETED (replaced by tablet e8e967a592a442c28f19f8ab943a8528) from {username='slave'} at 127.0.0.1:34192
I20251213 09:05:07.683482 18051 tablet_replica.cc:333] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:07.683642 18051 raft_consensus.cc:2243] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:07.683768 18051 raft_consensus.cc:2272] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:07.684217 18051 ts_tablet_manager.cc:1916] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7ff828d4f7dc kudu::Thread::SuperviseThread() at ??:0
I20251213 09:05:07.687355 18051 ts_tablet_manager.cc:1929] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:07.687424 18051 log.cc:1199] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/8a9c4e8b224d440dbab9d693bbba9e37
I20251213 09:05:07.687682 18051 ts_tablet_manager.cc:1950] T 8a9c4e8b224d440dbab9d693bbba9e37 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
@ 0x7ff8295e86db start_thread at ??:0
I20251213 09:05:07.688588 18056 tablet_bootstrap.cc:492] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:07.688575 17619 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 8a9c4e8b224d440dbab9d693bbba9e37 (table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]) successfully deleted
I20251213 09:05:07.688676 18056 ts_tablet_manager.cc:1403] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20251213 09:05:07.689306 18056 raft_consensus.cc:359] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.689430 18056 raft_consensus.cc:385] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.689476 18056 raft_consensus.cc:740] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.689621 18056 consensus_queue.cc:260] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.690013 18056 ts_tablet_manager.cc:1434] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:07.680876 18057 raft_consensus.cc:359] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.690217 18057 raft_consensus.cc:385] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.690282 18057 raft_consensus.cc:740] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.690410 18057 consensus_queue.cc:260] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.690692 18057 ts_tablet_manager.cc:1434] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20251213 09:05:07.690891 18057 tablet_bootstrap.cc:492] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
@ 0x7ff826aac71f clone at ??:0
I20251213 09:05:07.694065 18057 tablet_bootstrap.cc:654] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:07.705061 18057 tablet_bootstrap.cc:492] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:07.705261 18057 ts_tablet_manager.cc:1403] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s
I20251213 09:05:07.706142 18057 raft_consensus.cc:359] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.706271 18057 raft_consensus.cc:385] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:07.706306 18057 raft_consensus.cc:740] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:07.706466 18057 consensus_queue.cc:260] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.706766 18057 ts_tablet_manager.cc:1434] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:07.710940 18031 raft_consensus.cc:493] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:07.711054 18031 raft_consensus.cc:515] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.711603 18031 leader_election.cc:290] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.711948 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c75672e770be41aeb9fe180521d3f7af" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:07.712073 16956 raft_consensus.cc:2468] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:07.712550 17028 leader_election.cc:304] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.712729 18031 raft_consensus.cc:2804] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:07.712790 18031 raft_consensus.cc:493] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:07.712831 18031 raft_consensus.cc:3060] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.713080 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c75672e770be41aeb9fe180521d3f7af" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:07.713236 16819 raft_consensus.cc:2468] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:07.714030 18031 raft_consensus.cc:515] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.714438 18031 leader_election.cc:290] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.714888 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c75672e770be41aeb9fe180521d3f7af" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:07.715013 16957 raft_consensus.cc:3060] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.716042 16957 raft_consensus.cc:2468] T c75672e770be41aeb9fe180521d3f7af P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:07.716642 17028 leader_election.cc:304] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.716900 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c75672e770be41aeb9fe180521d3f7af" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:07.717023 16819 raft_consensus.cc:3060] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.718123 16819 raft_consensus.cc:2468] T c75672e770be41aeb9fe180521d3f7af P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:07.718699 18031 raft_consensus.cc:2804] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:07.718796 18031 raft_consensus.cc:697] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:07.718952 18031 consensus_queue.cc:237] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.730500 18031 raft_consensus.cc:493] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:07.730634 18031 raft_consensus.cc:515] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.731079 18031 leader_election.cc:290] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.731657 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12254c0d95144f8e8d958647924a5ee2" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:07.731683 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12254c0d95144f8e8d958647924a5ee2" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:07.731794 16819 raft_consensus.cc:2468] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:07.731839 16957 raft_consensus.cc:2468] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:07.732108 17026 leader_election.cc:304] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:07.732313 18031 raft_consensus.cc:2804] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:07.732357 18031 raft_consensus.cc:493] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:07.732393 18031 raft_consensus.cc:3060] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.733502 18031 raft_consensus.cc:515] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.733876 18031 leader_election.cc:290] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.734447 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12254c0d95144f8e8d958647924a5ee2" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:07.734549 16819 raft_consensus.cc:3060] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.734647 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12254c0d95144f8e8d958647924a5ee2" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:07.734764 16956 raft_consensus.cc:3060] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.735540 16819 raft_consensus.cc:2468] T 12254c0d95144f8e8d958647924a5ee2 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:07.735838 17026 leader_election.cc:304] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:07.735903 16956 raft_consensus.cc:2468] T 12254c0d95144f8e8d958647924a5ee2 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:07.736040 18031 raft_consensus.cc:2804] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:07.736153 18031 raft_consensus.cc:697] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:07.736315 18031 consensus_queue.cc:237] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.791777 17484 consensus_queue.cc:1048] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:07.793226 17484 consensus_queue.cc:1048] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251213 09:05:07.830260 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:07.869427 17757 raft_consensus.cc:493] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:07.869599 17757 raft_consensus.cc:515] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.870123 17757 leader_election.cc:290] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.870625 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c857d1903b479bb62d8173a4e6f22e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:07.870767 16820 raft_consensus.cc:2468] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:07.870925 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c857d1903b479bb62d8173a4e6f22e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:07.871083 17092 raft_consensus.cc:2468] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:07.871446 16894 leader_election.cc:304] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.871466 17757 consensus_queue.cc:1048] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:07.871655 17875 raft_consensus.cc:2804] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:07.871702 17875 raft_consensus.cc:493] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:07.871743 17875 raft_consensus.cc:3060] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.872900 17875 raft_consensus.cc:515] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.873270 17875 leader_election.cc:290] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.873930 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c857d1903b479bb62d8173a4e6f22e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:07.874051 17092 raft_consensus.cc:3060] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.875150 17092 raft_consensus.cc:2468] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:07.875654 16894 leader_election.cc:304] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:07.875844 17875 raft_consensus.cc:2804] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:07.875931 17875 raft_consensus.cc:697] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:07.876070 17875 consensus_queue.cc:237] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.876371 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "33c857d1903b479bb62d8173a4e6f22e" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:07.876479 16820 raft_consensus.cc:3060] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.877526 16820 raft_consensus.cc:2468] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:07.877811 17850 consensus_queue.cc:1048] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251213 09:05:07.879335 17146 connection.cc:537] client connection to 127.15.213.62:42117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251213 09:05:07.879443 17874 consensus_queue.cc:1048] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:07.886767 17484 consensus_queue.cc:1048] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251213 09:05:07.888099 18123 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:07.879162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.15.213.3:47557)
1213 09:05:07.883815 (+ 4653us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:07.883880 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":4571,"thread_start_us":88,"threads_started":1}
W20251213 09:05:07.895846 18122 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:07.879007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.15.213.1:57349)
1213 09:05:07.881473 (+ 2466us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:07.881543 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":2378,"thread_start_us":71,"threads_started":1}
I20251213 09:05:07.896967 17911 raft_consensus.cc:493] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:07.897089 17911 raft_consensus.cc:515] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.897452 17911 leader_election.cc:290] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.897756 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d49fcf75fc57485fa8ab3ee432aa3772" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:07.897806 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d49fcf75fc57485fa8ab3ee432aa3772" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:07.897902 16957 raft_consensus.cc:2468] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:07.897922 16820 raft_consensus.cc:2468] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:07.898259 17026 leader_election.cc:304] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:07.898481 18031 raft_consensus.cc:2804] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:07.898533 18031 raft_consensus.cc:493] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:07.898592 18031 raft_consensus.cc:3060] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.899587 18031 raft_consensus.cc:515] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:07.899916 18031 leader_election.cc:290] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:07.900267 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d49fcf75fc57485fa8ab3ee432aa3772" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:07.900386 16820 raft_consensus.cc:3060] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.900506 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d49fcf75fc57485fa8ab3ee432aa3772" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:07.900610 16957 raft_consensus.cc:3060] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:07.901399 16820 raft_consensus.cc:2468] T d49fcf75fc57485fa8ab3ee432aa3772 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:07.901546 16957 raft_consensus.cc:2468] T d49fcf75fc57485fa8ab3ee432aa3772 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:07.901755 17026 leader_election.cc:304] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:07.901952 18031 raft_consensus.cc:2804] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:07.902046 18031 raft_consensus.cc:697] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:07.902184 18031 consensus_queue.cc:237] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } }
I20251213 09:05:08.090708 17757 consensus_queue.cc:1048] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.094740 17875 consensus_queue.cc:1048] T 5982bb569c3d48c0aeb7bc4018cfa533 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.151978 18132 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:08.152107 18132 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:08.153383 18132 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
I20251213 09:05:08.153806 17306 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7f61ccb4ffd4066babfa94938e28b87" candidate_term: 4 candidate_status { last_received { term: 3 index: 241 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" is_pre_election: true
W20251213 09:05:08.153968 17937 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:08.153940 17911 consensus_queue.cc:1048] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251213 09:05:08.155048 17937 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:08.155162 17937 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:08.155588 18132 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251213 09:05:08.158802 18031 consensus_queue.cc:1048] T c75672e770be41aeb9fe180521d3f7af P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.161414 18138 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:08.161532 18138 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
W20251213 09:05:08.163594 17280 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 5 similar messages]
I20251213 09:05:08.163757 17961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" candidate_term: 4 candidate_status { last_received { term: 3 index: 241 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87" is_pre_election: true
I20251213 09:05:08.163892 17961 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ef4ffe02ab44248dc97cb1c5cceac1 in term 3.
I20251213 09:05:08.164045 18138 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:08.164552 17283 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters:
W20251213 09:05:08.164651 17280 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:08.164712 18138 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251213 09:05:08.164773 18138 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:08.164821 18138 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 3 FOLLOWER]: Advancing to term 4
I20251213 09:05:08.165663 18138 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:08.165966 18138 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 4 election: Requested vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:08.166255 17961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" candidate_term: 4 candidate_status { last_received { term: 3 index: 241 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87"
I20251213 09:05:08.166353 17961 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 3 FOLLOWER]: Advancing to term 4
W20251213 09:05:08.166859 17280 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:08.167167 17961 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ef4ffe02ab44248dc97cb1c5cceac1 in term 4.
I20251213 09:05:08.167451 17283 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982
I20251213 09:05:08.167613 18138 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 4 FOLLOWER]: Leader election won for term 4
I20251213 09:05:08.167814 18138 raft_consensus.cc:697] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 4 LEADER]: Becoming Leader. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Running, Role: LEADER
I20251213 09:05:08.167960 18138 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 241, Committed index: 241, Last appended: 3.241, Last appended by leader: 241, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:08.168555 18142 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ef4ffe02ab44248dc97cb1c5cceac1. Latest consensus state: current_term: 4 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:08.168643 18142 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:08.168861 18143 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:05:08.170805 18143 catalog_manager.cc:679] Loaded metadata for table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:08.171234 18143 catalog_manager.cc:679] Loaded metadata for table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]
I20251213 09:05:08.171438 18143 catalog_manager.cc:679] Loaded metadata for table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]
I20251213 09:05:08.171645 18143 catalog_manager.cc:679] Loaded metadata for table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]
I20251213 09:05:08.171835 18143 catalog_manager.cc:679] Loaded metadata for table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]
I20251213 09:05:08.172049 18143 catalog_manager.cc:679] Loaded metadata for table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]
I20251213 09:05:08.172421 18143 catalog_manager.cc:679] Loaded metadata for table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:08.172824 18143 catalog_manager.cc:679] Loaded metadata for table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]
I20251213 09:05:08.173148 18143 catalog_manager.cc:679] Loaded metadata for table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:08.173345 18143 catalog_manager.cc:679] Loaded metadata for table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]
I20251213 09:05:08.173532 18143 catalog_manager.cc:679] Loaded metadata for table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]
I20251213 09:05:08.173713 18143 catalog_manager.cc:679] Loaded metadata for table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:05:08.173897 18143 catalog_manager.cc:679] Loaded metadata for table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]
I20251213 09:05:08.174081 18143 catalog_manager.cc:679] Loaded metadata for table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:05:08.174432 18143 catalog_manager.cc:679] Loaded metadata for table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]
I20251213 09:05:08.174698 18143 catalog_manager.cc:679] Loaded metadata for table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:08.174878 18143 catalog_manager.cc:679] Loaded metadata for table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]
I20251213 09:05:08.175072 18143 catalog_manager.cc:679] Loaded metadata for table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]
I20251213 09:05:08.175458 18143 catalog_manager.cc:679] Loaded metadata for table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]
I20251213 09:05:08.175724 18143 catalog_manager.cc:679] Loaded metadata for table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]
I20251213 09:05:08.175902 18143 catalog_manager.cc:679] Loaded metadata for table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:08.176082 18143 catalog_manager.cc:679] Loaded metadata for table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]
I20251213 09:05:08.176270 18143 catalog_manager.cc:679] Loaded metadata for table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:08.176481 18143 catalog_manager.cc:679] Loaded metadata for table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:08.176707 18143 catalog_manager.cc:679] Loaded metadata for table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:08.177047 18143 catalog_manager.cc:679] Loaded metadata for table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]
I20251213 09:05:08.177243 18143 catalog_manager.cc:679] Loaded metadata for table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]
I20251213 09:05:08.177453 18143 catalog_manager.cc:679] Loaded metadata for table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]
I20251213 09:05:08.178930 18143 tablet_loader.cc:96] loaded metadata for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d])
I20251213 09:05:08.179558 18143 tablet_loader.cc:96] loaded metadata for tablet 12254c0d95144f8e8d958647924a5ee2 (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f])
I20251213 09:05:08.179759 18143 tablet_loader.cc:96] loaded metadata for tablet 1391d28e1e4046b4af9f0b06ae539c0d (table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d])
I20251213 09:05:08.179934 18143 tablet_loader.cc:96] loaded metadata for tablet 13b11eb6cf6b4560b693797ca18292e4 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253])
I20251213 09:05:08.180274 18143 tablet_loader.cc:96] loaded metadata for tablet 33c857d1903b479bb62d8173a4e6f22e (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e])
I20251213 09:05:08.180433 18143 tablet_loader.cc:96] loaded metadata for tablet 33e5ff40d6b24f51956d050c23d41eb7 (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454])
I20251213 09:05:08.180671 18143 tablet_loader.cc:96] loaded metadata for tablet 3afb8349ced4486d8a283966ac647965 (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8])
I20251213 09:05:08.181207 18143 tablet_loader.cc:96] loaded metadata for tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb])
I20251213 09:05:08.181387 18143 tablet_loader.cc:96] loaded metadata for tablet 4a86f3d6176a4a4681c0fb31649e0eab (table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907])
I20251213 09:05:08.181706 18143 tablet_loader.cc:96] loaded metadata for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a])
I20251213 09:05:08.182118 18143 tablet_loader.cc:96] loaded metadata for tablet 604c2f416148499ab5651c43cd1491a1 (table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d])
I20251213 09:05:08.182523 18143 tablet_loader.cc:96] loaded metadata for tablet 62236955121e49ec800c5e37a40c5b19 (table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644])
I20251213 09:05:08.182919 18143 tablet_loader.cc:96] loaded metadata for tablet 79d28675183f4fb1ad9a573cab3bba32 (table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a])
I20251213 09:05:08.183080 18143 tablet_loader.cc:96] loaded metadata for tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c])
I20251213 09:05:08.183681 18143 tablet_loader.cc:96] loaded metadata for tablet 9d0400b5bf3946de8ab82596a94b99ae (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5])
I20251213 09:05:08.184083 18143 tablet_loader.cc:96] loaded metadata for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893])
I20251213 09:05:08.184334 18143 tablet_loader.cc:96] loaded metadata for tablet b3c914dd363847b2a5730feb0c3e9c11 (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d])
I20251213 09:05:08.184815 18143 tablet_loader.cc:96] loaded metadata for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07])
I20251213 09:05:08.185034 18143 tablet_loader.cc:96] loaded metadata for tablet c5adcb68c5b9438da10370479acbed52 (table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba])
I20251213 09:05:08.185314 18143 tablet_loader.cc:96] loaded metadata for tablet c75672e770be41aeb9fe180521d3f7af (table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad])
I20251213 09:05:08.185487 18143 tablet_loader.cc:96] loaded metadata for tablet c8276392af2740258e804f72f7529d16 (table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd])
I20251213 09:05:08.185663 18143 tablet_loader.cc:96] loaded metadata for tablet d49fcf75fc57485fa8ab3ee432aa3772 (table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa])
I20251213 09:05:08.185741 18031 consensus_queue.cc:1048] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.186252 18143 tablet_loader.cc:96] loaded metadata for tablet e8b33140a56b49cf9068eb6b09613998 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd])
I20251213 09:05:08.186457 18143 tablet_loader.cc:96] loaded metadata for tablet e8e967a592a442c28f19f8ab943a8528 (table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce])
I20251213 09:05:08.186659 18143 tablet_loader.cc:96] loaded metadata for tablet eb95522d80454b48af6bfdd05fb684d6 (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46])
I20251213 09:05:08.187196 18143 tablet_loader.cc:96] loaded metadata for tablet f394b4d388cd43a49ae4c3db293a893c (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1])
I20251213 09:05:08.187390 18143 tablet_loader.cc:96] loaded metadata for tablet f3b4a3ff63414a5da3faa9023644c677 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f])
I20251213 09:05:08.187660 18143 tablet_loader.cc:96] loaded metadata for tablet fb68b603c201419491b09993080789b5 (table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee])
I20251213 09:05:08.189018 18143 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:05:08.190704 18143 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:08.190757 18143 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:05:08.190794 17911 consensus_queue.cc:1048] T 12254c0d95144f8e8d958647924a5ee2 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.195925 18143 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:05:08.197065 18143 catalog_manager.cc:6038] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Loaded TSK: 0
I20251213 09:05:08.197331 18143 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:05:08.198318 18143 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:05:08.199299 18143 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 76
I20251213 09:05:08.213971 17292 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_cfb419171a574069b4e41856a31a16f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:08.214200 17287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_2dc90a5c5ed546fc91a933d1157d4271"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:08.214316 17291 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_39e762e539224330b4bfb1f52c75c017"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:08.214504 17296 master_service.cc:954] ReplaceTablet: received request to replace tablet eb95522d80454b48af6bfdd05fb684d6 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:08.214571 17288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_9b48a97fa9d7493e90bdd14e64693cdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:08.214601 17289 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_af6c4a1282d24b2283671da41b9b0400"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:08.214839 17295 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_e3c10aee5e2044a5b15b49197906acde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:08.214972 17290 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_a211b679083e4e4294bf4c97874b2d60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:08.215162 17294 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_432a26ea35484c14b07c89f682c923e3" } new_table_name: "default.Table_404d066ee1b14871b9972b685635fe46" modify_external_catalogs: true
I20251213 09:05:08.214505 17293 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58844:
name: "default.Table_82ff078f92894308a9243b01684306d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:08.216998 17961 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Refusing update from remote peer f0ef4ffe02ab44248dc97cb1c5cceac1: Log matching property violated. Preceding OpId in replica: term: 3 index: 241. Preceding OpId from leader: term: 4 index: 243. (index mismatch)
I20251213 09:05:08.217502 18142 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 242, Last known committed idx: 241, Time since last communication: 0.000s
W20251213 09:05:08.217814 17280 consensus_peers.cc:597] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 -> Peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Couldn't send request to peer 8fe04e8d31ac4cd9bca8f96335ff1982. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:08.218945 18132 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ef4ffe02ab44248dc97cb1c5cceac1. Latest consensus state: current_term: 4 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
F20251213 09:05:08.219007 17358 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 6 out of 12 received events: NotificationEvent(eventId=77, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_82ff078f92894308a9243b01684306d0, message={"server":"","servicePrincipal":"","db":"default","table":"table_82ff078f92894308a9243b01684306d0","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_82ff078f92894308a9243b01684306d0\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_82ff078f92894308a9243b01684306d0\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_82ff078f92894308a9243b01684306d0\",\"transient_lastDdlTime\":\"1765616707\",\"kudu.table_id\":\"9e2a6770e19d4fde8081928cfa9612bd\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1765616707, eventType=CREATE_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_77ba98ea391f495daa07e314094f52c2, message={"server":"","servicePrincipal":"","db":"default","table":"table_731dc67a6a2b407180abef538691c40c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_731dc67a6a2b407180abef538691c40c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_731dc67a6a2b407180abef538691c40c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_731dc67a6a2b407180abef538691c40c\",\"transient_lastDdlTime\":\"1765616703\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_77ba98ea391f495daa07e314094f52c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_77ba98ea391f495daa07e314094f52c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_77ba98ea391f495daa07e314094f52c2\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"transient_lastDdlTime\":\"1765616703\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_cfb419171a574069b4e41856a31a16f7, message={"server":"","servicePrincipal":"","db":"default","table":"table_cfb419171a574069b4e41856a31a16f7","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_cfb419171a574069b4e41856a31a16f7\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_cfb419171a574069b4e41856a31a16f7\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_cfb419171a574069b4e41856a31a16f7\",\"kudu.table_id\":\"75537d22d2274862a5106e7a3cdf7992\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_08f61de8c46c467ba64e2ccbc392e100, message={"server":"","servicePrincipal":"","db":"default","table":"table_a90e27bac3a946e5bdd85f229deeb4be","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_a90e27bac3a946e5bdd85f229deeb4be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a90e27bac3a946e5bdd85f229deeb4be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a90e27bac3a946e5bdd85f229deeb4be\",\"transient_lastDdlTime\":\"1765616701\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_08f61de8c46c467ba64e2ccbc392e100\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_08f61de8c46c467ba64e2ccbc392e100\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_08f61de8c46c467ba64e2ccbc392e100\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"transient_lastDdlTime\":\"1765616701\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive);
I20251213 09:05:08.219067 18132 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
*** Check failure stack trace: ***
I20251213 09:05:08.220504 18142 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:08.220629 18142 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:08.221477 18132 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:08.221603 18132 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:08.222326 17296 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet eb95522d80454b48af6bfdd05fb684d6
I20251213 09:05:08.222733 17296 catalog_manager.cc:6724] ReplaceTablet: tablet eb95522d80454b48af6bfdd05fb684d6 deleted and replaced by tablet 4451b0205d96405ca64a9f027749b7af
I20251213 09:05:08.222896 17296 master_service.cc:954] ReplaceTablet: received request to replace tablet 13b11eb6cf6b4560b693797ca18292e4 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:08.223115 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet eb95522d80454b48af6bfdd05fb684d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4451b0205d96405ca64a9f027749b7af) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:08.223147 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet eb95522d80454b48af6bfdd05fb684d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4451b0205d96405ca64a9f027749b7af) from {username='slave'} at 127.0.0.1:49318
@ 0x7f02d0809dcd google::LogMessage::Fail() at ??:0
I20251213 09:05:08.223469 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet eb95522d80454b48af6bfdd05fb684d6 with delete_type TABLET_DATA_DELETED (replaced by tablet 4451b0205d96405ca64a9f027749b7af) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:08.224525 18151 tablet_replica.cc:333] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:08.224720 18151 raft_consensus.cc:2243] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:08.224850 18151 raft_consensus.cc:2272] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.225359 18151 ts_tablet_manager.cc:1916] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f02d080db93 google::LogMessage::SendToLog() at ??:0
@ 0x7f02d08097cc google::LogMessage::Flush() at ??:0
I20251213 09:05:08.229934 18151 ts_tablet_manager.cc:1929] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:08.230008 18151 log.cc:1199] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/eb95522d80454b48af6bfdd05fb684d6
I20251213 09:05:08.230262 18151 ts_tablet_manager.cc:1950] T eb95522d80454b48af6bfdd05fb684d6 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:08.231016 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet eb95522d80454b48af6bfdd05fb684d6 (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]) successfully deleted
@ 0x7f02d0809a11 google::LogMessage::~LogMessage() at ??:0
I20251213 09:05:08.232553 17296 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 13b11eb6cf6b4560b693797ca18292e4
I20251213 09:05:08.232841 17296 catalog_manager.cc:6724] ReplaceTablet: tablet 13b11eb6cf6b4560b693797ca18292e4 deleted and replaced by tablet 6e0d9ba6a4d0401994b1b74449bd5cc7
I20251213 09:05:08.232975 17296 master_service.cc:954] ReplaceTablet: received request to replace tablet 7d063b797ac74e9fbefa304a854dfba3 from {username='slave'} at 127.0.0.1:58844
I20251213 09:05:08.233556 16800 tablet_service.cc:1505] Processing CreateTablet for tablet e8e967a592a442c28f19f8ab943a8528 (DEFAULT_TABLE table=default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.233824 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e967a592a442c28f19f8ab943a8528. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.235486 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet 13b11eb6cf6b4560b693797ca18292e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e0d9ba6a4d0401994b1b74449bd5cc7) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:08.235718 18150 tablet_replica.cc:333] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:08.235852 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 13b11eb6cf6b4560b693797ca18292e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e0d9ba6a4d0401994b1b74449bd5cc7) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:08.235878 18150 raft_consensus.cc:2243] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:08.235993 18150 raft_consensus.cc:2272] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.236156 16936 tablet_service.cc:1505] Processing CreateTablet for tablet e8e967a592a442c28f19f8ab943a8528 (DEFAULT_TABLE table=default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.236395 18150 ts_tablet_manager.cc:1916] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:08.236423 16936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e967a592a442c28f19f8ab943a8528. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.236712 16798 tablet_service.cc:1505] Processing CreateTablet for tablet 4451b0205d96405ca64a9f027749b7af (DEFAULT_TABLE table=default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.236967 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4451b0205d96405ca64a9f027749b7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.239329 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 4451b0205d96405ca64a9f027749b7af (DEFAULT_TABLE table=default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.239377 18156 tablet_bootstrap.cc:492] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:08.239436 18149 tablet_replica.cc:333] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:08.239564 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4451b0205d96405ca64a9f027749b7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.239881 18158 tablet_bootstrap.cc:492] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:08.240461 18156 tablet_bootstrap.cc:654] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.240947 18158 tablet_bootstrap.cc:654] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.241652 18150 ts_tablet_manager.cc:1929] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:08.241720 18150 log.cc:1199] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/eb95522d80454b48af6bfdd05fb684d6
I20251213 09:05:08.241782 17070 tablet_service.cc:1505] Processing CreateTablet for tablet 4451b0205d96405ca64a9f027749b7af (DEFAULT_TABLE table=default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.241986 18150 ts_tablet_manager.cc:1950] T eb95522d80454b48af6bfdd05fb684d6 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:08.242066 17070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4451b0205d96405ca64a9f027749b7af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.242653 18149 raft_consensus.cc:2243] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:08.243104 18149 raft_consensus.cc:2272] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.243537 18149 ts_tablet_manager.cc:1916] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:08.244791 17073 tablet_service.cc:1505] Processing CreateTablet for tablet e8e967a592a442c28f19f8ab943a8528 (DEFAULT_TABLE table=default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.245023 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8e967a592a442c28f19f8ab943a8528. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f02d597d279 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20251213 09:05:08.247277 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet 13b11eb6cf6b4560b693797ca18292e4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6e0d9ba6a4d0401994b1b74449bd5cc7) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:08.247519 18161 tablet_bootstrap.cc:492] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:08.248000 17296 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 7d063b797ac74e9fbefa304a854dfba3
I20251213 09:05:08.248358 17296 catalog_manager.cc:6724] ReplaceTablet: tablet 7d063b797ac74e9fbefa304a854dfba3 deleted and replaced by tablet e74f37bdb74e4102931e51914c24d217
I20251213 09:05:08.248605 16798 tablet_service.cc:1552] Processing DeleteTablet for tablet 7d063b797ac74e9fbefa304a854dfba3 with delete_type TABLET_DATA_DELETED (replaced by tablet e74f37bdb74e4102931e51914c24d217) from {username='slave'} at 127.0.0.1:51876
I20251213 09:05:08.248584 17296 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:58844:
table { table_name: "default.Table_6b013204511a4b49bd1c108904225841" } new_table_name: "default.Table_d364163ef2394c35b078e79e43b16a89" modify_external_catalogs: true
I20251213 09:05:08.248621 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet 7d063b797ac74e9fbefa304a854dfba3 with delete_type TABLET_DATA_DELETED (replaced by tablet e74f37bdb74e4102931e51914c24d217) from {username='slave'} at 127.0.0.1:38058
I20251213 09:05:08.248798 18161 tablet_bootstrap.cc:654] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.248922 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet 7d063b797ac74e9fbefa304a854dfba3 with delete_type TABLET_DATA_DELETED (replaced by tablet e74f37bdb74e4102931e51914c24d217) from {username='slave'} at 127.0.0.1:49318
I20251213 09:05:08.250185 18161 tablet_bootstrap.cc:492] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:08.250272 18161 ts_tablet_manager.cc:1403] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:08.250725 18161 raft_consensus.cc:359] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.250823 18161 raft_consensus.cc:385] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.250866 18161 raft_consensus.cc:740] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.251008 18161 consensus_queue.cc:260] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.251320 17073 tablet_service.cc:1505] Processing CreateTablet for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7 (DEFAULT_TABLE table=default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.251617 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.251611 16798 tablet_service.cc:1505] Processing CreateTablet for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7 (DEFAULT_TABLE table=default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.252311 16936 tablet_service.cc:1505] Processing CreateTablet for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7 (DEFAULT_TABLE table=default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.252585 16936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.251363 18161 ts_tablet_manager.cc:1434] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:08.252774 18161 tablet_bootstrap.cc:492] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:08.253820 18161 tablet_bootstrap.cc:654] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.256353 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f02d597c190 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20251213 09:05:08.251060 18149 ts_tablet_manager.cc:1929] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:08.257952 18149 log.cc:1199] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/eb95522d80454b48af6bfdd05fb684d6
I20251213 09:05:08.258301 18149 ts_tablet_manager.cc:1950] T eb95522d80454b48af6bfdd05fb684d6 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:08.258926 18150 tablet_replica.cc:333] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:08.259064 18150 raft_consensus.cc:2243] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:08.259040 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet eb95522d80454b48af6bfdd05fb684d6 (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]) successfully deleted
I20251213 09:05:08.259218 18150 raft_consensus.cc:2272] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.259426 18149 tablet_replica.cc:333] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:08.259543 18149 raft_consensus.cc:2243] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:08.259634 18150 ts_tablet_manager.cc:1916] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:08.259724 18149 raft_consensus.cc:2272] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.259949 17874 consensus_queue.cc:1048] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.259994 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet eb95522d80454b48af6bfdd05fb684d6 (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]) successfully deleted
I20251213 09:05:08.260092 16798 tablet_service.cc:1505] Processing CreateTablet for tablet e74f37bdb74e4102931e51914c24d217 (DEFAULT_TABLE table=default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.260363 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74f37bdb74e4102931e51914c24d217. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.260390 18149 ts_tablet_manager.cc:1916] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:08.261900 18150 ts_tablet_manager.cc:1929] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:08.261962 18150 log.cc:1199] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/13b11eb6cf6b4560b693797ca18292e4
I20251213 09:05:08.262291 18150 ts_tablet_manager.cc:1950] T 13b11eb6cf6b4560b693797ca18292e4 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:08.262712 18149 ts_tablet_manager.cc:1929] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:08.262773 18149 log.cc:1199] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/13b11eb6cf6b4560b693797ca18292e4
I20251213 09:05:08.262925 18150 tablet_replica.cc:333] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:08.263020 18149 ts_tablet_manager.cc:1950] T 13b11eb6cf6b4560b693797ca18292e4 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:08.263055 18150 raft_consensus.cc:2243] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:08.263201 18151 tablet_replica.cc:333] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:08.263350 18151 raft_consensus.cc:2243] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:08.263454 18150 raft_consensus.cc:2272] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.263473 18151 raft_consensus.cc:2272] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.263615 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 13b11eb6cf6b4560b693797ca18292e4 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]) successfully deleted
I20251213 09:05:08.263743 18156 tablet_bootstrap.cc:492] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:08.263813 18150 ts_tablet_manager.cc:1916] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:08.263823 18156 ts_tablet_manager.cc:1403] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20251213 09:05:08.263880 18151 ts_tablet_manager.cc:1916] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:08.264328 18156 raft_consensus.cc:359] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.264375 17073 tablet_service.cc:1505] Processing CreateTablet for tablet e74f37bdb74e4102931e51914c24d217 (DEFAULT_TABLE table=default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.264428 18156 raft_consensus.cc:385] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.264459 18156 raft_consensus.cc:740] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.264629 17073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74f37bdb74e4102931e51914c24d217. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.264585 18156 consensus_queue.cc:260] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.264894 18156 ts_tablet_manager.cc:1434] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:08.265056 18156 tablet_bootstrap.cc:492] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:08.266091 18156 tablet_bootstrap.cc:654] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.266623 16936 tablet_service.cc:1505] Processing CreateTablet for tablet e74f37bdb74e4102931e51914c24d217 (DEFAULT_TABLE table=default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:08.266877 16936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e74f37bdb74e4102931e51914c24d217. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:08.267899 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 13b11eb6cf6b4560b693797ca18292e4 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]) successfully deleted
I20251213 09:05:08.268142 18149 tablet_replica.cc:333] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:08.268319 18149 raft_consensus.cc:2243] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:08.268543 18149 raft_consensus.cc:2272] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.268920 18149 ts_tablet_manager.cc:1916] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:08.270641 18150 ts_tablet_manager.cc:1929] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:08.270653 18151 ts_tablet_manager.cc:1929] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:08.270725 18151 log.cc:1199] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/13b11eb6cf6b4560b693797ca18292e4
I20251213 09:05:08.270713 18150 log.cc:1199] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/7d063b797ac74e9fbefa304a854dfba3
I20251213 09:05:08.271000 18150 ts_tablet_manager.cc:1950] T 7d063b797ac74e9fbefa304a854dfba3 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:08.271003 18151 ts_tablet_manager.cc:1950] T 13b11eb6cf6b4560b693797ca18292e4 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
@ 0x7f02d597b8f3 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20251213 09:05:08.273157 17757 consensus_queue.cc:1048] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.273798 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 13b11eb6cf6b4560b693797ca18292e4 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]) successfully deleted
I20251213 09:05:08.274026 18151 tablet_replica.cc:333] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:08.274187 18151 raft_consensus.cc:2243] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:08.274325 18151 raft_consensus.cc:2272] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:08.275712 18149 ts_tablet_manager.cc:1929] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:08.275789 18149 log.cc:1199] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/7d063b797ac74e9fbefa304a854dfba3
I20251213 09:05:08.276082 18149 ts_tablet_manager.cc:1950] T 7d063b797ac74e9fbefa304a854dfba3 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:08.276029 17282 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:08.276466 18151 ts_tablet_manager.cc:1916] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:08.276832 17283 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:08.277401 18158 tablet_bootstrap.cc:492] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:08.277513 18158 ts_tablet_manager.cc:1403] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.038s user 0.002s sys 0.000s
@ 0x7f02d5980ffa _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20251213 09:05:08.278160 18158 raft_consensus.cc:359] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.278308 18158 raft_consensus.cc:385] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.278349 18158 raft_consensus.cc:740] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.278378 18151 ts_tablet_manager.cc:1929] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:08.278431 18151 log.cc:1199] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/7d063b797ac74e9fbefa304a854dfba3
I20251213 09:05:08.278501 18158 consensus_queue.cc:260] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
@ 0x557be653da0a std::function<>::operator()() at ??:0
I20251213 09:05:08.278654 18151 ts_tablet_manager.cc:1950] T 7d063b797ac74e9fbefa304a854dfba3 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:08.278882 18158 ts_tablet_manager.cc:1434] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:08.279080 18158 tablet_bootstrap.cc:492] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:08.279875 18156 tablet_bootstrap.cc:492] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:08.279959 18156 ts_tablet_manager.cc:1403] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251213 09:05:08.280445 18158 tablet_bootstrap.cc:654] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.280514 18156 raft_consensus.cc:359] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.280592 18156 raft_consensus.cc:385] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.280613 18156 raft_consensus.cc:740] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.280720 18156 consensus_queue.cc:260] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.281013 18156 ts_tablet_manager.cc:1434] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:08.281493 18156 tablet_bootstrap.cc:492] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
@ 0x7f02d1c637dc kudu::Thread::SuperviseThread() at ??:0
I20251213 09:05:08.282476 18161 tablet_bootstrap.cc:492] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:08.282546 18156 tablet_bootstrap.cc:654] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.282572 18161 ts_tablet_manager.cc:1403] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.002s
I20251213 09:05:08.283201 18161 raft_consensus.cc:359] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.283335 18161 raft_consensus.cc:385] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.283375 18161 raft_consensus.cc:740] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.283514 18161 consensus_queue.cc:260] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.283869 18161 ts_tablet_manager.cc:1434] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:08.284082 18161 tablet_bootstrap.cc:492] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
@ 0x7f02d24fc6db start_thread at ??:0
I20251213 09:05:08.284162 18156 tablet_bootstrap.cc:492] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:08.284245 18156 ts_tablet_manager.cc:1403] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:08.284662 18156 raft_consensus.cc:359] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.284775 18156 raft_consensus.cc:385] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.284809 18156 raft_consensus.cc:740] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.284806 17280 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 7d063b797ac74e9fbefa304a854dfba3 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]) successfully deleted
I20251213 09:05:08.284920 18156 consensus_queue.cc:260] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.285198 18156 ts_tablet_manager.cc:1434] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:08.285385 18156 tablet_bootstrap.cc:492] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:08.285521 18161 tablet_bootstrap.cc:654] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
@ 0x7f02cf9c071f clone at ??:0
I20251213 09:05:08.286410 18156 tablet_bootstrap.cc:654] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.287789 18158 tablet_bootstrap.cc:492] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:08.287874 18158 ts_tablet_manager.cc:1403] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:08.288374 18158 raft_consensus.cc:359] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.288475 18158 raft_consensus.cc:385] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.288508 18158 raft_consensus.cc:740] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.288708 18158 consensus_queue.cc:260] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.289682 18158 ts_tablet_manager.cc:1434] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:08.289844 18158 tablet_bootstrap.cc:492] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:08.290772 18158 tablet_bootstrap.cc:654] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.291857 18156 tablet_bootstrap.cc:492] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:08.291939 18156 ts_tablet_manager.cc:1403] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:08.291960 18158 tablet_bootstrap.cc:492] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:08.292023 18158 ts_tablet_manager.cc:1403] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:08.292424 18158 raft_consensus.cc:359] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.292508 18158 raft_consensus.cc:385] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.292549 18158 raft_consensus.cc:740] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.292469 18156 raft_consensus.cc:359] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.292593 18156 raft_consensus.cc:385] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.292655 18158 consensus_queue.cc:260] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.292682 18156 raft_consensus.cc:740] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.292876 18158 ts_tablet_manager.cc:1434] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:08.293012 18158 tablet_bootstrap.cc:492] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:08.293912 18158 tablet_bootstrap.cc:654] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.294199 18156 consensus_queue.cc:260] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.294541 18156 ts_tablet_manager.cc:1434] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:08.295550 18158 tablet_bootstrap.cc:492] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:08.295617 18158 ts_tablet_manager.cc:1403] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:08.296017 18158 raft_consensus.cc:359] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.296110 18158 raft_consensus.cc:385] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.296140 18158 raft_consensus.cc:740] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.296249 18158 consensus_queue.cc:260] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.296468 18158 ts_tablet_manager.cc:1434] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:08.298394 18136 consensus_queue.cc:1048] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.301077 18161 tablet_bootstrap.cc:492] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:08.301177 18161 ts_tablet_manager.cc:1403] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.001s
I20251213 09:05:08.301668 18161 raft_consensus.cc:359] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.301770 18161 raft_consensus.cc:385] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.301802 18161 raft_consensus.cc:740] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.301916 18161 consensus_queue.cc:260] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.302213 18161 ts_tablet_manager.cc:1434] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251213 09:05:08.303962 18031 consensus_queue.cc:1048] T d49fcf75fc57485fa8ab3ee432aa3772 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.305059 18161 tablet_bootstrap.cc:492] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:08.306082 18161 tablet_bootstrap.cc:654] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:08.307399 18161 tablet_bootstrap.cc:492] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:08.307471 18161 ts_tablet_manager.cc:1403] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251213 09:05:08.307893 18161 raft_consensus.cc:359] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.307991 18161 raft_consensus.cc:385] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:08.308020 18161 raft_consensus.cc:740] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:08.308130 18161 consensus_queue.cc:260] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.308398 18161 ts_tablet_manager.cc:1434] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:08.310943 17911 raft_consensus.cc:493] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:08.311012 17911 raft_consensus.cc:515] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.311337 17911 leader_election.cc:290] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:08.311748 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4451b0205d96405ca64a9f027749b7af" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:08.311864 16957 raft_consensus.cc:2468] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:08.312197 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4451b0205d96405ca64a9f027749b7af" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:08.312310 16820 raft_consensus.cc:2468] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:08.312629 17028 leader_election.cc:304] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:08.312765 17911 raft_consensus.cc:2804] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:08.312803 17911 raft_consensus.cc:493] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:08.312835 17911 raft_consensus.cc:3060] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.313825 17911 raft_consensus.cc:515] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.314107 17911 leader_election.cc:290] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:08.314440 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4451b0205d96405ca64a9f027749b7af" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:08.314548 16957 raft_consensus.cc:3060] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.314791 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4451b0205d96405ca64a9f027749b7af" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:08.314904 16820 raft_consensus.cc:3060] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.315569 16957 raft_consensus.cc:2468] T 4451b0205d96405ca64a9f027749b7af P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:08.315910 16820 raft_consensus.cc:2468] T 4451b0205d96405ca64a9f027749b7af P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:08.319717 17028 leader_election.cc:304] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:08.321341 17911 raft_consensus.cc:2804] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:08.321415 17911 raft_consensus.cc:697] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:08.321537 17911 consensus_queue.cc:237] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.357643 17484 raft_consensus.cc:493] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:08.357784 17484 raft_consensus.cc:515] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.358179 17484 leader_election.cc:290] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:08.358525 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8e967a592a442c28f19f8ab943a8528" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:08.358533 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8e967a592a442c28f19f8ab943a8528" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:08.358652 16957 raft_consensus.cc:2468] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:08.358650 17092 raft_consensus.cc:2468] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:08.358948 16757 leader_election.cc:304] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:08.359167 17484 raft_consensus.cc:2804] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:08.359226 17484 raft_consensus.cc:493] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:08.359283 17484 raft_consensus.cc:3060] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.360212 17484 raft_consensus.cc:515] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.360507 17484 leader_election.cc:290] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:08.360808 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8e967a592a442c28f19f8ab943a8528" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:08.360919 16957 raft_consensus.cc:3060] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.361711 17757 raft_consensus.cc:493] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:08.361794 17757 raft_consensus.cc:515] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.361950 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e8e967a592a442c28f19f8ab943a8528" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:08.362061 17092 raft_consensus.cc:3060] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.362105 17757 leader_election.cc:290] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:08.361817 16957 raft_consensus.cc:2468] T e8e967a592a442c28f19f8ab943a8528 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:08.362530 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e74f37bdb74e4102931e51914c24d217" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:08.362537 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e74f37bdb74e4102931e51914c24d217" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:08.362628 16820 raft_consensus.cc:2468] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:08.362628 17093 raft_consensus.cc:2468] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:08.362802 16756 leader_election.cc:304] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:08.362941 17484 raft_consensus.cc:2804] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:08.362972 16891 leader_election.cc:304] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:08.362972 17092 raft_consensus.cc:2468] T e8e967a592a442c28f19f8ab943a8528 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:08.363016 17484 raft_consensus.cc:697] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:08.363101 17757 raft_consensus.cc:2804] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:08.363162 17757 raft_consensus.cc:493] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:08.363197 17757 raft_consensus.cc:3060] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.363159 17484 consensus_queue.cc:237] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.364095 17757 raft_consensus.cc:515] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.364403 17757 leader_election.cc:290] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:08.365329 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e74f37bdb74e4102931e51914c24d217" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:08.365428 16820 raft_consensus.cc:3060] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.366240 16820 raft_consensus.cc:2468] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:08.366549 16891 leader_election.cc:304] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:08.366726 17757 raft_consensus.cc:2804] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:08.366701 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e74f37bdb74e4102931e51914c24d217" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:08.366796 17092 raft_consensus.cc:3060] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.366803 17757 raft_consensus.cc:697] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:08.366921 17757 consensus_queue.cc:237] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.367676 17092 raft_consensus.cc:2468] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
W20251213 09:05:08.470810 17148 connection.cc:537] client connection to 127.15.213.61:38171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:08.471720 17148 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.61:38171)
W20251213 09:05:08.471995 17148 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.15.213.61:38171)
W20251213 09:05:08.472169 17148 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.15.213.61:38171)
W20251213 09:05:08.472344 17148 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.213.61:38171)
W20251213 09:05:08.472589 18122 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:08.472202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.61:38171 (local address 127.15.213.1:51291)
1213 09:05:08.472429 (+ 227us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:08.472495 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":130}
I20251213 09:05:08.500317 17757 raft_consensus.cc:493] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:08.500506 17757 raft_consensus.cc:515] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.500995 17757 leader_election.cc:290] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:08.501405 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e0d9ba6a4d0401994b1b74449bd5cc7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:08.501471 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e0d9ba6a4d0401994b1b74449bd5cc7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:08.501544 16820 raft_consensus.cc:2468] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:08.501607 17092 raft_consensus.cc:2468] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:08.501837 16891 leader_election.cc:304] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:08.502012 17757 raft_consensus.cc:2804] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:08.502074 17757 raft_consensus.cc:493] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:08.502115 17757 raft_consensus.cc:3060] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.503234 17757 raft_consensus.cc:515] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.503638 17757 leader_election.cc:290] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:08.503958 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e0d9ba6a4d0401994b1b74449bd5cc7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:08.504029 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e0d9ba6a4d0401994b1b74449bd5cc7" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:08.504066 16820 raft_consensus.cc:3060] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.504139 17092 raft_consensus.cc:3060] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:08.505029 16820 raft_consensus.cc:2468] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:08.505079 17092 raft_consensus.cc:2468] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:08.505575 16894 leader_election.cc:304] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:08.505815 17757 raft_consensus.cc:2804] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:08.505908 17757 raft_consensus.cc:697] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:08.506353 17757 consensus_queue.cc:237] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:08.747380 17911 consensus_queue.cc:1048] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.751004 18177 consensus_queue.cc:1048] T 4451b0205d96405ca64a9f027749b7af P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.761705 17850 consensus_queue.cc:1048] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.765763 17850 consensus_queue.cc:1048] T e8e967a592a442c28f19f8ab943a8528 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.765820 18200 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:08.765910 18200 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:08.767937 18200 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:08.768507 17937 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:08.769503 17939 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:05:08.769574 17939 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:08.769754 18200 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20251213 09:05:08.816785 17757 consensus_queue.cc:1048] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:08.821100 17875 consensus_queue.cc:1048] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:09.058954 17875 consensus_queue.cc:1048] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:09.062886 17874 consensus_queue.cc:1048] T 6e0d9ba6a4d0401994b1b74449bd5cc7 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:09.267210 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.62:42117
--webserver_interface=127.15.213.62
--webserver_port=43541
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251213 09:05:09.350447 18212 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:09.350558 18212 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:09.350953 18212 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:09.352065 17937 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:09.352241 17939 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:05:09.352339 17939 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:09.352499 18212 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20251213 09:05:09.383781 18209 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:05:09.384013 18209 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:05:09.384065 18209 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:05:09.387424 18209 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:05:09.387491 18209 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:05:09.387513 18209 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:05:09.387532 18209 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:05:09.391819 18209 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.62:42117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.213.62
--webserver_port=43541
--never_fsync=true
--heap_profile_path=/tmp/kudu.18209
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:05:09.392988 18209 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:05:09.394147 18209 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:05:09.400019 18223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:09.400012 18220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:09.400012 18221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:09.400630 18209 server_base.cc:1047] running on GCE node
I20251213 09:05:09.401120 18209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:05:09.402086 18209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:05:09.403188 18209 hybrid_clock.cc:648] HybridClock initialized: now 1765616709403175 us; error 27 us; skew 500 ppm
I20251213 09:05:09.404968 18209 webserver.cc:492] Webserver started at http://127.15.213.62:43541/ using document root <none> and password file <none>
I20251213 09:05:09.405537 18209 fs_manager.cc:362] Metadata directory not provided
I20251213 09:05:09.405592 18209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:05:09.409034 18209 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20251213 09:05:09.410959 18229 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:05:09.411948 18209 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:09.412065 18209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
uuid: "8fe04e8d31ac4cd9bca8f96335ff1982"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:05:09.412443 18209 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:05:09.449681 18209 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:05:09.450404 18209 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:05:09.450578 18209 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:05:09.458668 18282 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.62:42117 every 8 connection(s)
I20251213 09:05:09.458675 18209 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.62:42117
I20251213 09:05:09.460016 18209 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
I20251213 09:05:09.464285 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 18209
I20251213 09:05:09.464598 18283 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:05:09.467025 18283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap starting.
I20251213 09:05:09.489624 18283 log.cc:826] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Log is configured to *not* fsync() on all Append() calls
I20251213 09:05:09.604627 18283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap replayed 1/1 log segments. Stats: ops{read=241 overwritten=0 applied=241 ignored=0} inserts{seen=155 ignored=0} mutations{seen=216 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251213 09:05:09.605034 18283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap complete.
I20251213 09:05:09.607805 18283 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:09.608127 18283 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe04e8d31ac4cd9bca8f96335ff1982, State: Initialized, Role: FOLLOWER
I20251213 09:05:09.608515 18283 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 241, Last appended: 3.241, Last appended by leader: 241, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:09.609251 18288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:09.609377 18288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:09.609683 18283 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:05:09.620880 18209 master_runner.cc:186] Error getting master registration for 127.15.213.61:38171: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111),
I20251213 09:05:09.622859 18209 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:09.626246 18302 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:09.626334 18302 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: loading cluster ID for follower catalog manager: success
I20251213 09:05:09.630586 18302 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: acquiring CA information for follower catalog manager: success
I20251213 09:05:09.633810 18302 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:05:09.821038 16869 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:09.823755 18247 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:37007; Asking this server to re-register.
I20251213 09:05:09.824402 16869 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:09.826305 18247 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:09.830127 17140 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:09.832042 18247 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:52113; Asking this server to re-register.
I20251213 09:05:09.832671 17140 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:09.833779 18247 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:09.961838 17005 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:09.963512 18247 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:52361; Asking this server to re-register.
I20251213 09:05:09.964021 17005 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:09.965103 18247 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:10.004041 18288 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:10.004213 18288 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:10.005388 18288 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:10.005859 18232 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
W20251213 09:05:10.006599 18232 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:05:10.008879 17961 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 4 candidate_status { last_received { term: 3 index: 241 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87" is_pre_election: true
I20251213 09:05:10.009044 17961 raft_consensus.cc:2393] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in current term 4: Already voted for candidate f0ef4ffe02ab44248dc97cb1c5cceac1 in this term.
I20251213 09:05:10.009457 18234 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982; no voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:10.009688 18288 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 3 FOLLOWER]: Advancing to term 4
I20251213 09:05:10.011620 18288 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251213 09:05:10.111522 18314 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:10.111647 18314 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:10.112097 18314 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:10.114023 17939 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:05:10.115739 18257 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7f61ccb4ffd4066babfa94938e28b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 248 } } ignore_live_leader: false dest_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" is_pre_election: true
I20251213 09:05:10.116004 18257 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7f61ccb4ffd4066babfa94938e28b87 in term 4.
I20251213 09:05:10.116288 17937 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87; no voters: f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:10.116452 18314 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20251213 09:05:10.116518 18314 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:10.116559 18314 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 4 FOLLOWER]: Advancing to term 5
I20251213 09:05:10.117430 18314 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:10.117792 18314 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 election: Requested vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
I20251213 09:05:10.118252 18257 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7f61ccb4ffd4066babfa94938e28b87" candidate_term: 5 candidate_status { last_received { term: 4 index: 248 } } ignore_live_leader: false dest_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982"
I20251213 09:05:10.118376 18257 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 4 FOLLOWER]: Advancing to term 5
W20251213 09:05:10.118644 17939 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:05:10.119326 18257 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7f61ccb4ffd4066babfa94938e28b87 in term 5.
I20251213 09:05:10.119573 17937 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87; no voters: f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:10.119716 18314 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 5 FOLLOWER]: Leader election won for term 5
I20251213 09:05:10.119902 18314 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 5 LEADER]: Becoming Leader. State: Replica: d7f61ccb4ffd4066babfa94938e28b87, State: Running, Role: LEADER
I20251213 09:05:10.120157 18314 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 248, Committed index: 248, Last appended: 4.248, Last appended by leader: 248, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:10.121120 18318 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7f61ccb4ffd4066babfa94938e28b87. Latest consensus state: current_term: 5 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:10.121307 18318 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:10.121618 18320 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:05:10.123808 18320 catalog_manager.cc:679] Loaded metadata for table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:10.124238 18320 catalog_manager.cc:679] Loaded metadata for table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]
I20251213 09:05:10.124444 18320 catalog_manager.cc:679] Loaded metadata for table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]
I20251213 09:05:10.124648 18320 catalog_manager.cc:679] Loaded metadata for table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]
I20251213 09:05:10.124842 18320 catalog_manager.cc:679] Loaded metadata for table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]
I20251213 09:05:10.125039 18320 catalog_manager.cc:679] Loaded metadata for table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]
I20251213 09:05:10.125309 18320 catalog_manager.cc:679] Loaded metadata for table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:10.125725 18320 catalog_manager.cc:679] Loaded metadata for table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]
I20251213 09:05:10.126063 18320 catalog_manager.cc:679] Loaded metadata for table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:10.126302 18320 catalog_manager.cc:679] Loaded metadata for table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]
I20251213 09:05:10.126521 18320 catalog_manager.cc:679] Loaded metadata for table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]
I20251213 09:05:10.126742 18320 catalog_manager.cc:679] Loaded metadata for table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:05:10.126981 18320 catalog_manager.cc:679] Loaded metadata for table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]
I20251213 09:05:10.127214 18320 catalog_manager.cc:679] Loaded metadata for table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:05:10.127595 18320 catalog_manager.cc:679] Loaded metadata for table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]
I20251213 09:05:10.127874 18320 catalog_manager.cc:679] Loaded metadata for table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:10.128070 18320 catalog_manager.cc:679] Loaded metadata for table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]
I20251213 09:05:10.128269 18320 catalog_manager.cc:679] Loaded metadata for table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]
I20251213 09:05:10.128621 18320 catalog_manager.cc:679] Loaded metadata for table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]
I20251213 09:05:10.128870 18320 catalog_manager.cc:679] Loaded metadata for table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]
I20251213 09:05:10.129042 18320 catalog_manager.cc:679] Loaded metadata for table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:10.129241 18320 catalog_manager.cc:679] Loaded metadata for table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]
I20251213 09:05:10.129426 18320 catalog_manager.cc:679] Loaded metadata for table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:10.129626 18320 catalog_manager.cc:679] Loaded metadata for table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:10.129832 18320 catalog_manager.cc:679] Loaded metadata for table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:10.130132 18320 catalog_manager.cc:679] Loaded metadata for table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]
I20251213 09:05:10.130319 18320 catalog_manager.cc:679] Loaded metadata for table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]
I20251213 09:05:10.130502 18320 catalog_manager.cc:679] Loaded metadata for table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]
I20251213 09:05:10.132539 18320 tablet_loader.cc:96] loaded metadata for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d])
I20251213 09:05:10.133219 18320 tablet_loader.cc:96] loaded metadata for tablet 12254c0d95144f8e8d958647924a5ee2 (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f])
I20251213 09:05:10.133373 18320 tablet_loader.cc:96] loaded metadata for tablet 1391d28e1e4046b4af9f0b06ae539c0d (table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d])
I20251213 09:05:10.133900 18320 tablet_loader.cc:96] loaded metadata for tablet 33c857d1903b479bb62d8173a4e6f22e (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e])
I20251213 09:05:10.134109 18320 tablet_loader.cc:96] loaded metadata for tablet 33e5ff40d6b24f51956d050c23d41eb7 (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454])
I20251213 09:05:10.134435 18320 tablet_loader.cc:96] loaded metadata for tablet 3afb8349ced4486d8a283966ac647965 (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8])
I20251213 09:05:10.134810 18320 tablet_loader.cc:96] loaded metadata for tablet 4451b0205d96405ca64a9f027749b7af (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46])
I20251213 09:05:10.135025 18320 tablet_loader.cc:96] loaded metadata for tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb])
I20251213 09:05:10.135201 18320 tablet_loader.cc:96] loaded metadata for tablet 4a86f3d6176a4a4681c0fb31649e0eab (table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907])
I20251213 09:05:10.135537 18320 tablet_loader.cc:96] loaded metadata for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a])
I20251213 09:05:10.135903 18320 tablet_loader.cc:96] loaded metadata for tablet 604c2f416148499ab5651c43cd1491a1 (table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d])
I20251213 09:05:10.136262 18320 tablet_loader.cc:96] loaded metadata for tablet 62236955121e49ec800c5e37a40c5b19 (table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644])
I20251213 09:05:10.136399 18320 tablet_loader.cc:96] loaded metadata for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253])
I20251213 09:05:10.136758 18320 tablet_loader.cc:96] loaded metadata for tablet 79d28675183f4fb1ad9a573cab3bba32 (table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a])
I20251213 09:05:10.137348 18320 tablet_loader.cc:96] loaded metadata for tablet 9d0400b5bf3946de8ab82596a94b99ae (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5])
I20251213 09:05:10.137809 18320 tablet_loader.cc:96] loaded metadata for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893])
I20251213 09:05:10.138055 18320 tablet_loader.cc:96] loaded metadata for tablet b3c914dd363847b2a5730feb0c3e9c11 (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d])
I20251213 09:05:10.138433 18320 tablet_loader.cc:96] loaded metadata for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07])
I20251213 09:05:10.138592 18320 tablet_loader.cc:96] loaded metadata for tablet c5adcb68c5b9438da10370479acbed52 (table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba])
I20251213 09:05:10.138875 18320 tablet_loader.cc:96] loaded metadata for tablet c75672e770be41aeb9fe180521d3f7af (table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad])
I20251213 09:05:10.139035 18320 tablet_loader.cc:96] loaded metadata for tablet c8276392af2740258e804f72f7529d16 (table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd])
I20251213 09:05:10.139217 18320 tablet_loader.cc:96] loaded metadata for tablet d49fcf75fc57485fa8ab3ee432aa3772 (table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa])
I20251213 09:05:10.139650 18320 tablet_loader.cc:96] loaded metadata for tablet e74f37bdb74e4102931e51914c24d217 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c])
I20251213 09:05:10.139885 18320 tablet_loader.cc:96] loaded metadata for tablet e8b33140a56b49cf9068eb6b09613998 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd])
I20251213 09:05:10.140034 18320 tablet_loader.cc:96] loaded metadata for tablet e8e967a592a442c28f19f8ab943a8528 (table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce])
I20251213 09:05:10.140466 18320 tablet_loader.cc:96] loaded metadata for tablet f394b4d388cd43a49ae4c3db293a893c (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1])
I20251213 09:05:10.140651 18320 tablet_loader.cc:96] loaded metadata for tablet f3b4a3ff63414a5da3faa9023644c677 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f])
I20251213 09:05:10.140893 18320 tablet_loader.cc:96] loaded metadata for tablet fb68b603c201419491b09993080789b5 (table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee])
I20251213 09:05:10.141034 18320 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:05:10.142189 18320 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:10.142236 18320 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:05:10.143584 18320 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:05:10.144647 18320 catalog_manager.cc:6038] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Loaded TSK: 0
I20251213 09:05:10.145370 18320 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:05:10.146421 18320 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:05:10.147504 18320 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 76
I20251213 09:05:10.154210 17951 master_service.cc:954] ReplaceTablet: received request to replace tablet f3b4a3ff63414a5da3faa9023644c677 from {username='slave'} at 127.0.0.1:42278
I20251213 09:05:10.154338 17953 master_service.cc:954] ReplaceTablet: received request to replace tablet 33c857d1903b479bb62d8173a4e6f22e from {username='slave'} at 127.0.0.1:42278
I20251213 09:05:10.154536 17952 master_service.cc:954] ReplaceTablet: received request to replace tablet b3c914dd363847b2a5730feb0c3e9c11 from {username='slave'} at 127.0.0.1:42278
I20251213 09:05:10.155539 17949 master_service.cc:954] ReplaceTablet: received request to replace tablet f3b4a3ff63414a5da3faa9023644c677 from {username='slave'} at 127.0.0.1:42278
I20251213 09:05:10.154872 17946 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" } modify_external_catalogs: true
I20251213 09:05:10.154919 17945 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42278:
name: "default.Table_a19aae3ffc1441ad9d2a8082df491a94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:10.155026 17944 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42278:
name: "default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:10.156797 17946 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" } modify_external_catalogs: true
I20251213 09:05:10.155737 17948 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_a90e27bac3a946e5bdd85f229deeb4be" } new_table_name: "default.Table_08f61de8c46c467ba64e2ccbc392e100" modify_external_catalogs: true
I20251213 09:05:10.155647 17947 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_20afd9b96f7e403d9c185f93b6567f19" } modify_external_catalogs: true
I20251213 09:05:10.157102 17947 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_20afd9b96f7e403d9c185f93b6567f19" } modify_external_catalogs: true
I20251213 09:05:10.155426 17950 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_7bb124a916904ca5b08081aae9ac54a0" } new_table_name: "default.Table_8ad4a38d0dcc447fb137dd4e3701421e" modify_external_catalogs: true
I20251213 09:05:10.159673 18257 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Refusing update from remote peer d7f61ccb4ffd4066babfa94938e28b87: Log matching property violated. Preceding OpId in replica: term: 3 index: 241. Preceding OpId from leader: term: 5 index: 250. (index mismatch)
W20251213 09:05:10.160626 17939 consensus_peers.cc:597] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 -> Peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Couldn't send request to peer f0ef4ffe02ab44248dc97cb1c5cceac1. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:10.160876 18318 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 249, Last known committed idx: 241, Time since last communication: 0.000s
F20251213 09:05:10.161433 18015 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 6 out of 12 received events: NotificationEvent(eventId=77, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_82ff078f92894308a9243b01684306d0, message={"server":"","servicePrincipal":"","db":"default","table":"table_82ff078f92894308a9243b01684306d0","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_82ff078f92894308a9243b01684306d0\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_82ff078f92894308a9243b01684306d0\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_82ff078f92894308a9243b01684306d0\",\"transient_lastDdlTime\":\"1765616707\",\"kudu.table_id\":\"9e2a6770e19d4fde8081928cfa9612bd\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1765616707, eventType=CREATE_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_77ba98ea391f495daa07e314094f52c2, message={"server":"","servicePrincipal":"","db":"default","table":"table_731dc67a6a2b407180abef538691c40c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_731dc67a6a2b407180abef538691c40c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_731dc67a6a2b407180abef538691c40c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_731dc67a6a2b407180abef538691c40c\",\"transient_lastDdlTime\":\"1765616703\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_77ba98ea391f495daa07e314094f52c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_77ba98ea391f495daa07e314094f52c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_77ba98ea391f495daa07e314094f52c2\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"transient_lastDdlTime\":\"1765616703\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_cfb419171a574069b4e41856a31a16f7, message={"server":"","servicePrincipal":"","db":"default","table":"table_cfb419171a574069b4e41856a31a16f7","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_cfb419171a574069b4e41856a31a16f7\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_cfb419171a574069b4e41856a31a16f7\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_cfb419171a574069b4e41856a31a16f7\",\"kudu.table_id\":\"75537d22d2274862a5106e7a3cdf7992\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_08f61de8c46c467ba64e2ccbc392e100, message={"server":"","servicePrincipal":"","db":"default","table":"table_a90e27bac3a946e5bdd85f229deeb4be","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_a90e27bac3a946e5bdd85f229deeb4be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a90e27bac3a946e5bdd85f229deeb4be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a90e27bac3a946e5bdd85f229deeb4be\",\"transient_lastDdlTime\":\"1765616701\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_08f61de8c46c467ba64e2ccbc392e100\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_08f61de8c46c467ba64e2ccbc392e100\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_08f61de8c46c467ba64e2ccbc392e100\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"transient_lastDdlTime\":\"1765616701\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f341f821dcd google::LogMessage::Fail() at ??:0
I20251213 09:05:10.165910 18288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7f61ccb4ffd4066babfa94938e28b87. Latest consensus state: current_term: 5 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:10.166033 18288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:10.166136 18288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:10.166198 18288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f341f825b93 google::LogMessage::SendToLog() at ??:0
I20251213 09:05:10.168764 18318 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:10.168879 18318 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: LEADER
@ 0x7f341f8217cc google::LogMessage::Flush() at ??:0
I20251213 09:05:10.169915 18325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:10.170032 18325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:10.170313 17952 catalog_manager.cc:5941] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Sending DeleteTablet for 3 replicas of tablet b3c914dd363847b2a5730feb0c3e9c11
@ 0x7f341f821a11 google::LogMessage::~LogMessage() at ??:0
I20251213 09:05:10.171725 17952 catalog_manager.cc:6724] ReplaceTablet: tablet b3c914dd363847b2a5730feb0c3e9c11 deleted and replaced by tablet 362edc0369024cc6b1c4acce115c4f1f
I20251213 09:05:10.171834 18322 mvcc.cc:204] Tried to move back new op lower bound from 7231966044811792384 to 7231966036656431104. Current Snapshot: MvccSnapshot[applied={T|T < 7231966037013753856}]
I20251213 09:05:10.172071 17952 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_430d04b174a84f139dae2021743273d2" } modify_external_catalogs: true
I20251213 09:05:10.172235 17952 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_430d04b174a84f139dae2021743273d2" } modify_external_catalogs: true
I20251213 09:05:10.173985 17951 catalog_manager.cc:5941] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Sending DeleteTablet for 3 replicas of tablet f3b4a3ff63414a5da3faa9023644c677
I20251213 09:05:10.174494 17953 catalog_manager.cc:5941] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Sending DeleteTablet for 3 replicas of tablet 33c857d1903b479bb62d8173a4e6f22e
I20251213 09:05:10.174649 17949 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_fd1d1908e83b4925a03e655168a92b9e" } modify_external_catalogs: true
I20251213 09:05:10.174739 17953 catalog_manager.cc:6724] ReplaceTablet: tablet 33c857d1903b479bb62d8173a4e6f22e deleted and replaced by tablet 5e23c178da6f47c487ed085718b83ce6
I20251213 09:05:10.174773 17949 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_fd1d1908e83b4925a03e655168a92b9e" } modify_external_catalogs: true
I20251213 09:05:10.174916 17953 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_731dc67a6a2b407180abef538691c40c" } new_table_name: "default.Table_77ba98ea391f495daa07e314094f52c2" modify_external_catalogs: true
I20251213 09:05:10.175076 17951 catalog_manager.cc:6724] ReplaceTablet: tablet f3b4a3ff63414a5da3faa9023644c677 deleted and replaced by tablet 639c8c290eb6413e9b343b8c132d8152
I20251213 09:05:10.175277 17951 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_9dc2b6abe24f4a86ade24c79c38fa2e3" } modify_external_catalogs: true
I20251213 09:05:10.175390 17951 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42278:
table { table_name: "default.Table_9dc2b6abe24f4a86ade24c79c38fa2e3" } modify_external_catalogs: true
@ 0x7f3424995279 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20251213 09:05:10.182126 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet b3c914dd363847b2a5730feb0c3e9c11 with delete_type TABLET_DATA_DELETED (replaced by tablet 362edc0369024cc6b1c4acce115c4f1f) from {username='slave'} at 127.0.0.1:57788
I20251213 09:05:10.182255 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 33c857d1903b479bb62d8173a4e6f22e with delete_type TABLET_DATA_DELETED (replaced by tablet 5e23c178da6f47c487ed085718b83ce6) from {username='slave'} at 127.0.0.1:57788
I20251213 09:05:10.182351 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet f3b4a3ff63414a5da3faa9023644c677 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c8c290eb6413e9b343b8c132d8152) from {username='slave'} at 127.0.0.1:57788
I20251213 09:05:10.183800 16798 tablet_service.cc:1552] Processing DeleteTablet for tablet b3c914dd363847b2a5730feb0c3e9c11 with delete_type TABLET_DATA_DELETED (replaced by tablet 362edc0369024cc6b1c4acce115c4f1f) from {username='slave'} at 127.0.0.1:34202
I20251213 09:05:10.183923 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet 33c857d1903b479bb62d8173a4e6f22e with delete_type TABLET_DATA_DELETED (replaced by tablet 5e23c178da6f47c487ed085718b83ce6) from {username='slave'} at 127.0.0.1:34202
I20251213 09:05:10.183964 18338 tablet_replica.cc:333] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:10.184121 18338 raft_consensus.cc:2243] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:10.184237 18338 raft_consensus.cc:2272] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.184826 18338 ts_tablet_manager.cc:1916] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.184826 16798 tablet_service.cc:1505] Processing CreateTablet for tablet 362edc0369024cc6b1c4acce115c4f1f (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.185072 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet b3c914dd363847b2a5730feb0c3e9c11 with delete_type TABLET_DATA_DELETED (replaced by tablet 362edc0369024cc6b1c4acce115c4f1f) from {username='slave'} at 127.0.0.1:53846
I20251213 09:05:10.185134 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362edc0369024cc6b1c4acce115c4f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.185249 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet f3b4a3ff63414a5da3faa9023644c677 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c8c290eb6413e9b343b8c132d8152) from {username='slave'} at 127.0.0.1:53846
I20251213 09:05:10.185355 17070 tablet_service.cc:1552] Processing DeleteTablet for tablet 33c857d1903b479bb62d8173a4e6f22e with delete_type TABLET_DATA_DELETED (replaced by tablet 5e23c178da6f47c487ed085718b83ce6) from {username='slave'} at 127.0.0.1:53846
I20251213 09:05:10.185575 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 362edc0369024cc6b1c4acce115c4f1f (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.185823 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362edc0369024cc6b1c4acce115c4f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.186571 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet f3b4a3ff63414a5da3faa9023644c677 with delete_type TABLET_DATA_DELETED (replaced by tablet 639c8c290eb6413e9b343b8c132d8152) from {username='slave'} at 127.0.0.1:34202
I20251213 09:05:10.187682 18343 tablet_bootstrap.cc:492] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:10.188481 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 362edc0369024cc6b1c4acce115c4f1f (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.188741 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 362edc0369024cc6b1c4acce115c4f1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.188767 18343 tablet_bootstrap.cc:654] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
@ 0x7f3424994190 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20251213 09:05:10.191759 16937 tablet_service.cc:1505] Processing CreateTablet for tablet 5e23c178da6f47c487ed085718b83ce6 (DEFAULT_TABLE table=default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.192023 16937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e23c178da6f47c487ed085718b83ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.192530 16936 tablet_service.cc:1505] Processing CreateTablet for tablet 639c8c290eb6413e9b343b8c132d8152 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.192651 17070 tablet_service.cc:1505] Processing CreateTablet for tablet 639c8c290eb6413e9b343b8c132d8152 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.192756 16936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639c8c290eb6413e9b343b8c132d8152. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.192651 17072 tablet_service.cc:1505] Processing CreateTablet for tablet 5e23c178da6f47c487ed085718b83ce6 (DEFAULT_TABLE table=default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.192924 17070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639c8c290eb6413e9b343b8c132d8152. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.193044 17072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e23c178da6f47c487ed085718b83ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.193199 16798 tablet_service.cc:1505] Processing CreateTablet for tablet 5e23c178da6f47c487ed085718b83ce6 (DEFAULT_TABLE table=default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.193441 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e23c178da6f47c487ed085718b83ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.194981 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 639c8c290eb6413e9b343b8c132d8152 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:10.195226 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 639c8c290eb6413e9b343b8c132d8152. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:10.195989 18344 tablet_bootstrap.cc:492] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:10.196790 18338 ts_tablet_manager.cc:1929] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.196861 18338 log.cc:1199] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/b3c914dd363847b2a5730feb0c3e9c11
I20251213 09:05:10.197543 18342 tablet_replica.cc:333] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:10.197691 18338 ts_tablet_manager.cc:1950] T b3c914dd363847b2a5730feb0c3e9c11 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:10.198040 18342 raft_consensus.cc:2243] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:10.198300 18342 raft_consensus.cc:2272] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.198643 18338 tablet_replica.cc:333] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:10.198758 18342 ts_tablet_manager.cc:1916] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.198776 18338 raft_consensus.cc:2243] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:10.198750 17939 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet b3c914dd363847b2a5730feb0c3e9c11 (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]) successfully deleted
@ 0x7f34249938f3 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20251213 09:05:10.198951 18338 raft_consensus.cc:2272] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.199319 18338 ts_tablet_manager.cc:1916] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.199364 18346 tablet_bootstrap.cc:492] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:10.200505 18346 tablet_bootstrap.cc:654] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:10.201031 18344 tablet_bootstrap.cc:654] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:10.201154 18338 ts_tablet_manager.cc:1929] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.201205 18338 log.cc:1199] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/33c857d1903b479bb62d8173a4e6f22e
I20251213 09:05:10.201443 18338 ts_tablet_manager.cc:1950] T 33c857d1903b479bb62d8173a4e6f22e P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:10.201756 18341 tablet_replica.cc:333] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:10.201930 18341 raft_consensus.cc:2243] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:10.202025 18342 ts_tablet_manager.cc:1929] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.202076 18342 log.cc:1199] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/b3c914dd363847b2a5730feb0c3e9c11
I20251213 09:05:10.202064 18341 raft_consensus.cc:2272] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.202529 18341 ts_tablet_manager.cc:1916] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.202558 18342 ts_tablet_manager.cc:1950] T b3c914dd363847b2a5730feb0c3e9c11 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:10.203083 18342 tablet_replica.cc:333] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:10.203277 18342 raft_consensus.cc:2243] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:10.203254 17940 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet b3c914dd363847b2a5730feb0c3e9c11 (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]) successfully deleted
I20251213 09:05:10.203486 18342 raft_consensus.cc:2272] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.203779 18342 ts_tablet_manager.cc:1916] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.205260 18342 ts_tablet_manager.cc:1929] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.205248 18341 ts_tablet_manager.cc:1929] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.205312 18342 log.cc:1199] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/f3b4a3ff63414a5da3faa9023644c677
I20251213 09:05:10.205329 18341 log.cc:1199] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/b3c914dd363847b2a5730feb0c3e9c11
I20251213 09:05:10.205502 18342 ts_tablet_manager.cc:1950] T f3b4a3ff63414a5da3faa9023644c677 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:10.206061 18341 ts_tablet_manager.cc:1950] T b3c914dd363847b2a5730feb0c3e9c11 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:10.206249 18338 tablet_replica.cc:333] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:10.206421 18338 raft_consensus.cc:2243] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:10.206378 17940 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet f3b4a3ff63414a5da3faa9023644c677 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]) successfully deleted
I20251213 09:05:10.206485 18342 tablet_replica.cc:333] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:10.206555 18338 raft_consensus.cc:2272] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.206384 17939 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 33c857d1903b479bb62d8173a4e6f22e (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]) successfully deleted
I20251213 09:05:10.206602 18342 raft_consensus.cc:2243] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:10.206738 18341 tablet_replica.cc:333] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:10.206831 17937 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet b3c914dd363847b2a5730feb0c3e9c11 (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]) successfully deleted
I20251213 09:05:10.206871 18341 raft_consensus.cc:2243] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:10.206938 18338 ts_tablet_manager.cc:1916] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.206969 18341 raft_consensus.cc:2272] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.207028 18342 raft_consensus.cc:2272] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.207413 18342 ts_tablet_manager.cc:1916] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.207532 18341 ts_tablet_manager.cc:1916] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.207084 18346 tablet_bootstrap.cc:492] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:10.208599 18346 ts_tablet_manager.cc:1403] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:10.209280 18338 ts_tablet_manager.cc:1929] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.209321 18346 raft_consensus.cc:359] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.209450 18346 raft_consensus.cc:385] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.209484 18346 raft_consensus.cc:740] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.209483 18342 ts_tablet_manager.cc:1929] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.209545 18342 log.cc:1199] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/33c857d1903b479bb62d8173a4e6f22e
I20251213 09:05:10.209638 18346 consensus_queue.cc:260] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.209800 18342 ts_tablet_manager.cc:1950] T 33c857d1903b479bb62d8173a4e6f22e P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:10.209980 18346 ts_tablet_manager.cc:1434] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:10.209981 18341 ts_tablet_manager.cc:1929] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.210047 18341 log.cc:1199] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/33c857d1903b479bb62d8173a4e6f22e
I20251213 09:05:10.209357 18338 log.cc:1199] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/f3b4a3ff63414a5da3faa9023644c677
I20251213 09:05:10.210160 18343 tablet_bootstrap.cc:492] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:10.210248 18343 ts_tablet_manager.cc:1403] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20251213 09:05:10.210305 18341 ts_tablet_manager.cc:1950] T 33c857d1903b479bb62d8173a4e6f22e P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:10.210563 17940 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 33c857d1903b479bb62d8173a4e6f22e (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]) successfully deleted
I20251213 09:05:10.210744 18338 ts_tablet_manager.cc:1950] T f3b4a3ff63414a5da3faa9023644c677 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:10.210897 18341 tablet_replica.cc:333] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:10.210906 18343 raft_consensus.cc:359] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.211052 18343 raft_consensus.cc:385] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.211035 18341 raft_consensus.cc:2243] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:10.211087 18343 raft_consensus.cc:740] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.211095 17937 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 33c857d1903b479bb62d8173a4e6f22e (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]) successfully deleted
I20251213 09:05:10.211210 18341 raft_consensus.cc:2272] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:10.211263 18343 consensus_queue.cc:260] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.211660 18343 ts_tablet_manager.cc:1434] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:10.211768 18341 ts_tablet_manager.cc:1916] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:10.211833 18343 tablet_bootstrap.cc:492] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
@ 0x7f3424998ffa _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20251213 09:05:10.213056 18343 tablet_bootstrap.cc:654] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:10.213186 18344 tablet_bootstrap.cc:492] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:10.213271 18344 ts_tablet_manager.cc:1403] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
@ 0x55c3fcde5a0a std::function<>::operator()() at ??:0
I20251213 09:05:10.213758 18344 raft_consensus.cc:359] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.213855 18344 raft_consensus.cc:385] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.213891 18344 raft_consensus.cc:740] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.214012 18344 consensus_queue.cc:260] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.214303 18344 ts_tablet_manager.cc:1434] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:10.214334 17939 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet f3b4a3ff63414a5da3faa9023644c677 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]) successfully deleted
I20251213 09:05:10.214499 18344 tablet_bootstrap.cc:492] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:10.215497 18344 tablet_bootstrap.cc:654] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:10.216957 18344 tablet_bootstrap.cc:492] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:10.217038 18344 ts_tablet_manager.cc:1403] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:10.217476 18344 raft_consensus.cc:359] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
@ 0x7f3420c7b7dc kudu::Thread::SuperviseThread() at ??:0
I20251213 09:05:10.217581 18344 raft_consensus.cc:385] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.217612 18344 raft_consensus.cc:740] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.217718 18344 consensus_queue.cc:260] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.218000 18344 ts_tablet_manager.cc:1434] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:10.218128 18346 tablet_bootstrap.cc:492] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:10.218166 18344 tablet_bootstrap.cc:492] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:10.219178 18346 tablet_bootstrap.cc:654] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:10.219712 18344 tablet_bootstrap.cc:654] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
@ 0x7f34215146db start_thread at ??:0
I20251213 09:05:10.221257 18344 tablet_bootstrap.cc:492] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:10.221338 18344 ts_tablet_manager.cc:1403] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251213 09:05:10.221473 18341 ts_tablet_manager.cc:1929] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:10.221539 18341 log.cc:1199] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/f3b4a3ff63414a5da3faa9023644c677
I20251213 09:05:10.221784 18341 ts_tablet_manager.cc:1950] T f3b4a3ff63414a5da3faa9023644c677 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:10.221858 18344 raft_consensus.cc:359] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.221961 18344 raft_consensus.cc:385] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.222002 18344 raft_consensus.cc:740] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.222116 18344 consensus_queue.cc:260] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.222391 18344 ts_tablet_manager.cc:1434] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
@ 0x7f341e9d871f clone at ??:0
I20251213 09:05:10.223712 18346 tablet_bootstrap.cc:492] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:10.223863 18346 ts_tablet_manager.cc:1403] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251213 09:05:10.224139 18343 tablet_bootstrap.cc:492] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:10.224218 18343 ts_tablet_manager.cc:1403] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251213 09:05:10.224361 18346 raft_consensus.cc:359] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.224457 18346 raft_consensus.cc:385] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.224489 18346 raft_consensus.cc:740] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.224625 18346 consensus_queue.cc:260] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.224840 18343 raft_consensus.cc:359] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.224943 18343 raft_consensus.cc:385] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.224979 18343 raft_consensus.cc:740] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.225106 18343 consensus_queue.cc:260] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.225404 18343 ts_tablet_manager.cc:1434] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:10.224912 18346 ts_tablet_manager.cc:1434] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:10.230038 18346 tablet_bootstrap.cc:492] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:10.230505 18343 tablet_bootstrap.cc:492] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:10.231282 18346 tablet_bootstrap.cc:654] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:10.231702 18343 tablet_bootstrap.cc:654] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:10.232781 18343 tablet_bootstrap.cc:492] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:10.232859 18343 ts_tablet_manager.cc:1403] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251213 09:05:10.233086 18346 tablet_bootstrap.cc:492] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:10.233162 18346 ts_tablet_manager.cc:1403] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251213 09:05:10.233393 18343 raft_consensus.cc:359] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.233513 18343 raft_consensus.cc:385] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.233546 18343 raft_consensus.cc:740] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.233615 18346 raft_consensus.cc:359] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.233664 18343 consensus_queue.cc:260] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.233709 18346 raft_consensus.cc:385] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:10.233743 18346 raft_consensus.cc:740] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:10.233865 18346 consensus_queue.cc:260] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.233950 18343 ts_tablet_manager.cc:1434] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:10.234156 18346 ts_tablet_manager.cc:1434] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:10.247965 17875 raft_consensus.cc:493] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:10.248081 17875 raft_consensus.cc:515] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.248533 17875 leader_election.cc:290] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:10.249081 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "639c8c290eb6413e9b343b8c132d8152" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:10.249250 17093 raft_consensus.cc:2468] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:10.249642 16894 leader_election.cc:304] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:10.249742 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "639c8c290eb6413e9b343b8c132d8152" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:10.249864 17875 raft_consensus.cc:2804] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:10.249926 17875 raft_consensus.cc:493] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:10.249914 16820 raft_consensus.cc:2468] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:10.249974 17875 raft_consensus.cc:3060] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.250964 17875 raft_consensus.cc:515] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.251406 17875 leader_election.cc:290] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:10.252005 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "639c8c290eb6413e9b343b8c132d8152" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:10.252123 17093 raft_consensus.cc:3060] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.252372 16820 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "639c8c290eb6413e9b343b8c132d8152" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:10.252496 16820 raft_consensus.cc:3060] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.253206 17093 raft_consensus.cc:2468] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:10.253458 16820 raft_consensus.cc:2468] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:10.253579 16894 leader_election.cc:304] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:10.254410 17757 raft_consensus.cc:2804] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:10.254632 17757 raft_consensus.cc:697] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:10.254791 17757 consensus_queue.cc:237] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.297174 18357 raft_consensus.cc:493] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:10.297331 18357 raft_consensus.cc:515] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.297775 18357 leader_election.cc:290] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:10.298072 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e23c178da6f47c487ed085718b83ce6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:10.298193 16957 raft_consensus.cc:2468] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:10.298223 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e23c178da6f47c487ed085718b83ce6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:10.298370 17093 raft_consensus.cc:2468] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:10.298498 16756 leader_election.cc:304] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:10.298844 18357 raft_consensus.cc:2804] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:10.298914 18357 raft_consensus.cc:493] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:10.298962 18357 raft_consensus.cc:3060] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.300129 18357 raft_consensus.cc:515] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:10.300532 18357 leader_election.cc:290] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:10.300770 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e23c178da6f47c487ed085718b83ce6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:10.300865 16957 raft_consensus.cc:3060] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.300962 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e23c178da6f47c487ed085718b83ce6" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:10.301090 17093 raft_consensus.cc:3060] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.301769 16957 raft_consensus.cc:2468] T 5e23c178da6f47c487ed085718b83ce6 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:10.302079 16756 leader_election.cc:304] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:10.302094 17093 raft_consensus.cc:2468] T 5e23c178da6f47c487ed085718b83ce6 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:10.302520 18357 raft_consensus.cc:2804] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:10.302625 18357 raft_consensus.cc:697] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:10.302762 18357 consensus_queue.cc:237] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
W20251213 09:05:10.396654 16757 connection.cc:537] server connection from 127.0.0.1:34202 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:10.397078 17149 connection.cc:537] client connection to 127.15.213.60:37605 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:10.397545 17149 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.60:37605)
W20251213 09:05:10.397842 17149 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.213.60:37605)
W20251213 09:05:10.398142 17149 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.15.213.60:37605)
W20251213 09:05:10.398401 17149 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.15.213.60:37605)
W20251213 09:05:10.399660 18309 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:10.399266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.60:37605 (local address 127.15.213.3:38971)
1213 09:05:10.399443 (+ 177us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:10.399456 (+ 13us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:10.399527 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":92}
W20251213 09:05:10.399703 18127 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:10.399060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.60:37605 (local address 127.0.0.1:42300)
1213 09:05:10.399250 (+ 190us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:10.399264 (+ 14us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:10.399356 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:10.399612 (+ 256us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":98}
W20251213 09:05:10.400297 18307 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:10.398158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.60:37605 (local address 127.15.213.1:57363)
1213 09:05:10.398337 (+ 179us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:10.398351 (+ 14us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:10.398437 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:10.400188 (+ 1751us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":93}
I20251213 09:05:10.409950 18177 raft_consensus.cc:493] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:10.410123 18177 raft_consensus.cc:515] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.410614 18177 leader_election.cc:290] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:10.411067 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "362edc0369024cc6b1c4acce115c4f1f" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:10.411150 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "362edc0369024cc6b1c4acce115c4f1f" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:10.411252 16819 raft_consensus.cc:2468] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:10.411306 16957 raft_consensus.cc:2468] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:10.411561 17026 leader_election.cc:304] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:10.411754 18177 raft_consensus.cc:2804] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:10.411823 18177 raft_consensus.cc:493] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:10.411875 18177 raft_consensus.cc:3060] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.412763 18177 raft_consensus.cc:515] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.413139 18177 leader_election.cc:290] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:10.413467 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "362edc0369024cc6b1c4acce115c4f1f" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:10.413482 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "362edc0369024cc6b1c4acce115c4f1f" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:10.413595 16957 raft_consensus.cc:3060] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.413594 16819 raft_consensus.cc:3060] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:10.414407 16957 raft_consensus.cc:2468] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:10.414506 16819 raft_consensus.cc:2468] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:10.414703 17028 leader_election.cc:304] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:10.414971 18177 raft_consensus.cc:2804] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:10.415083 18177 raft_consensus.cc:697] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:10.415314 18177 consensus_queue.cc:237] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:10.691689 18374 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:10.691845 18374 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:10.692735 18374 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:10.693810 18234 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:10.694146 18232 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:05:10.694223 18232 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982; no voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:10.694406 18374 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251213 09:05:10.712348 18357 consensus_queue.cc:1048] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:10.715821 18357 consensus_queue.cc:1048] T 5e23c178da6f47c487ed085718b83ce6 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:10.767339 17757 consensus_queue.cc:1048] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:10.771281 18386 consensus_queue.cc:1048] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:10.925026 18177 consensus_queue.cc:1048] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:10.929395 17911 consensus_queue.cc:1048] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:11.427390 18393 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:11.427515 18393 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:11.427924 18393 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:11.429191 18232 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
W20251213 09:05:11.429353 18234 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:11.429432 18234 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982; no voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:11.429580 18393 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251213 09:05:12.523454 18410 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:12.523576 18410 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:12.523942 18410 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:12.525085 18234 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:12.525177 18232 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:05:12.525264 18232 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982; no voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:12.525471 18410 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20251213 09:05:12.623514 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--webserver_interface=127.15.213.61
--webserver_port=46495
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251213 09:05:12.738492 18414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:05:12.738687 18414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:05:12.738729 18414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:05:12.742134 18414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:05:12.742224 18414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:05:12.742303 18414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:05:12.742334 18414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:05:12.746134 18414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.213.61
--webserver_port=46495
--never_fsync=true
--heap_profile_path=/tmp/kudu.18414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:05:12.747251 18414 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:05:12.748461 18414 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:05:12.754048 18422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:12.754078 18421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:12.754081 18424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:12.754184 18414 server_base.cc:1047] running on GCE node
I20251213 09:05:12.754738 18414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:05:12.755666 18414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:05:12.756814 18414 hybrid_clock.cc:648] HybridClock initialized: now 1765616712756794 us; error 40 us; skew 500 ppm
I20251213 09:05:12.758534 18414 webserver.cc:492] Webserver started at http://127.15.213.61:46495/ using document root <none> and password file <none>
I20251213 09:05:12.759090 18414 fs_manager.cc:362] Metadata directory not provided
I20251213 09:05:12.759192 18414 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:05:12.762662 18414 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20251213 09:05:12.766599 18430 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:05:12.767647 18414 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:12.767762 18414 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:05:12.768163 18414 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:05:12.779569 18414 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:05:12.780210 18414 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:05:12.780387 18414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:05:12.787386 18484 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.61:38171 every 8 connection(s)
I20251213 09:05:12.787393 18414 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.61:38171
I20251213 09:05:12.788621 18414 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
I20251213 09:05:12.790438 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 18414
I20251213 09:05:12.793380 18485 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:05:12.796005 18485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap starting.
I20251213 09:05:12.813930 18485 log.cc:826] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Log is configured to *not* fsync() on all Append() calls
I20251213 09:05:12.933838 18485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=248 overwritten=0 applied=248 ignored=0} inserts{seen=158 ignored=0} mutations{seen=223 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251213 09:05:12.934213 18485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap complete.
I20251213 09:05:12.936923 18485 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:12.937357 18485 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Initialized, Role: FOLLOWER
I20251213 09:05:12.937860 18485 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 248, Last appended: 4.248, Last appended by leader: 248, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:12.938423 18490 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:12.938556 18490 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:12.939203 18485 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:05:12.947288 18505 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:12.947438 18505 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: loading cluster ID for follower catalog manager: success
I20251213 09:05:12.951855 18505 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: acquiring CA information for follower catalog manager: success
I20251213 09:05:12.955377 18505 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:05:12.960143 18414 master_runner.cc:186] Error getting master registration for 127.15.213.60:37605: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111),
I20251213 09:05:12.962044 18414 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:13.023753 17141 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:13.025985 18448 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:40423; Asking this server to re-register.
I20251213 09:05:13.026515 17141 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:13.027838 18448 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
W20251213 09:05:13.072165 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 6: this message will repeat every 5th retry.
I20251213 09:05:13.191259 16870 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:13.192674 18448 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:59449; Asking this server to re-register.
I20251213 09:05:13.193140 16870 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:13.194175 18448 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:13.239014 18514 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:13.239192 18514 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:13.239786 18514 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:13.241444 18234 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:13.244050 18459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 6 candidate_status { last_received { term: 5 index: 254 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" is_pre_election: true
I20251213 09:05:13.244380 18459 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 4.
I20251213 09:05:13.244747 18232 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:13.244964 18514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20251213 09:05:13.245023 18514 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Starting leader election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:13.245069 18514 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 5 FOLLOWER]: Advancing to term 6
I20251213 09:05:13.245954 18514 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:13.246313 18514 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 election: Requested vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:13.246771 18459 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 6 candidate_status { last_received { term: 5 index: 254 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
I20251213 09:05:13.246908 18459 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 4 FOLLOWER]: Advancing to term 6
W20251213 09:05:13.247392 18234 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:13.248947 18459 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 6.
I20251213 09:05:13.249337 18232 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:13.249518 18514 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Leader election won for term 6
I20251213 09:05:13.249788 18514 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 LEADER]: Becoming Leader. State: Replica: 8fe04e8d31ac4cd9bca8f96335ff1982, State: Running, Role: LEADER
I20251213 09:05:13.250069 18514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 254, Committed index: 254, Last appended: 5.254, Last appended by leader: 254, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:13.251173 18518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 6 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:13.251282 18518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:13.251608 18520 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:05:13.253809 18520 catalog_manager.cc:679] Loaded metadata for table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:13.254262 18520 catalog_manager.cc:679] Loaded metadata for table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]
I20251213 09:05:13.254490 18520 catalog_manager.cc:679] Loaded metadata for table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]
I20251213 09:05:13.254712 18520 catalog_manager.cc:679] Loaded metadata for table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]
I20251213 09:05:13.254936 18520 catalog_manager.cc:679] Loaded metadata for table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]
I20251213 09:05:13.255165 18520 catalog_manager.cc:679] Loaded metadata for table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]
I20251213 09:05:13.255471 18520 catalog_manager.cc:679] Loaded metadata for table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:13.255860 18520 catalog_manager.cc:679] Loaded metadata for table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]
I20251213 09:05:13.256155 18520 catalog_manager.cc:679] Loaded metadata for table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:13.256352 18520 catalog_manager.cc:679] Loaded metadata for table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]
I20251213 09:05:13.256549 18520 catalog_manager.cc:679] Loaded metadata for table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]
I20251213 09:05:13.256755 18520 catalog_manager.cc:679] Loaded metadata for table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:05:13.256950 18520 catalog_manager.cc:679] Loaded metadata for table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]
I20251213 09:05:13.257171 18520 catalog_manager.cc:679] Loaded metadata for table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:05:13.257532 18520 catalog_manager.cc:679] Loaded metadata for table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]
I20251213 09:05:13.257862 18520 catalog_manager.cc:679] Loaded metadata for table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:13.258101 18520 catalog_manager.cc:679] Loaded metadata for table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]
I20251213 09:05:13.258347 18520 catalog_manager.cc:679] Loaded metadata for table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]
I20251213 09:05:13.258790 18520 catalog_manager.cc:679] Loaded metadata for table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]
I20251213 09:05:13.259099 18520 catalog_manager.cc:679] Loaded metadata for table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]
I20251213 09:05:13.259328 18520 catalog_manager.cc:679] Loaded metadata for table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:13.259487 18520 catalog_manager.cc:679] Loaded metadata for table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]
I20251213 09:05:13.259640 18520 catalog_manager.cc:679] Loaded metadata for table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:13.259814 18520 catalog_manager.cc:679] Loaded metadata for table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:13.259969 18520 catalog_manager.cc:679] Loaded metadata for table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:13.260196 18520 catalog_manager.cc:679] Loaded metadata for table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]
I20251213 09:05:13.260345 18520 catalog_manager.cc:679] Loaded metadata for table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]
I20251213 09:05:13.260490 18520 catalog_manager.cc:679] Loaded metadata for table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]
I20251213 09:05:13.262351 18520 tablet_loader.cc:96] loaded metadata for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d])
I20251213 09:05:13.262861 18520 tablet_loader.cc:96] loaded metadata for tablet 12254c0d95144f8e8d958647924a5ee2 (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f])
I20251213 09:05:13.262984 18520 tablet_loader.cc:96] loaded metadata for tablet 1391d28e1e4046b4af9f0b06ae539c0d (table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d])
I20251213 09:05:13.263494 18520 tablet_loader.cc:96] loaded metadata for tablet 33e5ff40d6b24f51956d050c23d41eb7 (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454])
I20251213 09:05:13.263633 18520 tablet_loader.cc:96] loaded metadata for tablet 362edc0369024cc6b1c4acce115c4f1f (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d])
I20251213 09:05:13.263832 18520 tablet_loader.cc:96] loaded metadata for tablet 3afb8349ced4486d8a283966ac647965 (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8])
I20251213 09:05:13.264106 18520 tablet_loader.cc:96] loaded metadata for tablet 4451b0205d96405ca64a9f027749b7af (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46])
I20251213 09:05:13.264297 18520 tablet_loader.cc:96] loaded metadata for tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb])
I20251213 09:05:13.264415 18520 tablet_loader.cc:96] loaded metadata for tablet 4a86f3d6176a4a4681c0fb31649e0eab (table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907])
I20251213 09:05:13.264686 18520 tablet_loader.cc:96] loaded metadata for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a])
I20251213 09:05:13.265020 18520 tablet_loader.cc:96] loaded metadata for tablet 5e23c178da6f47c487ed085718b83ce6 (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e])
I20251213 09:05:13.265139 18520 tablet_loader.cc:96] loaded metadata for tablet 604c2f416148499ab5651c43cd1491a1 (table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d])
I20251213 09:05:13.265473 18520 tablet_loader.cc:96] loaded metadata for tablet 62236955121e49ec800c5e37a40c5b19 (table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644])
I20251213 09:05:13.265599 18520 tablet_loader.cc:96] loaded metadata for tablet 639c8c290eb6413e9b343b8c132d8152 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f])
I20251213 09:05:13.265734 18520 tablet_loader.cc:96] loaded metadata for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253])
I20251213 09:05:13.266095 18520 tablet_loader.cc:96] loaded metadata for tablet 79d28675183f4fb1ad9a573cab3bba32 (table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a])
I20251213 09:05:13.266830 18520 tablet_loader.cc:96] loaded metadata for tablet 9d0400b5bf3946de8ab82596a94b99ae (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5])
I20251213 09:05:13.267315 18520 tablet_loader.cc:96] loaded metadata for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893])
I20251213 09:05:13.267884 18520 tablet_loader.cc:96] loaded metadata for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07])
I20251213 09:05:13.268038 18520 tablet_loader.cc:96] loaded metadata for tablet c5adcb68c5b9438da10370479acbed52 (table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba])
I20251213 09:05:13.268267 18520 tablet_loader.cc:96] loaded metadata for tablet c75672e770be41aeb9fe180521d3f7af (table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad])
I20251213 09:05:13.268473 18520 tablet_loader.cc:96] loaded metadata for tablet c8276392af2740258e804f72f7529d16 (table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd])
I20251213 09:05:13.268690 18520 tablet_loader.cc:96] loaded metadata for tablet d49fcf75fc57485fa8ab3ee432aa3772 (table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa])
I20251213 09:05:13.269125 18520 tablet_loader.cc:96] loaded metadata for tablet e74f37bdb74e4102931e51914c24d217 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c])
I20251213 09:05:13.269382 18520 tablet_loader.cc:96] loaded metadata for tablet e8b33140a56b49cf9068eb6b09613998 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd])
I20251213 09:05:13.269552 18520 tablet_loader.cc:96] loaded metadata for tablet e8e967a592a442c28f19f8ab943a8528 (table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce])
I20251213 09:05:13.269969 18520 tablet_loader.cc:96] loaded metadata for tablet f394b4d388cd43a49ae4c3db293a893c (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1])
I20251213 09:05:13.270290 18520 tablet_loader.cc:96] loaded metadata for tablet fb68b603c201419491b09993080789b5 (table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee])
I20251213 09:05:13.270432 18520 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:05:13.271800 18520 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:13.271862 18520 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:05:13.273624 18520 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:05:13.274911 18520 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Loaded TSK: 0
I20251213 09:05:13.275875 18520 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:05:13.276706 17006 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:13.277339 18520 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:05:13.278509 18448 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:48485; Asking this server to re-register.
I20251213 09:05:13.278553 18520 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 76
I20251213 09:05:13.278937 17006 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:13.280251 18448 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:13.310747 18246 master_service.cc:954] ReplaceTablet: received request to replace tablet 3afb8349ced4486d8a283966ac647965 from {username='slave'} at 127.0.0.1:40392
I20251213 09:05:13.311524 18240 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40392:
name: "default.Table_2dc90a5c5ed546fc91a933d1157d4271"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:13.311661 18238 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40392:
table { table_name: "default.Table_432a26ea35484c14b07c89f682c923e3" } new_table_name: "default.Table_404d066ee1b14871b9972b685635fe46" modify_external_catalogs: true
I20251213 09:05:13.311918 18244 master_service.cc:954] ReplaceTablet: received request to replace tablet e8b33140a56b49cf9068eb6b09613998 from {username='slave'} at 127.0.0.1:40392
I20251213 09:05:13.312060 18241 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40392:
name: "default.Table_39e762e539224330b4bfb1f52c75c017"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:13.312290 18247 master_service.cc:954] ReplaceTablet: received request to replace tablet 604c2f416148499ab5651c43cd1491a1 from {username='slave'} at 127.0.0.1:40392
I20251213 09:05:13.312649 18239 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40392:
name: "default.Table_9b48a97fa9d7493e90bdd14e64693cdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:13.312696 18242 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40392:
name: "default.Table_a211b679083e4e4294bf4c97874b2d60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:13.312951 18243 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40392:
name: "default.Table_cfb419171a574069b4e41856a31a16f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:13.312963 18245 master_service.cc:954] ReplaceTablet: received request to replace tablet 9d0400b5bf3946de8ab82596a94b99ae from {username='slave'} at 127.0.0.1:40392
I20251213 09:05:13.317286 18459 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Refusing update from remote peer 8fe04e8d31ac4cd9bca8f96335ff1982: Log matching property violated. Preceding OpId in replica: term: 4 index: 248. Preceding OpId from leader: term: 6 index: 258. (index mismatch)
W20251213 09:05:13.317327 18234 consensus_peers.cc:597] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 -> Peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Couldn't send request to peer d7f61ccb4ffd4066babfa94938e28b87. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:13.317916 18524 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 255, Last known committed idx: 248, Time since last communication: 0.000s
F20251213 09:05:13.318485 18301 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 6 out of 12 received events: NotificationEvent(eventId=77, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_82ff078f92894308a9243b01684306d0, message={"server":"","servicePrincipal":"","db":"default","table":"table_82ff078f92894308a9243b01684306d0","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_82ff078f92894308a9243b01684306d0\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_82ff078f92894308a9243b01684306d0\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_82ff078f92894308a9243b01684306d0\",\"transient_lastDdlTime\":\"1765616707\",\"kudu.table_id\":\"9e2a6770e19d4fde8081928cfa9612bd\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1765616707, eventType=CREATE_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_77ba98ea391f495daa07e314094f52c2, message={"server":"","servicePrincipal":"","db":"default","table":"table_731dc67a6a2b407180abef538691c40c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_731dc67a6a2b407180abef538691c40c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_731dc67a6a2b407180abef538691c40c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_731dc67a6a2b407180abef538691c40c\",\"transient_lastDdlTime\":\"1765616703\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_77ba98ea391f495daa07e314094f52c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_77ba98ea391f495daa07e314094f52c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_77ba98ea391f495daa07e314094f52c2\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"transient_lastDdlTime\":\"1765616703\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_cfb419171a574069b4e41856a31a16f7, message={"server":"","servicePrincipal":"","db":"default","table":"table_cfb419171a574069b4e41856a31a16f7","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_cfb419171a574069b4e41856a31a16f7\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_cfb419171a574069b4e41856a31a16f7\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_cfb419171a574069b4e41856a31a16f7\",\"kudu.table_id\":\"75537d22d2274862a5106e7a3cdf7992\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_08f61de8c46c467ba64e2ccbc392e100, message={"server":"","servicePrincipal":"","db":"default","table":"table_a90e27bac3a946e5bdd85f229deeb4be","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_a90e27bac3a946e5bdd85f229deeb4be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a90e27bac3a946e5bdd85f229deeb4be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a90e27bac3a946e5bdd85f229deeb4be\",\"transient_lastDdlTime\":\"1765616701\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_08f61de8c46c467ba64e2ccbc392e100\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_08f61de8c46c467ba64e2ccbc392e100\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_08f61de8c46c467ba64e2ccbc392e100\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"transient_lastDdlTime\":\"1765616701\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f4efff03dcd google::LogMessage::Fail() at ??:0
I20251213 09:05:13.322773 18490 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 6 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:13.322890 18490 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:13.322979 18490 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:13.323041 18490 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7f4efff07b93 google::LogMessage::SendToLog() at ??:0
I20251213 09:05:13.325928 18523 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:13.326047 18523 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:13.326591 18525 mvcc.cc:204] Tried to move back new op lower bound from 7231966057736818688 to 7231966044654297088. Current Snapshot: MvccSnapshot[applied={T|T < 7231966044892762112}]
@ 0x7f4efff037cc google::LogMessage::Flush() at ??:0
I20251213 09:05:13.327148 18528 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:13.327246 18528 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:13.329519 18247 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 604c2f416148499ab5651c43cd1491a1
I20251213 09:05:13.330096 18244 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet e8b33140a56b49cf9068eb6b09613998
I20251213 09:05:13.330219 18245 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 9d0400b5bf3946de8ab82596a94b99ae
I20251213 09:05:13.330549 18246 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 3afb8349ced4486d8a283966ac647965
I20251213 09:05:13.330618 18244 catalog_manager.cc:6724] ReplaceTablet: tablet e8b33140a56b49cf9068eb6b09613998 deleted and replaced by tablet c034dfd35b7b471a8343b1f4e62c4757
I20251213 09:05:13.330785 18246 catalog_manager.cc:6724] ReplaceTablet: tablet 3afb8349ced4486d8a283966ac647965 deleted and replaced by tablet fdb25c7f713e4b63b9ab99cf4daacc4d
I20251213 09:05:13.330904 18244 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40392:
name: "default.Table_82ff078f92894308a9243b01684306d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:13.330969 18246 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40392:
name: "default.Table_af6c4a1282d24b2283671da41b9b0400"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:13.331214 18245 catalog_manager.cc:6724] ReplaceTablet: tablet 9d0400b5bf3946de8ab82596a94b99ae deleted and replaced by tablet 1ef26c19666f4a0194c172a7ca4a922f
I20251213 09:05:13.331403 18245 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40392:
name: "default.Table_e3c10aee5e2044a5b15b49197906acde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:13.332799 18247 catalog_manager.cc:6724] ReplaceTablet: tablet 604c2f416148499ab5651c43cd1491a1 deleted and replaced by tablet d680eb65e2a9499897a362e09bc772b9
I20251213 09:05:13.332970 18247 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40392:
table { table_name: "default.Table_a90e27bac3a946e5bdd85f229deeb4be" } new_table_name: "default.Table_08f61de8c46c467ba64e2ccbc392e100" modify_external_catalogs: true
@ 0x7f4efff03a11 google::LogMessage::~LogMessage() at ??:0
@ 0x7f4f05077279 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20251213 09:05:13.340509 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 604c2f416148499ab5651c43cd1491a1 with delete_type TABLET_DATA_DELETED (replaced by tablet d680eb65e2a9499897a362e09bc772b9) from {username='slave'} at 127.0.0.1:34214
I20251213 09:05:13.340875 16798 tablet_service.cc:1552] Processing DeleteTablet for tablet e8b33140a56b49cf9068eb6b09613998 with delete_type TABLET_DATA_DELETED (replaced by tablet c034dfd35b7b471a8343b1f4e62c4757) from {username='slave'} at 127.0.0.1:34214
I20251213 09:05:13.341084 16796 tablet_service.cc:1552] Processing DeleteTablet for tablet 3afb8349ced4486d8a283966ac647965 with delete_type TABLET_DATA_DELETED (replaced by tablet fdb25c7f713e4b63b9ab99cf4daacc4d) from {username='slave'} at 127.0.0.1:34214
I20251213 09:05:13.341040 16800 tablet_service.cc:1505] Processing CreateTablet for tablet fdb25c7f713e4b63b9ab99cf4daacc4d (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.341300 16801 tablet_service.cc:1505] Processing CreateTablet for tablet d680eb65e2a9499897a362e09bc772b9 (DEFAULT_TABLE table=default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.341353 16799 tablet_service.cc:1505] Processing CreateTablet for tablet c034dfd35b7b471a8343b1f4e62c4757 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.341051 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet 9d0400b5bf3946de8ab82596a94b99ae with delete_type TABLET_DATA_DELETED (replaced by tablet 1ef26c19666f4a0194c172a7ca4a922f) from {username='slave'} at 127.0.0.1:34214
I20251213 09:05:13.342558 16797 tablet_service.cc:1505] Processing CreateTablet for tablet 1ef26c19666f4a0194c172a7ca4a922f (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.341357 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb25c7f713e4b63b9ab99cf4daacc4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.344264 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d680eb65e2a9499897a362e09bc772b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.345242 18543 tablet_bootstrap.cc:492] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:13.345285 16799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c034dfd35b7b471a8343b1f4e62c4757. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.346650 18543 tablet_bootstrap.cc:654] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
@ 0x7f4f05076190 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20251213 09:05:13.347254 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef26c19666f4a0194c172a7ca4a922f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.347746 18543 tablet_bootstrap.cc:492] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:13.347815 18543 ts_tablet_manager.cc:1403] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:13.348325 18543 raft_consensus.cc:359] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.348441 18543 raft_consensus.cc:385] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.348471 18543 raft_consensus.cc:740] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.348505 17070 tablet_service.cc:1552] Processing DeleteTablet for tablet e8b33140a56b49cf9068eb6b09613998 with delete_type TABLET_DATA_DELETED (replaced by tablet c034dfd35b7b471a8343b1f4e62c4757) from {username='slave'} at 127.0.0.1:53858
I20251213 09:05:13.348577 18543 consensus_queue.cc:260] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.348773 17073 tablet_service.cc:1552] Processing DeleteTablet for tablet 604c2f416148499ab5651c43cd1491a1 with delete_type TABLET_DATA_DELETED (replaced by tablet d680eb65e2a9499897a362e09bc772b9) from {username='slave'} at 127.0.0.1:53858
I20251213 09:05:13.348855 18543 ts_tablet_manager.cc:1434] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:13.349002 18543 tablet_bootstrap.cc:492] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:13.349118 17067 tablet_service.cc:1505] Processing CreateTablet for tablet fdb25c7f713e4b63b9ab99cf4daacc4d (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.349284 17071 tablet_service.cc:1505] Processing CreateTablet for tablet c034dfd35b7b471a8343b1f4e62c4757 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.349452 17067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb25c7f713e4b63b9ab99cf4daacc4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.349687 17069 tablet_service.cc:1505] Processing CreateTablet for tablet d680eb65e2a9499897a362e09bc772b9 (DEFAULT_TABLE table=default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.349915 17069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d680eb65e2a9499897a362e09bc772b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.350025 18543 tablet_bootstrap.cc:654] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
@ 0x7f4f050758f3 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20251213 09:05:13.350575 17072 tablet_service.cc:1552] Processing DeleteTablet for tablet 9d0400b5bf3946de8ab82596a94b99ae with delete_type TABLET_DATA_DELETED (replaced by tablet 1ef26c19666f4a0194c172a7ca4a922f) from {username='slave'} at 127.0.0.1:53858
I20251213 09:05:13.350690 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet 3afb8349ced4486d8a283966ac647965 with delete_type TABLET_DATA_DELETED (replaced by tablet fdb25c7f713e4b63b9ab99cf4daacc4d) from {username='slave'} at 127.0.0.1:53858
I20251213 09:05:13.352355 18547 tablet_bootstrap.cc:492] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:13.352392 17066 tablet_service.cc:1505] Processing CreateTablet for tablet 1ef26c19666f4a0194c172a7ca4a922f (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.352672 17066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef26c19666f4a0194c172a7ca4a922f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.353276 17071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c034dfd35b7b471a8343b1f4e62c4757. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.353574 18547 tablet_bootstrap.cc:654] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
@ 0x7f4f0507affa _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x56083eec5a0a std::function<>::operator()() at ??:0
I20251213 09:05:13.356108 18543 tablet_bootstrap.cc:492] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:13.356192 18543 ts_tablet_manager.cc:1403] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:13.356724 18543 raft_consensus.cc:359] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.356828 18543 raft_consensus.cc:385] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.356854 18543 raft_consensus.cc:740] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.356969 18543 consensus_queue.cc:260] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.357244 18543 ts_tablet_manager.cc:1434] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:13.357435 18543 tablet_bootstrap.cc:492] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:13.357939 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet 9d0400b5bf3946de8ab82596a94b99ae with delete_type TABLET_DATA_DELETED (replaced by tablet 1ef26c19666f4a0194c172a7ca4a922f) from {username='slave'} at 127.0.0.1:57804
I20251213 09:05:13.358151 16934 tablet_service.cc:1552] Processing DeleteTablet for tablet 604c2f416148499ab5651c43cd1491a1 with delete_type TABLET_DATA_DELETED (replaced by tablet d680eb65e2a9499897a362e09bc772b9) from {username='slave'} at 127.0.0.1:57804
I20251213 09:05:13.358276 16937 tablet_service.cc:1552] Processing DeleteTablet for tablet e8b33140a56b49cf9068eb6b09613998 with delete_type TABLET_DATA_DELETED (replaced by tablet c034dfd35b7b471a8343b1f4e62c4757) from {username='slave'} at 127.0.0.1:57804
I20251213 09:05:13.358358 16936 tablet_service.cc:1505] Processing CreateTablet for tablet fdb25c7f713e4b63b9ab99cf4daacc4d (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.358407 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 3afb8349ced4486d8a283966ac647965 with delete_type TABLET_DATA_DELETED (replaced by tablet fdb25c7f713e4b63b9ab99cf4daacc4d) from {username='slave'} at 127.0.0.1:57804
@ 0x7f4f0135d7dc kudu::Thread::SuperviseThread() at ??:0
I20251213 09:05:13.358621 16938 tablet_service.cc:1505] Processing CreateTablet for tablet d680eb65e2a9499897a362e09bc772b9 (DEFAULT_TABLE table=default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.358789 18543 tablet_bootstrap.cc:654] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.358290 16935 tablet_service.cc:1505] Processing CreateTablet for tablet c034dfd35b7b471a8343b1f4e62c4757 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.359037 16932 tablet_service.cc:1505] Processing CreateTablet for tablet 1ef26c19666f4a0194c172a7ca4a922f (DEFAULT_TABLE table=default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:13.358621 16936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdb25c7f713e4b63b9ab99cf4daacc4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.359647 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef26c19666f4a0194c172a7ca4a922f. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f4f01bf66db start_thread at ??:0
I20251213 09:05:13.361605 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d680eb65e2a9499897a362e09bc772b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:13.362277 16935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c034dfd35b7b471a8343b1f4e62c4757. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f4eff0ba71f clone at ??:0
I20251213 09:05:13.363550 18545 tablet_replica.cc:333] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:13.363726 18545 raft_consensus.cc:2243] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:13.363842 18545 raft_consensus.cc:2272] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.364177 18545 ts_tablet_manager.cc:1916] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.364334 18551 tablet_bootstrap.cc:492] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:13.365617 18551 tablet_bootstrap.cc:654] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.366087 18545 ts_tablet_manager.cc:1929] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.366138 18545 log.cc:1199] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/e8b33140a56b49cf9068eb6b09613998
I20251213 09:05:13.366441 18545 ts_tablet_manager.cc:1950] T e8b33140a56b49cf9068eb6b09613998 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:13.366534 18542 tablet_replica.cc:333] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:13.366689 18542 raft_consensus.cc:2243] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:13.366812 18551 tablet_bootstrap.cc:492] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:13.366885 18551 ts_tablet_manager.cc:1403] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:13.366923 18542 raft_consensus.cc:2272] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.367054 18545 tablet_replica.cc:333] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:13.367233 18545 raft_consensus.cc:2243] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:13.367359 18545 raft_consensus.cc:2272] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.367445 18542 ts_tablet_manager.cc:1916] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.367714 18545 ts_tablet_manager.cc:1916] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.368163 18549 tablet_replica.cc:333] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:13.368325 18549 raft_consensus.cc:2243] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:13.368505 18551 raft_consensus.cc:359] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.368665 18551 raft_consensus.cc:385] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.368703 18551 raft_consensus.cc:740] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.368849 18551 consensus_queue.cc:260] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.368533 18549 raft_consensus.cc:2272] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.370046 18551 ts_tablet_manager.cc:1434] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251213 09:05:13.370218 18551 tablet_bootstrap.cc:492] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:13.371248 18551 tablet_bootstrap.cc:654] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.371791 18542 ts_tablet_manager.cc:1929] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.371861 18542 log.cc:1199] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/604c2f416148499ab5651c43cd1491a1
I20251213 09:05:13.372045 18549 ts_tablet_manager.cc:1916] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.372133 18542 ts_tablet_manager.cc:1950] T 604c2f416148499ab5651c43cd1491a1 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:13.372406 18547 tablet_bootstrap.cc:492] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:13.372489 18547 ts_tablet_manager.cc:1403] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251213 09:05:13.372906 18542 tablet_replica.cc:333] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:13.373046 18542 raft_consensus.cc:2243] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:13.373008 18547 raft_consensus.cc:359] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.373122 18547 raft_consensus.cc:385] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.373155 18547 raft_consensus.cc:740] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.373270 18547 consensus_queue.cc:260] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.373311 18542 raft_consensus.cc:2272] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.373561 18547 ts_tablet_manager.cc:1434] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:13.373991 18542 ts_tablet_manager.cc:1916] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.374794 18549 ts_tablet_manager.cc:1929] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.374858 18549 log.cc:1199] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/9d0400b5bf3946de8ab82596a94b99ae
I20251213 09:05:13.375151 18549 ts_tablet_manager.cc:1950] T 9d0400b5bf3946de8ab82596a94b99ae P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:13.375746 18549 tablet_replica.cc:333] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:13.375861 18549 raft_consensus.cc:2243] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:13.375952 18549 raft_consensus.cc:2272] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.376082 18542 ts_tablet_manager.cc:1929] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.376152 18542 log.cc:1199] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/e8b33140a56b49cf9068eb6b09613998
I20251213 09:05:13.376250 18547 tablet_bootstrap.cc:492] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:13.376276 18549 ts_tablet_manager.cc:1916] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.376417 18542 ts_tablet_manager.cc:1950] T e8b33140a56b49cf9068eb6b09613998 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:13.376979 18542 tablet_replica.cc:333] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:13.377097 18542 raft_consensus.cc:2243] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:13.377197 18545 ts_tablet_manager.cc:1929] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.377269 18545 log.cc:1199] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/604c2f416148499ab5651c43cd1491a1
I20251213 09:05:13.377350 18547 tablet_bootstrap.cc:654] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.377566 18545 ts_tablet_manager.cc:1950] T 604c2f416148499ab5651c43cd1491a1 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:13.377192 18542 raft_consensus.cc:2272] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.378439 18542 ts_tablet_manager.cc:1916] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.378836 18545 tablet_replica.cc:333] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:13.378959 18545 raft_consensus.cc:2243] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:13.379055 18545 raft_consensus.cc:2272] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.379456 18545 ts_tablet_manager.cc:1916] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.380342 18542 ts_tablet_manager.cc:1929] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.380403 18542 log.cc:1199] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/3afb8349ced4486d8a283966ac647965
I20251213 09:05:13.380641 18542 ts_tablet_manager.cc:1950] T 3afb8349ced4486d8a283966ac647965 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:13.381114 18549 ts_tablet_manager.cc:1929] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.381191 18549 log.cc:1199] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/604c2f416148499ab5651c43cd1491a1
I20251213 09:05:13.381232 18542 tablet_replica.cc:333] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:13.381377 18542 raft_consensus.cc:2243] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:13.381456 18549 ts_tablet_manager.cc:1950] T 604c2f416148499ab5651c43cd1491a1 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:13.381484 18542 raft_consensus.cc:2272] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.381867 18542 ts_tablet_manager.cc:1916] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.382619 18551 tablet_bootstrap.cc:492] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:13.382668 18543 tablet_bootstrap.cc:492] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:13.382699 18551 ts_tablet_manager.cc:1403] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251213 09:05:13.382754 18543 ts_tablet_manager.cc:1403] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20251213 09:05:13.383224 18551 raft_consensus.cc:359] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.383339 18551 raft_consensus.cc:385] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.383374 18551 raft_consensus.cc:740] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.383314 18543 raft_consensus.cc:359] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.383425 18543 raft_consensus.cc:385] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.383460 18543 raft_consensus.cc:740] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.383584 18551 consensus_queue.cc:260] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.383605 18543 consensus_queue.cc:260] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.383692 18542 ts_tablet_manager.cc:1929] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.383742 18542 log.cc:1199] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/9d0400b5bf3946de8ab82596a94b99ae
I20251213 09:05:13.383867 18551 ts_tablet_manager.cc:1434] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251213 09:05:13.383927 18543 ts_tablet_manager.cc:1434] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:13.383980 18542 ts_tablet_manager.cc:1950] T 9d0400b5bf3946de8ab82596a94b99ae P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:13.384179 18543 tablet_bootstrap.cc:492] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:13.385278 18543 tablet_bootstrap.cc:654] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.387501 18543 tablet_bootstrap.cc:492] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:13.387655 18543 ts_tablet_manager.cc:1403] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:13.388137 18545 ts_tablet_manager.cc:1929] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.388132 18543 raft_consensus.cc:359] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.388202 18545 log.cc:1199] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/9d0400b5bf3946de8ab82596a94b99ae
I20251213 09:05:13.388226 18543 raft_consensus.cc:385] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.388263 18543 raft_consensus.cc:740] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.388392 18543 consensus_queue.cc:260] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.388526 18545 ts_tablet_manager.cc:1950] T 9d0400b5bf3946de8ab82596a94b99ae P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:13.388767 18543 ts_tablet_manager.cc:1434] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:13.389603 18547 tablet_bootstrap.cc:492] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:13.389670 18547 ts_tablet_manager.cc:1403] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251213 09:05:13.389180 18545 tablet_replica.cc:333] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:13.389982 18545 raft_consensus.cc:2243] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:13.390084 18545 raft_consensus.cc:2272] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.390141 18547 raft_consensus.cc:359] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.390232 18547 raft_consensus.cc:385] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.390264 18547 raft_consensus.cc:740] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.390431 18545 ts_tablet_manager.cc:1916] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.390411 18547 consensus_queue.cc:260] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.392132 18547 ts_tablet_manager.cc:1434] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:13.392532 18545 ts_tablet_manager.cc:1929] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.392596 18545 log.cc:1199] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/3afb8349ced4486d8a283966ac647965
I20251213 09:05:13.392845 18545 ts_tablet_manager.cc:1950] T 3afb8349ced4486d8a283966ac647965 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:13.393011 18547 tablet_bootstrap.cc:492] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:13.393146 18551 tablet_bootstrap.cc:492] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:13.394034 18547 tablet_bootstrap.cc:654] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.394343 18549 tablet_replica.cc:333] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:13.394522 18549 raft_consensus.cc:2243] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:13.394650 18549 raft_consensus.cc:2272] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.395051 18549 ts_tablet_manager.cc:1916] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.395641 18551 tablet_bootstrap.cc:654] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.396816 18547 tablet_bootstrap.cc:492] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:13.396899 18547 ts_tablet_manager.cc:1403] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:13.397372 18547 raft_consensus.cc:359] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.397482 18547 raft_consensus.cc:385] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.397516 18547 raft_consensus.cc:740] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.397696 18549 ts_tablet_manager.cc:1929] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.397764 18549 log.cc:1199] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/e8b33140a56b49cf9068eb6b09613998
I20251213 09:05:13.397933 18547 consensus_queue.cc:260] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.398027 18549 ts_tablet_manager.cc:1950] T e8b33140a56b49cf9068eb6b09613998 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:13.398311 18547 ts_tablet_manager.cc:1434] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:13.398659 18547 tablet_bootstrap.cc:492] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:13.400517 18549 tablet_replica.cc:333] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:13.400745 18549 raft_consensus.cc:2243] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:13.400954 18549 raft_consensus.cc:2272] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:13.401391 18549 ts_tablet_manager.cc:1916] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:13.402004 18551 tablet_bootstrap.cc:492] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:13.402087 18551 ts_tablet_manager.cc:1403] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20251213 09:05:13.403906 18549 ts_tablet_manager.cc:1929] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:13.403975 18549 log.cc:1199] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/3afb8349ced4486d8a283966ac647965
I20251213 09:05:13.404078 18551 raft_consensus.cc:359] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.404186 18551 raft_consensus.cc:385] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.404219 18551 raft_consensus.cc:740] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.404238 18549 ts_tablet_manager.cc:1950] T 3afb8349ced4486d8a283966ac647965 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:13.404407 18551 consensus_queue.cc:260] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.404738 18551 ts_tablet_manager.cc:1434] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251213 09:05:13.405567 18551 tablet_bootstrap.cc:492] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:13.408005 18551 tablet_bootstrap.cc:654] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.408301 18547 tablet_bootstrap.cc:654] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:13.409577 18547 tablet_bootstrap.cc:492] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:13.409667 18547 ts_tablet_manager.cc:1403] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251213 09:05:13.410317 18551 tablet_bootstrap.cc:492] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:13.410259 18547 raft_consensus.cc:359] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.410400 18551 ts_tablet_manager.cc:1403] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20251213 09:05:13.410396 18547 raft_consensus.cc:385] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.410437 18547 raft_consensus.cc:740] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.410581 18547 consensus_queue.cc:260] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.410853 18551 raft_consensus.cc:359] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.410944 18547 ts_tablet_manager.cc:1434] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:13.410955 18551 raft_consensus.cc:385] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:13.410986 18551 raft_consensus.cc:740] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:13.411096 18551 consensus_queue.cc:260] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.411430 18551 ts_tablet_manager.cc:1434] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:13.464296 18510 raft_consensus.cc:493] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:13.464473 18510 raft_consensus.cc:515] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.464977 18510 leader_election.cc:290] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:13.465488 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c034dfd35b7b471a8343b1f4e62c4757" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:13.465524 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c034dfd35b7b471a8343b1f4e62c4757" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:13.465652 17093 raft_consensus.cc:2468] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:13.465652 16956 raft_consensus.cc:2468] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:13.466053 16756 leader_election.cc:304] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:13.466313 18510 raft_consensus.cc:2804] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:13.466400 18510 raft_consensus.cc:493] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:13.466440 18510 raft_consensus.cc:3060] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.467723 18510 raft_consensus.cc:515] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.468300 18510 leader_election.cc:290] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:13.468797 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c034dfd35b7b471a8343b1f4e62c4757" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:13.468888 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c034dfd35b7b471a8343b1f4e62c4757" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:13.468945 17093 raft_consensus.cc:3060] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.469024 16956 raft_consensus.cc:3060] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.470026 17093 raft_consensus.cc:2468] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:13.470026 16956 raft_consensus.cc:2468] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:13.470439 16757 leader_election.cc:304] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:13.470669 18510 raft_consensus.cc:2804] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:13.470872 18510 raft_consensus.cc:697] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:13.471029 18510 consensus_queue.cc:237] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.506129 18386 raft_consensus.cc:493] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:13.506305 18386 raft_consensus.cc:515] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.506837 18386 leader_election.cc:290] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:13.507326 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ef26c19666f4a0194c172a7ca4a922f" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:13.507347 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ef26c19666f4a0194c172a7ca4a922f" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:13.507496 17093 raft_consensus.cc:2468] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:13.507496 16819 raft_consensus.cc:2468] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:13.507874 16894 leader_election.cc:304] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:13.508097 18386 raft_consensus.cc:2804] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:13.508181 18386 raft_consensus.cc:493] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:13.508236 18386 raft_consensus.cc:3060] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.509557 18386 raft_consensus.cc:515] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.509976 18386 leader_election.cc:290] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:13.510385 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ef26c19666f4a0194c172a7ca4a922f" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:13.510396 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ef26c19666f4a0194c172a7ca4a922f" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:13.510509 16819 raft_consensus.cc:3060] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.510520 17093 raft_consensus.cc:3060] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.511411 16819 raft_consensus.cc:2468] T 1ef26c19666f4a0194c172a7ca4a922f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:13.511509 17093 raft_consensus.cc:2468] T 1ef26c19666f4a0194c172a7ca4a922f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:13.511742 16891 leader_election.cc:304] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:13.511906 18386 raft_consensus.cc:2804] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:13.512006 18386 raft_consensus.cc:697] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:13.512158 18386 consensus_queue.cc:237] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
W20251213 09:05:13.556908 17028 connection.cc:537] server connection from 127.0.0.1:53858 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:13.556928 16755 connection.cc:537] server connection from 127.0.0.1:34214 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:13.556942 16894 connection.cc:537] server connection from 127.0.0.1:57804 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:13.557214 16891 connection.cc:537] client connection to 127.15.213.62:42117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:13.557289 17026 connection.cc:537] client connection to 127.15.213.62:42117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:13.558519 17146 connection.cc:537] client connection to 127.15.213.62:42117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:13.558818 18512 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:13.557875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.15.213.1:35691)
1213 09:05:13.558072 (+ 197us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:13.558088 (+ 16us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:13.558181 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:13.558696 (+ 515us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":108}
W20251213 09:05:13.559057 17146 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.62:42117)
W20251213 09:05:13.559343 18521 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:13.557964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.15.213.2:47013)
1213 09:05:13.558366 (+ 402us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:13.558377 (+ 11us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:13.558447 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:13.559227 (+ 780us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":322}
W20251213 09:05:13.559358 17146 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:13.559501 17146 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:13.559687 18401 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:13.557964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.62:42117 (local address 127.15.213.3:33501)
1213 09:05:13.558149 (+ 185us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:13.558161 (+ 12us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:13.558231 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:13.559578 (+ 1347us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":110}
W20251213 09:05:13.559739 17146 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.213.62:42117)
I20251213 09:05:13.629472 18386 raft_consensus.cc:493] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:13.629624 18386 raft_consensus.cc:515] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.630029 18386 leader_election.cc:290] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:13.630378 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fdb25c7f713e4b63b9ab99cf4daacc4d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:13.630385 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fdb25c7f713e4b63b9ab99cf4daacc4d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:13.630518 17093 raft_consensus.cc:2468] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:13.630511 16819 raft_consensus.cc:2468] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:13.630827 16891 leader_election.cc:304] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:13.630992 18386 raft_consensus.cc:2804] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:13.631062 18386 raft_consensus.cc:493] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:13.631091 18386 raft_consensus.cc:3060] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.631991 18386 raft_consensus.cc:515] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.632359 18386 leader_election.cc:290] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:13.632752 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fdb25c7f713e4b63b9ab99cf4daacc4d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:13.632787 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fdb25c7f713e4b63b9ab99cf4daacc4d" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:13.632951 17093 raft_consensus.cc:3060] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.633082 16819 raft_consensus.cc:3060] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.633833 17093 raft_consensus.cc:2468] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:13.634212 16894 leader_election.cc:304] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:13.634235 16819 raft_consensus.cc:2468] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:13.634444 18386 raft_consensus.cc:2804] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:13.634558 18386 raft_consensus.cc:697] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:13.634750 18386 consensus_queue.cc:237] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.677426 18386 raft_consensus.cc:493] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:13.677575 18386 raft_consensus.cc:515] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.677981 18386 leader_election.cc:290] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:13.678342 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d680eb65e2a9499897a362e09bc772b9" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:13.678388 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d680eb65e2a9499897a362e09bc772b9" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:13.678519 16819 raft_consensus.cc:2468] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:13.678539 17093 raft_consensus.cc:2468] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:13.678828 16891 leader_election.cc:304] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:13.679031 18386 raft_consensus.cc:2804] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:13.679087 18386 raft_consensus.cc:493] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:13.679145 18386 raft_consensus.cc:3060] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.679988 18386 raft_consensus.cc:515] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.680334 18386 leader_election.cc:290] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:13.680627 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d680eb65e2a9499897a362e09bc772b9" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:13.680773 16819 raft_consensus.cc:3060] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.680837 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d680eb65e2a9499897a362e09bc772b9" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:13.680958 17093 raft_consensus.cc:3060] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:13.681849 16819 raft_consensus.cc:2468] T d680eb65e2a9499897a362e09bc772b9 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:13.681988 17093 raft_consensus.cc:2468] T d680eb65e2a9499897a362e09bc772b9 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:13.682206 16891 leader_election.cc:304] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:13.682639 18386 raft_consensus.cc:2804] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:13.682749 18386 raft_consensus.cc:697] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:13.682891 18386 consensus_queue.cc:237] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:13.837986 18580 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:13.838104 18580 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:13.839262 18580 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:13.839816 18436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:13.840463 18433 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:13.840641 18436 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:13.840728 18436 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:13.840937 18580 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20251213 09:05:13.922145 18510 consensus_queue.cc:1048] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:13.926640 18391 consensus_queue.cc:1048] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:13.962901 18554 consensus_queue.cc:1048] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:13.966049 18554 consensus_queue.cc:1048] T 1ef26c19666f4a0194c172a7ca4a922f P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:14.076684 18554 consensus_queue.cc:1048] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:14.080677 18386 consensus_queue.cc:1048] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:14.121068 18386 consensus_queue.cc:1048] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:14.125171 18386 consensus_queue.cc:1048] T d680eb65e2a9499897a362e09bc772b9 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:14.445938 18597 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:14.446074 18597 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:14.446476 18597 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:14.447750 18436 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:14.447832 18433 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:14.447947 18433 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:14.448074 18597 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20251213 09:05:15.247012 16212 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu with pid 18414
I20251213 09:05:16.178751 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--webserver_interface=127.15.213.61
--webserver_port=46495
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251213 09:05:16.296200 18623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:05:16.296476 18623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:05:16.296552 18623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:05:16.299948 18623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:05:16.300021 18623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:05:16.300061 18623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:05:16.300104 18623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:05:16.304126 18623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.213.61
--webserver_port=46495
--never_fsync=true
--heap_profile_path=/tmp/kudu.18623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:05:16.305289 18623 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:05:16.306452 18623 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:05:16.312268 18629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:16.312409 18623 server_base.cc:1047] running on GCE node
W20251213 09:05:16.312248 18628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:16.312249 18631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:16.313025 18623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:05:16.313987 18623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:05:16.315205 18623 hybrid_clock.cc:648] HybridClock initialized: now 1765616716315191 us; error 35 us; skew 500 ppm
I20251213 09:05:16.317052 18623 webserver.cc:492] Webserver started at http://127.15.213.61:46495/ using document root <none> and password file <none>
I20251213 09:05:16.317638 18623 fs_manager.cc:362] Metadata directory not provided
I20251213 09:05:16.317704 18623 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:05:16.321401 18623 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20251213 09:05:16.323518 18637 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:05:16.324638 18623 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20251213 09:05:16.324757 18623 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:05:16.325177 18623 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:05:16.347878 18623 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:05:16.348599 18623 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:05:16.348774 18623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:05:16.356534 18623 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.61:38171
I20251213 09:05:16.356626 18692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.61:38171 every 8 connection(s)
I20251213 09:05:16.357672 18623 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
I20251213 09:05:16.362010 18693 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:05:16.363669 18693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap starting.
I20251213 09:05:16.365255 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 18623
I20251213 09:05:16.384696 18693 log.cc:826] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Log is configured to *not* fsync() on all Append() calls
I20251213 09:05:16.433389 17141 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:16.471745 16870 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:16.511672 18693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=260 overwritten=0 applied=260 ignored=0} inserts{seen=165 ignored=0} mutations{seen=237 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251213 09:05:16.512055 18693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap complete.
I20251213 09:05:16.514914 18693 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:16.515281 18693 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Initialized, Role: FOLLOWER
I20251213 09:05:16.515719 18693 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 260, Last appended: 6.260, Last appended by leader: 260, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:16.516170 18701 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:16.516287 18701 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:16.516796 18693 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:05:16.522070 18623 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:16.524173 18715 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:16.524221 18623 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:16.524219 18715 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: loading cluster ID for follower catalog manager: success
I20251213 09:05:16.528419 18715 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: acquiring CA information for follower catalog manager: success
I20251213 09:05:16.531719 18715 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:05:16.651177 17006 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:16.652576 18657 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:52891; Asking this server to re-register.
I20251213 09:05:16.653026 17006 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:16.654422 18657 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:16.864389 18657 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:42569; Asking this server to re-register.
I20251213 09:05:16.864893 17141 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:16.866202 18657 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:16.917925 18701 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:16.918097 18701 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:16.919379 18701 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:16.919739 18641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:16.920464 18641 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:16.920583 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:16.920688 18638 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:16.920898 18701 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20251213 09:05:16.974749 18657 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:48433; Asking this server to re-register.
I20251213 09:05:16.975348 16870 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:16.976511 18657 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:17.507170 18728 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:17.507329 18728 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:17.507862 18728 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:17.509364 18641 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:17.509449 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:17.509508 18638 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:17.509641 18728 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20251213 09:05:18.213763 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 11: this message will repeat every 5th retry.
I20251213 09:05:18.625212 18742 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:18.625387 18742 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:18.625819 18742 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:18.627036 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:18.627140 18641 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:18.627223 18641 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:18.627393 18742 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20251213 09:05:19.542786 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.62:42117
--webserver_interface=127.15.213.62
--webserver_port=43541
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251213 09:05:19.628677 18761 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:19.628806 18761 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:19.629222 18761 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:19.630482 18641 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:19.631026 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:19.631136 18638 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:19.631287 18761 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20251213 09:05:19.660298 18758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:05:19.660512 18758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:05:19.660602 18758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:05:19.664041 18758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:05:19.664099 18758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:05:19.664130 18758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:05:19.664207 18758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:05:19.668582 18758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.62:42117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.15.213.62
--webserver_port=43541
--never_fsync=true
--heap_profile_path=/tmp/kudu.18758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:05:19.669704 18758 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:05:19.670886 18758 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:05:19.676864 18773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:19.676926 18774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:19.676949 18776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:19.677069 18758 server_base.cc:1047] running on GCE node
I20251213 09:05:19.677711 18758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:05:19.678619 18758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:05:19.679780 18758 hybrid_clock.cc:648] HybridClock initialized: now 1765616719679763 us; error 34 us; skew 500 ppm
I20251213 09:05:19.681656 18758 webserver.cc:492] Webserver started at http://127.15.213.62:43541/ using document root <none> and password file <none>
I20251213 09:05:19.682188 18758 fs_manager.cc:362] Metadata directory not provided
I20251213 09:05:19.682240 18758 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:05:19.685657 18758 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:19.687695 18782 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:05:19.689105 18758 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:19.689220 18758 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
uuid: "8fe04e8d31ac4cd9bca8f96335ff1982"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:05:19.689693 18758 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:05:19.716562 18758 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:05:19.717263 18758 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:05:19.717428 18758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:05:19.724545 18834 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.62:42117 every 8 connection(s)
I20251213 09:05:19.724560 18758 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.62:42117
I20251213 09:05:19.725652 18758 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-0/data/info.pb
I20251213 09:05:19.729547 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 18758
I20251213 09:05:19.729739 18835 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:05:19.731735 18835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap starting.
I20251213 09:05:19.751410 18835 log.cc:826] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Log is configured to *not* fsync() on all Append() calls
I20251213 09:05:19.873039 18835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap replayed 1/1 log segments. Stats: ops{read=260 overwritten=0 applied=260 ignored=0} inserts{seen=165 ignored=0} mutations{seen=237 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251213 09:05:19.873502 18835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Bootstrap complete.
I20251213 09:05:19.876626 18835 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:19.876965 18835 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fe04e8d31ac4cd9bca8f96335ff1982, State: Initialized, Role: FOLLOWER
I20251213 09:05:19.877362 18835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 260, Last appended: 6.260, Last appended by leader: 260, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:19.877907 18840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:19.878021 18840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:19.878546 18835 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:05:19.886210 18854 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:19.886287 18854 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: loading cluster ID for follower catalog manager: success
I20251213 09:05:19.890743 18854 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: acquiring CA information for follower catalog manager: success
I20251213 09:05:19.893867 18854 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:05:19.898428 18758 master_runner.cc:186] Error getting master registration for 127.15.213.60:37605: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111),
I20251213 09:05:19.900807 18758 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:19.977316 16869 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:19.979354 18799 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:44761; Asking this server to re-register.
I20251213 09:05:19.979990 16869 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:19.981623 18799 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:20.156484 17005 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:20.158035 18799 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:60647; Asking this server to re-register.
I20251213 09:05:20.158473 17005 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:20.159523 18799 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:20.170641 17140 heartbeater.cc:344] Connected to a master server at 127.15.213.62:42117
I20251213 09:05:20.172060 18799 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:51257; Asking this server to re-register.
I20251213 09:05:20.172578 17140 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:20.173676 18799 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:20.283654 18840 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:20.283883 18840 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:20.285373 18840 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:20.285851 18786 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:20.285799 18667 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 7 candidate_status { last_received { term: 6 index: 260 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" is_pre_election: true
I20251213 09:05:20.286056 18667 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 6.
I20251213 09:05:20.286502 18785 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters:
I20251213 09:05:20.286769 18840 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20251213 09:05:20.286863 18840 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:20.286928 18840 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 6 FOLLOWER]: Advancing to term 7
W20251213 09:05:20.287098 18786 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:20.288965 18840 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:20.289314 18840 leader_election.cc:290] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 7 election: Requested vote from peers f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:20.289623 18667 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" candidate_term: 7 candidate_status { last_received { term: 6 index: 260 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
I20251213 09:05:20.289748 18667 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 6 FOLLOWER]: Advancing to term 7
W20251213 09:05:20.290321 18786 leader_election.cc:336] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:20.291590 18667 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fe04e8d31ac4cd9bca8f96335ff1982 in term 7.
I20251213 09:05:20.291917 18785 leader_election.cc:304] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:20.292124 18840 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 7 FOLLOWER]: Leader election won for term 7
I20251213 09:05:20.292279 18840 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [term 7 LEADER]: Becoming Leader. State: Replica: 8fe04e8d31ac4cd9bca8f96335ff1982, State: Running, Role: LEADER
I20251213 09:05:20.292574 18840 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 260, Committed index: 260, Last appended: 6.260, Last appended by leader: 260, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:20.294147 18866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 7 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:20.294320 18866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:20.294709 18868 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:05:20.297245 18868 catalog_manager.cc:679] Loaded metadata for table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:20.297712 18868 catalog_manager.cc:679] Loaded metadata for table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]
I20251213 09:05:20.297930 18868 catalog_manager.cc:679] Loaded metadata for table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]
I20251213 09:05:20.298130 18868 catalog_manager.cc:679] Loaded metadata for table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]
I20251213 09:05:20.298346 18868 catalog_manager.cc:679] Loaded metadata for table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]
I20251213 09:05:20.298552 18868 catalog_manager.cc:679] Loaded metadata for table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]
I20251213 09:05:20.298846 18868 catalog_manager.cc:679] Loaded metadata for table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:20.299260 18868 catalog_manager.cc:679] Loaded metadata for table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]
I20251213 09:05:20.299569 18868 catalog_manager.cc:679] Loaded metadata for table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:20.299765 18868 catalog_manager.cc:679] Loaded metadata for table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]
I20251213 09:05:20.299969 18868 catalog_manager.cc:679] Loaded metadata for table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]
I20251213 09:05:20.300165 18868 catalog_manager.cc:679] Loaded metadata for table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:05:20.300370 18868 catalog_manager.cc:679] Loaded metadata for table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]
I20251213 09:05:20.300613 18868 catalog_manager.cc:679] Loaded metadata for table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:05:20.301049 18868 catalog_manager.cc:679] Loaded metadata for table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]
I20251213 09:05:20.301359 18868 catalog_manager.cc:679] Loaded metadata for table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:20.301555 18868 catalog_manager.cc:679] Loaded metadata for table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]
I20251213 09:05:20.301757 18868 catalog_manager.cc:679] Loaded metadata for table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]
I20251213 09:05:20.302139 18868 catalog_manager.cc:679] Loaded metadata for table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]
I20251213 09:05:20.302438 18868 catalog_manager.cc:679] Loaded metadata for table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]
I20251213 09:05:20.302678 18868 catalog_manager.cc:679] Loaded metadata for table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:20.302920 18868 catalog_manager.cc:679] Loaded metadata for table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]
I20251213 09:05:20.303185 18868 catalog_manager.cc:679] Loaded metadata for table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:20.303424 18868 catalog_manager.cc:679] Loaded metadata for table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:20.303637 18868 catalog_manager.cc:679] Loaded metadata for table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:20.303953 18868 catalog_manager.cc:679] Loaded metadata for table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]
I20251213 09:05:20.304163 18868 catalog_manager.cc:679] Loaded metadata for table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]
I20251213 09:05:20.304382 18868 catalog_manager.cc:679] Loaded metadata for table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]
I20251213 09:05:20.306350 18868 tablet_loader.cc:96] loaded metadata for tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d])
I20251213 09:05:20.306936 18868 tablet_loader.cc:96] loaded metadata for tablet 12254c0d95144f8e8d958647924a5ee2 (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f])
I20251213 09:05:20.307145 18868 tablet_loader.cc:96] loaded metadata for tablet 1391d28e1e4046b4af9f0b06ae539c0d (table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d])
I20251213 09:05:20.307430 18868 tablet_loader.cc:96] loaded metadata for tablet 1ef26c19666f4a0194c172a7ca4a922f (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5])
I20251213 09:05:20.307849 18868 tablet_loader.cc:96] loaded metadata for tablet 33e5ff40d6b24f51956d050c23d41eb7 (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454])
I20251213 09:05:20.308018 18868 tablet_loader.cc:96] loaded metadata for tablet 362edc0369024cc6b1c4acce115c4f1f (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d])
I20251213 09:05:20.308533 18868 tablet_loader.cc:96] loaded metadata for tablet 4451b0205d96405ca64a9f027749b7af (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46])
I20251213 09:05:20.308792 18868 tablet_loader.cc:96] loaded metadata for tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb])
I20251213 09:05:20.308960 18868 tablet_loader.cc:96] loaded metadata for tablet 4a86f3d6176a4a4681c0fb31649e0eab (table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907])
I20251213 09:05:20.309357 18868 tablet_loader.cc:96] loaded metadata for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a])
I20251213 09:05:20.309787 18868 tablet_loader.cc:96] loaded metadata for tablet 5e23c178da6f47c487ed085718b83ce6 (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e])
I20251213 09:05:20.310416 18868 tablet_loader.cc:96] loaded metadata for tablet 62236955121e49ec800c5e37a40c5b19 (table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644])
I20251213 09:05:20.310752 18868 tablet_loader.cc:96] loaded metadata for tablet 639c8c290eb6413e9b343b8c132d8152 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f])
I20251213 09:05:20.311002 18868 tablet_loader.cc:96] loaded metadata for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253])
I20251213 09:05:20.311496 18868 tablet_loader.cc:96] loaded metadata for tablet 79d28675183f4fb1ad9a573cab3bba32 (table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a])
I20251213 09:05:20.312418 18868 tablet_loader.cc:96] loaded metadata for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893])
I20251213 09:05:20.312928 18868 tablet_loader.cc:96] loaded metadata for tablet c034dfd35b7b471a8343b1f4e62c4757 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd])
I20251213 09:05:20.313053 18868 tablet_loader.cc:96] loaded metadata for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07])
I20251213 09:05:20.313191 18868 tablet_loader.cc:96] loaded metadata for tablet c5adcb68c5b9438da10370479acbed52 (table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba])
I20251213 09:05:20.313398 18868 tablet_loader.cc:96] loaded metadata for tablet c75672e770be41aeb9fe180521d3f7af (table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad])
I20251213 09:05:20.313532 18868 tablet_loader.cc:96] loaded metadata for tablet c8276392af2740258e804f72f7529d16 (table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd])
I20251213 09:05:20.313657 18868 tablet_loader.cc:96] loaded metadata for tablet d49fcf75fc57485fa8ab3ee432aa3772 (table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa])
I20251213 09:05:20.313833 18868 tablet_loader.cc:96] loaded metadata for tablet d680eb65e2a9499897a362e09bc772b9 (table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d])
I20251213 09:05:20.314247 18868 tablet_loader.cc:96] loaded metadata for tablet e74f37bdb74e4102931e51914c24d217 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c])
I20251213 09:05:20.314607 18868 tablet_loader.cc:96] loaded metadata for tablet e8e967a592a442c28f19f8ab943a8528 (table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce])
I20251213 09:05:20.314982 18868 tablet_loader.cc:96] loaded metadata for tablet f394b4d388cd43a49ae4c3db293a893c (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1])
I20251213 09:05:20.315306 18868 tablet_loader.cc:96] loaded metadata for tablet fb68b603c201419491b09993080789b5 (table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee])
I20251213 09:05:20.315454 18868 tablet_loader.cc:96] loaded metadata for tablet fdb25c7f713e4b63b9ab99cf4daacc4d (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8])
I20251213 09:05:20.315598 18868 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:05:20.316843 18868 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:20.316890 18868 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:05:20.318301 18868 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:05:20.319473 18868 catalog_manager.cc:6038] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Loaded TSK: 0
I20251213 09:05:20.320164 18868 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:05:20.321249 18868 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:05:20.322301 18868 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 76
I20251213 09:05:20.399787 18799 master_service.cc:954] ReplaceTablet: received request to replace tablet 4a86f3d6176a4a4681c0fb31649e0eab from {username='slave'} at 127.0.0.1:54236
I20251213 09:05:20.399931 18798 master_service.cc:954] ReplaceTablet: received request to replace tablet fb68b603c201419491b09993080789b5 from {username='slave'} at 127.0.0.1:54236
I20251213 09:05:20.399968 18797 master_service.cc:954] ReplaceTablet: received request to replace tablet fdb25c7f713e4b63b9ab99cf4daacc4d from {username='slave'} at 127.0.0.1:54236
I20251213 09:05:20.400456 18796 master_service.cc:954] ReplaceTablet: received request to replace tablet 0450a4a763a64dbaaa59efbfbd924713 from {username='slave'} at 127.0.0.1:54236
I20251213 09:05:20.400660 18795 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_6b013204511a4b49bd1c108904225841" } new_table_name: "default.Table_d364163ef2394c35b078e79e43b16a89" modify_external_catalogs: true
I20251213 09:05:20.402326 18794 master_service.cc:954] ReplaceTablet: received request to replace tablet 8a9c4e8b224d440dbab9d693bbba9e37 from {username='slave'} at 127.0.0.1:54236
I20251213 09:05:20.402385 18792 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_731dc67a6a2b407180abef538691c40c" } new_table_name: "default.Table_77ba98ea391f495daa07e314094f52c2" modify_external_catalogs: true
I20251213 09:05:20.402796 18793 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_9dc2b6abe24f4a86ade24c79c38fa2e3" } modify_external_catalogs: true
I20251213 09:05:20.402832 18791 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_fd1d1908e83b4925a03e655168a92b9e" } modify_external_catalogs: true
I20251213 09:05:20.402902 18793 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_9dc2b6abe24f4a86ade24c79c38fa2e3" } modify_external_catalogs: true
I20251213 09:05:20.402948 18791 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_fd1d1908e83b4925a03e655168a92b9e" } modify_external_catalogs: true
I20251213 09:05:20.403268 18790 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54236:
name: "default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:20.405947 18667 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Refusing update from remote peer 8fe04e8d31ac4cd9bca8f96335ff1982: Log matching property violated. Preceding OpId in replica: term: 6 index: 260. Preceding OpId from leader: term: 7 index: 262. (index mismatch)
I20251213 09:05:20.406584 18866 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 261, Last known committed idx: 260, Time since last communication: 0.000s
W20251213 09:05:20.407167 18786 consensus_peers.cc:597] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 -> Peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Couldn't send request to peer d7f61ccb4ffd4066babfa94938e28b87. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20251213 09:05:20.407189 18853 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 6 out of 12 received events: NotificationEvent(eventId=77, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_82ff078f92894308a9243b01684306d0, message={"server":"","servicePrincipal":"","db":"default","table":"table_82ff078f92894308a9243b01684306d0","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_82ff078f92894308a9243b01684306d0\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_82ff078f92894308a9243b01684306d0\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_82ff078f92894308a9243b01684306d0\",\"transient_lastDdlTime\":\"1765616707\",\"kudu.table_id\":\"9e2a6770e19d4fde8081928cfa9612bd\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1765616707, eventType=CREATE_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_77ba98ea391f495daa07e314094f52c2, message={"server":"","servicePrincipal":"","db":"default","table":"table_731dc67a6a2b407180abef538691c40c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_731dc67a6a2b407180abef538691c40c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_731dc67a6a2b407180abef538691c40c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_731dc67a6a2b407180abef538691c40c\",\"transient_lastDdlTime\":\"1765616703\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_77ba98ea391f495daa07e314094f52c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_77ba98ea391f495daa07e314094f52c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_77ba98ea391f495daa07e314094f52c2\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"transient_lastDdlTime\":\"1765616703\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_cfb419171a574069b4e41856a31a16f7, message={"server":"","servicePrincipal":"","db":"default","table":"table_cfb419171a574069b4e41856a31a16f7","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_cfb419171a574069b4e41856a31a16f7\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_cfb419171a574069b4e41856a31a16f7\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_cfb419171a574069b4e41856a31a16f7\",\"kudu.table_id\":\"75537d22d2274862a5106e7a3cdf7992\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_08f61de8c46c467ba64e2ccbc392e100, message={"server":"","servicePrincipal":"","db":"default","table":"table_a90e27bac3a946e5bdd85f229deeb4be","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_a90e27bac3a946e5bdd85f229deeb4be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a90e27bac3a946e5bdd85f229deeb4be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a90e27bac3a946e5bdd85f229deeb4be\",\"transient_lastDdlTime\":\"1765616701\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_08f61de8c46c467ba64e2ccbc392e100\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_08f61de8c46c467ba64e2ccbc392e100\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_08f61de8c46c467ba64e2ccbc392e100\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"transient_lastDdlTime\":\"1765616701\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20251213 09:05:20.407171 18794 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_430d04b174a84f139dae2021743273d2" } modify_external_catalogs: true
I20251213 09:05:20.407905 18794 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_430d04b174a84f139dae2021743273d2" } modify_external_catalogs: true
@ 0x7fed613dadcd google::LogMessage::Fail() at ??:0
I20251213 09:05:20.411484 18870 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fe04e8d31ac4cd9bca8f96335ff1982. Latest consensus state: current_term: 7 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:20.411631 18870 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
@ 0x7fed613deb93 google::LogMessage::SendToLog() at ??:0
I20251213 09:05:20.414182 18840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:20.414347 18840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:20.414489 18869 mvcc.cc:204] Tried to move back new op lower bound from 7231966086783864832 to 7231966086320824320. Current Snapshot: MvccSnapshot[applied={T|T < 7231966086774792192}]
@ 0x7fed613da7cc google::LogMessage::Flush() at ??:0
I20251213 09:05:20.414831 18871 mvcc.cc:204] Tried to move back new op lower bound from 7231966086783864832 to 7231966086320824320. Current Snapshot: MvccSnapshot[applied={T|T < 7231966086774792192}]
I20251213 09:05:20.415306 18870 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:20.415452 18870 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:20.416464 18796 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 0450a4a763a64dbaaa59efbfbd924713
@ 0x7fed613daa11 google::LogMessage::~LogMessage() at ??:0
I20251213 09:05:20.416971 18797 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet fdb25c7f713e4b63b9ab99cf4daacc4d
I20251213 09:05:20.420240 18798 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet fb68b603c201419491b09993080789b5
I20251213 09:05:20.420637 18798 catalog_manager.cc:6724] ReplaceTablet: tablet fb68b603c201419491b09993080789b5 deleted and replaced by tablet 2a1ac8e79b9f457eac1214d52872f8b7
I20251213 09:05:20.420986 18798 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54236:
table { table_name: "default.Table_7bb124a916904ca5b08081aae9ac54a0" } new_table_name: "default.Table_8ad4a38d0dcc447fb137dd4e3701421e" modify_external_catalogs: true
I20251213 09:05:20.422117 18797 catalog_manager.cc:6724] ReplaceTablet: tablet fdb25c7f713e4b63b9ab99cf4daacc4d deleted and replaced by tablet d1af0e247ba24ebe9adab2cfda9a16aa
I20251213 09:05:20.422652 18797 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54236:
name: "default.Table_a19aae3ffc1441ad9d2a8082df491a94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:20.422894 18796 catalog_manager.cc:6724] ReplaceTablet: tablet 0450a4a763a64dbaaa59efbfbd924713 deleted and replaced by tablet c46becb97a3f4c8398752f647efdc190
I20251213 09:05:20.423141 18796 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54236:
name: "default.Table_a211b679083e4e4294bf4c97874b2d60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:20.423156 18799 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 8fe04e8d31ac4cd9bca8f96335ff1982: Sending DeleteTablet for 3 replicas of tablet 4a86f3d6176a4a4681c0fb31649e0eab
I20251213 09:05:20.424331 18799 catalog_manager.cc:6724] ReplaceTablet: tablet 4a86f3d6176a4a4681c0fb31649e0eab deleted and replaced by tablet 7e1aeb5749684d268d61d9601c2f8efd
I20251213 09:05:20.424538 18799 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54236:
name: "default.Table_cfb419171a574069b4e41856a31a16f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7fed6654e279 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20251213 09:05:20.428179 16935 tablet_service.cc:1552] Processing DeleteTablet for tablet 0450a4a763a64dbaaa59efbfbd924713 with delete_type TABLET_DATA_DELETED (replaced by tablet c46becb97a3f4c8398752f647efdc190) from {username='slave'} at 127.0.0.1:56574
I20251213 09:05:20.428205 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet fdb25c7f713e4b63b9ab99cf4daacc4d with delete_type TABLET_DATA_DELETED (replaced by tablet d1af0e247ba24ebe9adab2cfda9a16aa) from {username='slave'} at 127.0.0.1:56574
I20251213 09:05:20.428369 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a86f3d6176a4a4681c0fb31649e0eab with delete_type TABLET_DATA_DELETED (replaced by tablet 7e1aeb5749684d268d61d9601c2f8efd) from {username='slave'} at 127.0.0.1:56574
I20251213 09:05:20.428663 18890 tablet_replica.cc:333] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:20.428660 16932 tablet_service.cc:1552] Processing DeleteTablet for tablet fb68b603c201419491b09993080789b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1ac8e79b9f457eac1214d52872f8b7) from {username='slave'} at 127.0.0.1:56574
I20251213 09:05:20.428839 18890 raft_consensus.cc:2243] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:20.428970 18890 raft_consensus.cc:2272] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.429384 18890 ts_tablet_manager.cc:1916] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fed6654d190 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20251213 09:05:20.432044 18890 ts_tablet_manager.cc:1929] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:20.432116 18890 log.cc:1199] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/0450a4a763a64dbaaa59efbfbd924713
I20251213 09:05:20.432402 18890 ts_tablet_manager.cc:1950] T 0450a4a763a64dbaaa59efbfbd924713 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:20.432976 16932 tablet_service.cc:1505] Processing CreateTablet for tablet c46becb97a3f4c8398752f647efdc190 (DEFAULT_TABLE table=default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.433298 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46becb97a3f4c8398752f647efdc190. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.433535 18785 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]) successfully deleted
I20251213 09:05:20.433838 18890 tablet_replica.cc:333] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:20.433967 18890 raft_consensus.cc:2243] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:20.434149 18890 raft_consensus.cc:2272] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7fed6654c8f3 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20251213 09:05:20.434517 18890 ts_tablet_manager.cc:1916] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:20.435873 17066 tablet_service.cc:1552] Processing DeleteTablet for tablet fdb25c7f713e4b63b9ab99cf4daacc4d with delete_type TABLET_DATA_DELETED (replaced by tablet d1af0e247ba24ebe9adab2cfda9a16aa) from {username='slave'} at 127.0.0.1:58976
I20251213 09:05:20.436173 17071 tablet_service.cc:1552] Processing DeleteTablet for tablet 0450a4a763a64dbaaa59efbfbd924713 with delete_type TABLET_DATA_DELETED (replaced by tablet c46becb97a3f4c8398752f647efdc190) from {username='slave'} at 127.0.0.1:58976
I20251213 09:05:20.436307 17069 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a86f3d6176a4a4681c0fb31649e0eab with delete_type TABLET_DATA_DELETED (replaced by tablet 7e1aeb5749684d268d61d9601c2f8efd) from {username='slave'} at 127.0.0.1:58976
I20251213 09:05:20.436328 17068 tablet_service.cc:1505] Processing CreateTablet for tablet c46becb97a3f4c8398752f647efdc190 (DEFAULT_TABLE table=default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.436376 16935 tablet_service.cc:1505] Processing CreateTablet for tablet d1af0e247ba24ebe9adab2cfda9a16aa (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.436524 17067 tablet_service.cc:1552] Processing DeleteTablet for tablet fb68b603c201419491b09993080789b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1ac8e79b9f457eac1214d52872f8b7) from {username='slave'} at 127.0.0.1:58976
I20251213 09:05:20.436564 17066 tablet_service.cc:1505] Processing CreateTablet for tablet d1af0e247ba24ebe9adab2cfda9a16aa (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.436640 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46becb97a3f4c8398752f647efdc190. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.436841 17066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1af0e247ba24ebe9adab2cfda9a16aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.436976 16935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1af0e247ba24ebe9adab2cfda9a16aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.439441 16799 tablet_service.cc:1552] Processing DeleteTablet for tablet fdb25c7f713e4b63b9ab99cf4daacc4d with delete_type TABLET_DATA_DELETED (replaced by tablet d1af0e247ba24ebe9adab2cfda9a16aa) from {username='slave'} at 127.0.0.1:33162
I20251213 09:05:20.439693 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet 0450a4a763a64dbaaa59efbfbd924713 with delete_type TABLET_DATA_DELETED (replaced by tablet c46becb97a3f4c8398752f647efdc190) from {username='slave'} at 127.0.0.1:33162
I20251213 09:05:20.439851 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet fb68b603c201419491b09993080789b5 with delete_type TABLET_DATA_DELETED (replaced by tablet 2a1ac8e79b9f457eac1214d52872f8b7) from {username='slave'} at 127.0.0.1:33162
I20251213 09:05:20.439919 16798 tablet_service.cc:1505] Processing CreateTablet for tablet d1af0e247ba24ebe9adab2cfda9a16aa (DEFAULT_TABLE table=default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.440128 16796 tablet_service.cc:1505] Processing CreateTablet for tablet c46becb97a3f4c8398752f647efdc190 (DEFAULT_TABLE table=default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.440213 16798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1af0e247ba24ebe9adab2cfda9a16aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.440233 18890 ts_tablet_manager.cc:1929] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:20.440294 18890 log.cc:1199] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/fdb25c7f713e4b63b9ab99cf4daacc4d
I20251213 09:05:20.440397 16796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c46becb97a3f4c8398752f647efdc190. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.440573 18890 ts_tablet_manager.cc:1950] T fdb25c7f713e4b63b9ab99cf4daacc4d P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:20.441488 18785 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet fdb25c7f713e4b63b9ab99cf4daacc4d (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]) successfully deleted
I20251213 09:05:20.441717 18890 tablet_replica.cc:333] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:20.441843 18890 raft_consensus.cc:2243] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:20.441947 18890 raft_consensus.cc:2272] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.442310 18890 ts_tablet_manager.cc:1916] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fed66551ffa _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20251213 09:05:20.439715 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 4a86f3d6176a4a4681c0fb31649e0eab with delete_type TABLET_DATA_DELETED (replaced by tablet 7e1aeb5749684d268d61d9601c2f8efd) from {username='slave'} at 127.0.0.1:33162
I20251213 09:05:20.443495 18892 tablet_replica.cc:333] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:20.443789 18892 raft_consensus.cc:2243] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:20.443897 18892 raft_consensus.cc:2272] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.443917 18895 tablet_bootstrap.cc:492] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:20.444273 18892 ts_tablet_manager.cc:1916] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:20.444474 18890 ts_tablet_manager.cc:1929] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:20.444547 18890 log.cc:1199] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/4a86f3d6176a4a4681c0fb31649e0eab
I20251213 09:05:20.444792 18890 ts_tablet_manager.cc:1950] T 4a86f3d6176a4a4681c0fb31649e0eab P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:20.445024 18895 tablet_bootstrap.cc:654] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.445444 18785 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 4a86f3d6176a4a4681c0fb31649e0eab (table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]) successfully deleted
I20251213 09:05:20.445655 18890 tablet_replica.cc:333] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:20.445667 18894 tablet_replica.cc:333] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:20.445782 18890 raft_consensus.cc:2243] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:20.445787 18894 raft_consensus.cc:2243] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:20.445883 18890 raft_consensus.cc:2272] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.445942 18894 raft_consensus.cc:2272] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.446311 18894 ts_tablet_manager.cc:1916] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x5587498d1a0a std::function<>::operator()() at ??:0
I20251213 09:05:20.448508 18891 tablet_bootstrap.cc:492] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:20.448559 18894 ts_tablet_manager.cc:1929] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:20.448619 18894 log.cc:1199] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/fdb25c7f713e4b63b9ab99cf4daacc4d
I20251213 09:05:20.448895 18894 ts_tablet_manager.cc:1950] T fdb25c7f713e4b63b9ab99cf4daacc4d P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:20.449582 18783 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet fdb25c7f713e4b63b9ab99cf4daacc4d (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]) successfully deleted
@ 0x7fed628347dc kudu::Thread::SuperviseThread() at ??:0
I20251213 09:05:20.450506 18891 tablet_bootstrap.cc:654] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.449451 18894 tablet_replica.cc:333] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:20.450661 18894 raft_consensus.cc:2243] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:20.450860 18894 raft_consensus.cc:2272] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.451292 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 2a1ac8e79b9f457eac1214d52872f8b7 (DEFAULT_TABLE table=default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.451440 18894 ts_tablet_manager.cc:1916] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:20.451521 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1ac8e79b9f457eac1214d52872f8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.451640 17068 tablet_service.cc:1505] Processing CreateTablet for tablet 2a1ac8e79b9f457eac1214d52872f8b7 (DEFAULT_TABLE table=default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.451875 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1ac8e79b9f457eac1214d52872f8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.452445 18890 ts_tablet_manager.cc:1916] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:20.453619 18894 ts_tablet_manager.cc:1929] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:20.453696 18894 log.cc:1199] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/0450a4a763a64dbaaa59efbfbd924713
I20251213 09:05:20.453819 16935 tablet_service.cc:1505] Processing CreateTablet for tablet 2a1ac8e79b9f457eac1214d52872f8b7 (DEFAULT_TABLE table=default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.454058 16935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a1ac8e79b9f457eac1214d52872f8b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.454196 17068 tablet_service.cc:1505] Processing CreateTablet for tablet 7e1aeb5749684d268d61d9601c2f8efd (DEFAULT_TABLE table=default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.454452 17068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1aeb5749684d268d61d9601c2f8efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.454450 18895 tablet_bootstrap.cc:492] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:20.454552 18895 ts_tablet_manager.cc:1403] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251213 09:05:20.454703 18890 ts_tablet_manager.cc:1929] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251213 09:05:20.454762 18890 log.cc:1199] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/fb68b603c201419491b09993080789b5
I20251213 09:05:20.454989 18890 ts_tablet_manager.cc:1950] T fb68b603c201419491b09993080789b5 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:20.455121 18895 raft_consensus.cc:359] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.455257 18895 raft_consensus.cc:385] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.455268 18894 ts_tablet_manager.cc:1950] T 0450a4a763a64dbaaa59efbfbd924713 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:20.455323 18895 raft_consensus.cc:740] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.455452 18895 consensus_queue.cc:260] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.456077 18895 ts_tablet_manager.cc:1434] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251213 09:05:20.456640 16932 tablet_service.cc:1505] Processing CreateTablet for tablet 7e1aeb5749684d268d61d9601c2f8efd (DEFAULT_TABLE table=default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.456885 16932 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1aeb5749684d268d61d9601c2f8efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.456910 18895 tablet_bootstrap.cc:492] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:20.457067 18892 ts_tablet_manager.cc:1929] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:20.457134 18892 log.cc:1199] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/fdb25c7f713e4b63b9ab99cf4daacc4d
I20251213 09:05:20.457427 18892 ts_tablet_manager.cc:1950] T fdb25c7f713e4b63b9ab99cf4daacc4d P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:20.457880 18895 tablet_bootstrap.cc:654] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
@ 0x7fed630cd6db start_thread at ??:0
I20251213 09:05:20.458587 18894 tablet_replica.cc:333] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:20.458705 18894 raft_consensus.cc:2243] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:20.459086 18894 raft_consensus.cc:2272] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.459066 18783 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 0450a4a763a64dbaaa59efbfbd924713 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]) successfully deleted
I20251213 09:05:20.459452 18894 ts_tablet_manager.cc:1916] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fed6059171f clone at ??:0
I20251213 09:05:20.460608 18893 tablet_bootstrap.cc:492] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:20.461177 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 7e1aeb5749684d268d61d9601c2f8efd (DEFAULT_TABLE table=default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:20.461393 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e1aeb5749684d268d61d9601c2f8efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:20.461758 18894 ts_tablet_manager.cc:1929] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251213 09:05:20.461838 18894 log.cc:1199] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/fb68b603c201419491b09993080789b5
I20251213 09:05:20.462087 18894 ts_tablet_manager.cc:1950] T fb68b603c201419491b09993080789b5 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:20.462332 18892 tablet_replica.cc:333] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:20.462446 18892 raft_consensus.cc:2243] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:20.462548 18892 raft_consensus.cc:2272] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.462746 18894 tablet_replica.cc:333] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:20.462852 18894 raft_consensus.cc:2243] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:20.462939 18894 raft_consensus.cc:2272] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.462942 18892 ts_tablet_manager.cc:1916] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:20.463380 18894 ts_tablet_manager.cc:1916] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:20.464121 18895 tablet_bootstrap.cc:492] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:20.464133 18893 tablet_bootstrap.cc:654] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.464196 18895 ts_tablet_manager.cc:1403] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251213 09:05:20.464740 18895 raft_consensus.cc:359] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.464856 18895 raft_consensus.cc:385] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.464893 18895 raft_consensus.cc:740] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.465042 18895 consensus_queue.cc:260] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.465130 18891 tablet_bootstrap.cc:492] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:20.465209 18891 ts_tablet_manager.cc:1403] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251213 09:05:20.465341 18895 ts_tablet_manager.cc:1434] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:20.465525 18895 tablet_bootstrap.cc:492] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:20.465700 18891 raft_consensus.cc:359] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.465795 18891 raft_consensus.cc:385] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.465824 18891 raft_consensus.cc:740] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.465932 18891 consensus_queue.cc:260] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.466192 18891 ts_tablet_manager.cc:1434] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:20.466398 18891 tablet_bootstrap.cc:492] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:20.466755 18895 tablet_bootstrap.cc:654] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.467425 18892 ts_tablet_manager.cc:1929] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:20.467484 18891 tablet_bootstrap.cc:654] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.467492 18892 log.cc:1199] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/0450a4a763a64dbaaa59efbfbd924713
I20251213 09:05:20.467756 18892 ts_tablet_manager.cc:1950] T 0450a4a763a64dbaaa59efbfbd924713 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:20.469468 18894 ts_tablet_manager.cc:1929] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:20.469537 18894 log.cc:1199] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/4a86f3d6176a4a4681c0fb31649e0eab
I20251213 09:05:20.469964 18894 ts_tablet_manager.cc:1950] T 4a86f3d6176a4a4681c0fb31649e0eab P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:20.470082 18892 tablet_replica.cc:333] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:20.470211 18892 raft_consensus.cc:2243] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:20.470397 18892 raft_consensus.cc:2272] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.470733 18892 ts_tablet_manager.cc:1916] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:20.471913 18891 tablet_bootstrap.cc:492] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:20.471985 18891 ts_tablet_manager.cc:1403] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:20.472438 18891 raft_consensus.cc:359] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.472533 18891 raft_consensus.cc:385] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.472563 18891 raft_consensus.cc:740] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.472693 18891 consensus_queue.cc:260] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.473171 18892 ts_tablet_manager.cc:1929] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:20.473263 18892 log.cc:1199] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/4a86f3d6176a4a4681c0fb31649e0eab
I20251213 09:05:20.473522 18892 ts_tablet_manager.cc:1950] T 4a86f3d6176a4a4681c0fb31649e0eab P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:20.474314 18892 tablet_replica.cc:333] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:20.474507 18892 raft_consensus.cc:2243] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:20.474628 18892 raft_consensus.cc:2272] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:20.475697 18891 ts_tablet_manager.cc:1434] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:05:20.476058 18892 ts_tablet_manager.cc:1916] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:20.478396 18892 ts_tablet_manager.cc:1929] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251213 09:05:20.478467 18892 log.cc:1199] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/fb68b603c201419491b09993080789b5
I20251213 09:05:20.478669 18891 tablet_bootstrap.cc:492] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:20.478734 18892 ts_tablet_manager.cc:1950] T fb68b603c201419491b09993080789b5 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:20.480085 18891 tablet_bootstrap.cc:654] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.482264 18893 tablet_bootstrap.cc:492] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:20.482335 18893 ts_tablet_manager.cc:1403] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20251213 09:05:20.482789 18893 raft_consensus.cc:359] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.482882 18893 raft_consensus.cc:385] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.482908 18893 raft_consensus.cc:740] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.483013 18893 consensus_queue.cc:260] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.483286 18893 ts_tablet_manager.cc:1434] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:20.483472 18893 tablet_bootstrap.cc:492] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:20.484408 18893 tablet_bootstrap.cc:654] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.484831 18891 tablet_bootstrap.cc:492] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:20.484920 18891 ts_tablet_manager.cc:1403] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:20.485404 18891 raft_consensus.cc:359] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.485525 18891 raft_consensus.cc:385] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.485560 18891 raft_consensus.cc:740] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.485728 18891 consensus_queue.cc:260] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.486753 18895 tablet_bootstrap.cc:492] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:20.486841 18895 ts_tablet_manager.cc:1403] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20251213 09:05:20.487334 18895 raft_consensus.cc:359] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.487442 18895 raft_consensus.cc:385] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.487473 18895 raft_consensus.cc:740] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.487581 18895 consensus_queue.cc:260] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.487876 18895 ts_tablet_manager.cc:1434] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:20.488058 18895 tablet_bootstrap.cc:492] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:20.489027 18895 tablet_bootstrap.cc:654] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.490584 18891 ts_tablet_manager.cc:1434] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251213 09:05:20.493716 18891 tablet_bootstrap.cc:492] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:20.494475 18895 tablet_bootstrap.cc:492] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:20.494547 18895 ts_tablet_manager.cc:1403] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:20.494848 18891 tablet_bootstrap.cc:654] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.494959 18895 raft_consensus.cc:359] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.495061 18895 raft_consensus.cc:385] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.495088 18895 raft_consensus.cc:740] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.495466 18895 consensus_queue.cc:260] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.496484 18893 tablet_bootstrap.cc:492] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:20.496543 18895 ts_tablet_manager.cc:1434] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:20.496572 18893 ts_tablet_manager.cc:1403] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251213 09:05:20.497072 18893 raft_consensus.cc:359] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.497169 18893 raft_consensus.cc:385] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.497197 18893 raft_consensus.cc:740] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.497332 18893 consensus_queue.cc:260] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.498245 18891 tablet_bootstrap.cc:492] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:20.498343 18891 ts_tablet_manager.cc:1403] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20251213 09:05:20.498487 18893 ts_tablet_manager.cc:1434] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251213 09:05:20.498670 18893 tablet_bootstrap.cc:492] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:20.499754 18893 tablet_bootstrap.cc:654] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.498973 18891 raft_consensus.cc:359] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.500735 18891 raft_consensus.cc:385] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.500784 18891 raft_consensus.cc:740] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.500918 18891 consensus_queue.cc:260] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.501226 18891 ts_tablet_manager.cc:1434] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251213 09:05:20.503300 18893 tablet_bootstrap.cc:492] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:20.503424 18893 ts_tablet_manager.cc:1403] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251213 09:05:20.503921 18893 raft_consensus.cc:359] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.504026 18893 raft_consensus.cc:385] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.504061 18893 raft_consensus.cc:740] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.504166 18893 consensus_queue.cc:260] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.504472 18893 ts_tablet_manager.cc:1434] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:20.504642 18893 tablet_bootstrap.cc:492] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:20.505733 18893 tablet_bootstrap.cc:654] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:20.506825 18893 tablet_bootstrap.cc:492] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:20.506906 18893 ts_tablet_manager.cc:1403] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251213 09:05:20.507447 18893 raft_consensus.cc:359] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.507551 18893 raft_consensus.cc:385] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:20.507587 18893 raft_consensus.cc:740] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:20.507709 18893 consensus_queue.cc:260] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.507977 18893 ts_tablet_manager.cc:1434] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:20.600720 18864 raft_consensus.cc:493] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:20.600883 18864 raft_consensus.cc:515] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.601411 18864 leader_election.cc:290] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:20.601905 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1aeb5749684d268d61d9601c2f8efd" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:20.601948 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1aeb5749684d268d61d9601c2f8efd" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:20.602056 16819 raft_consensus.cc:2468] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:20.602149 16956 raft_consensus.cc:2468] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:20.602417 17026 leader_election.cc:304] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:20.602583 18864 raft_consensus.cc:2804] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:20.602648 18864 raft_consensus.cc:493] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:20.602684 18864 raft_consensus.cc:3060] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.603649 18864 raft_consensus.cc:515] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.603961 18864 leader_election.cc:290] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:20.604235 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1aeb5749684d268d61d9601c2f8efd" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:20.604352 16819 raft_consensus.cc:3060] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.605118 16819 raft_consensus.cc:2468] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:20.605345 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e1aeb5749684d268d61d9601c2f8efd" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:20.605404 17026 leader_election.cc:304] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:20.605482 16957 raft_consensus.cc:3060] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.605580 18864 raft_consensus.cc:2804] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:20.605669 18864 raft_consensus.cc:697] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:20.605810 18864 consensus_queue.cc:237] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.606488 16957 raft_consensus.cc:2468] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:20.607980 18750 raft_consensus.cc:493] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:20.608069 18750 raft_consensus.cc:515] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.608559 18750 leader_election.cc:290] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:20.609700 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a1ac8e79b9f457eac1214d52872f8b7" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:20.609807 16957 raft_consensus.cc:2468] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:20.610067 16756 leader_election.cc:304] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:20.610137 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a1ac8e79b9f457eac1214d52872f8b7" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:20.610255 17093 raft_consensus.cc:2468] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 0.
I20251213 09:05:20.610534 18750 raft_consensus.cc:2804] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:20.610592 18750 raft_consensus.cc:493] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:20.610631 18750 raft_consensus.cc:3060] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.611454 18750 raft_consensus.cc:515] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.611760 18750 leader_election.cc:290] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Requested vote from peers ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:20.612071 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a1ac8e79b9f457eac1214d52872f8b7" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:20.612071 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a1ac8e79b9f457eac1214d52872f8b7" candidate_uuid: "42c0ccabbfc1460685086e58e05cd152" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:20.612175 17093 raft_consensus.cc:3060] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.612206 16957 raft_consensus.cc:3060] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.613070 17093 raft_consensus.cc:2468] T 2a1ac8e79b9f457eac1214d52872f8b7 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:20.613070 16957 raft_consensus.cc:2468] T 2a1ac8e79b9f457eac1214d52872f8b7 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42c0ccabbfc1460685086e58e05cd152 in term 1.
I20251213 09:05:20.613370 16757 leader_election.cc:304] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:20.613516 18750 raft_consensus.cc:2804] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:20.613710 18750 raft_consensus.cc:697] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Becoming Leader. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Running, Role: LEADER
I20251213 09:05:20.613850 18750 consensus_queue.cc:237] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
W20251213 09:05:20.649200 16756 connection.cc:537] server connection from 127.0.0.1:33162 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:20.649194 17027 connection.cc:537] server connection from 127.0.0.1:58976 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:20.649240 16894 connection.cc:537] server connection from 127.0.0.1:56574 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:20.649544 17146 connection.cc:537] client connection to 127.15.213.62:42117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:20.649983 17146 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.62:42117)
W20251213 09:05:20.650038 17026 connection.cc:537] client connection to 127.15.213.62:42117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:20.650295 17146 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:20.650441 17146 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:20.650542 17146 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.213.62:42117)
W20251213 09:05:20.650650 16891 connection.cc:537] client connection to 127.15.213.62:42117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251213 09:05:20.671247 18884 raft_consensus.cc:493] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:20.671383 18884 raft_consensus.cc:515] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.671881 18884 leader_election.cc:290] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:20.672173 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1af0e247ba24ebe9adab2cfda9a16aa" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:20.672264 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1af0e247ba24ebe9adab2cfda9a16aa" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:20.672318 16819 raft_consensus.cc:2468] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:20.672402 17093 raft_consensus.cc:2468] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:20.672634 16891 leader_election.cc:304] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:20.672855 18884 raft_consensus.cc:2804] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:20.672924 18884 raft_consensus.cc:493] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:20.672973 18884 raft_consensus.cc:3060] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.673882 18884 raft_consensus.cc:515] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.674160 18884 leader_election.cc:290] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:20.674496 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1af0e247ba24ebe9adab2cfda9a16aa" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:20.674526 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d1af0e247ba24ebe9adab2cfda9a16aa" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:20.674618 16819 raft_consensus.cc:3060] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.674624 17093 raft_consensus.cc:3060] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.675421 16819 raft_consensus.cc:2468] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:20.675586 17093 raft_consensus.cc:2468] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:20.675765 16891 leader_election.cc:304] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:20.675942 18884 raft_consensus.cc:2804] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:20.676038 18884 raft_consensus.cc:697] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:20.676173 18884 consensus_queue.cc:237] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.856230 18884 raft_consensus.cc:493] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:20.856372 18884 raft_consensus.cc:515] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.856791 18884 leader_election.cc:290] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:20.857225 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c46becb97a3f4c8398752f647efdc190" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:20.857225 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c46becb97a3f4c8398752f647efdc190" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:20.857378 17093 raft_consensus.cc:2468] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:20.857399 16819 raft_consensus.cc:2468] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:20.857700 16891 leader_election.cc:304] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:20.857870 18884 raft_consensus.cc:2804] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:20.857933 18884 raft_consensus.cc:493] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:20.857965 18884 raft_consensus.cc:3060] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.858839 18884 raft_consensus.cc:515] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.859161 18884 leader_election.cc:290] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:20.859529 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c46becb97a3f4c8398752f647efdc190" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:20.859529 17093 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c46becb97a3f4c8398752f647efdc190" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:20.859658 16819 raft_consensus.cc:3060] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.859695 17093 raft_consensus.cc:3060] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:20.860689 17093 raft_consensus.cc:2468] T c46becb97a3f4c8398752f647efdc190 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:20.860682 16819 raft_consensus.cc:2468] T c46becb97a3f4c8398752f647efdc190 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:20.861012 16891 leader_election.cc:304] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:20.861176 18884 raft_consensus.cc:2804] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:20.861266 18884 raft_consensus.cc:697] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:20.861474 18884 consensus_queue.cc:237] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:20.950739 18926 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:20.950867 18926 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:20.951347 18926 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:20.952486 18641 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:20.952564 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:20.952623 18638 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:20.952745 18926 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20251213 09:05:21.008715 18770 consensus_queue.cc:1048] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:21.012396 18609 consensus_queue.cc:1048] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:21.056490 18750 consensus_queue.cc:1048] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:21.058221 18750 consensus_queue.cc:1048] T 2a1ac8e79b9f457eac1214d52872f8b7 P 42c0ccabbfc1460685086e58e05cd152 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:21.111526 18884 consensus_queue.cc:1048] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:21.115860 18884 consensus_queue.cc:1048] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:21.290108 18884 consensus_queue.cc:1048] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:21.294937 18884 consensus_queue.cc:1048] T c46becb97a3f4c8398752f647efdc190 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:21.525192 18623 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:21.525311 18623 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:21.634636 18945 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:21.634757 18945 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:21.635210 18945 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:21.636211 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:21.636296 18641 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:21.636371 18641 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:21.636514 18945 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20251213 09:05:22.498368 18960 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:22.498549 18960 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:22.499029 18960 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:22.499634 18641 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20251213 09:05:22.500386 18641 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:22.500556 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:22.500654 18638 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:22.500792 18960 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20251213 09:05:23.137117 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.60:37605
--webserver_interface=127.15.213.60
--webserver_port=39639
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251213 09:05:23.248540 18973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:05:23.248785 18973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:05:23.248824 18973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:05:23.252149 18973 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:05:23.252218 18973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:05:23.252238 18973 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:05:23.252256 18973 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:05:23.256186 18973 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.60:37605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.15.213.60
--webserver_port=39639
--never_fsync=true
--heap_profile_path=/tmp/kudu.18973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:05:23.257257 18973 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:05:23.258386 18973 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:05:23.264129 18978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:23.264129 18979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:23.264294 18973 server_base.cc:1047] running on GCE node
W20251213 09:05:23.264129 18981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:23.265007 18973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:05:23.265971 18973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:05:23.267143 18973 hybrid_clock.cc:648] HybridClock initialized: now 1765616723267112 us; error 29 us; skew 500 ppm
I20251213 09:05:23.268983 18973 webserver.cc:492] Webserver started at http://127.15.213.60:39639/ using document root <none> and password file <none>
I20251213 09:05:23.269582 18973 fs_manager.cc:362] Metadata directory not provided
I20251213 09:05:23.269654 18973 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:05:23.273283 18973 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20251213 09:05:23.275358 18987 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20251213 09:05:23.276686 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 16: this message will repeat every 5th retry.
I20251213 09:05:23.276868 18973 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20251213 09:05:23.276995 18973 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
uuid: "d7f61ccb4ffd4066babfa94938e28b87"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:05:23.277525 18973 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:05:23.296437 18973 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:05:23.297232 18973 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:05:23.297406 18973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:05:23.305279 18973 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.60:37605
I20251213 09:05:23.305284 19044 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.60:37605 every 8 connection(s)
I20251213 09:05:23.306613 18973 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-2/data/info.pb
I20251213 09:05:23.311043 19046 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:05:23.312960 19046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Bootstrap starting.
I20251213 09:05:23.313504 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 18973
I20251213 09:05:23.333081 19046 log.cc:826] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Log is configured to *not* fsync() on all Append() calls
I20251213 09:05:23.450380 19046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Bootstrap replayed 1/1 log segments. Stats: ops{read=254 overwritten=0 applied=254 ignored=0} inserts{seen=161 ignored=0} mutations{seen=229 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251213 09:05:23.450809 19046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Bootstrap complete.
I20251213 09:05:23.453541 19046 raft_consensus.cc:359] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:23.453974 19046 raft_consensus.cc:740] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7f61ccb4ffd4066babfa94938e28b87, State: Initialized, Role: FOLLOWER
I20251213 09:05:23.454458 19046 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 254, Last appended: 5.254, Last appended by leader: 254, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:23.454911 19051 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:23.455017 19051 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:23.455588 19046 sys_catalog.cc:565] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:05:23.460163 18973 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:23.462333 18973 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:23.466125 19065 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:23.466194 19065 catalog_manager.cc:1562] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: loading cluster ID for follower catalog manager: success
I20251213 09:05:23.470263 19065 catalog_manager.cc:1584] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: acquiring CA information for follower catalog manager: success
I20251213 09:05:23.473519 19065 catalog_manager.cc:1612] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:05:23.781369 17139 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:05:23.783771 19002 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:52307; Asking this server to re-register.
I20251213 09:05:23.784313 17139 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:23.785763 19002 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:23.793147 17004 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:05:23.794703 19002 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:50545; Asking this server to re-register.
I20251213 09:05:23.795257 17004 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:23.796495 19002 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:23.802964 16868 heartbeater.cc:344] Connected to a master server at 127.15.213.60:37605
I20251213 09:05:23.804284 19002 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:51625; Asking this server to re-register.
I20251213 09:05:23.804701 16868 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:23.805678 19002 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:23.842100 19075 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:23.842213 19075 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:23.842566 19075 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:23.843777 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:23.846123 19019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" candidate_term: 8 candidate_status { last_received { term: 7 index: 267 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87" is_pre_election: true
I20251213 09:05:23.846422 19019 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ef4ffe02ab44248dc97cb1c5cceac1 in term 5.
I20251213 09:05:23.846884 18641 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982
I20251213 09:05:23.847065 19075 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20251213 09:05:23.847162 19075 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8fe04e8d31ac4cd9bca8f96335ff1982)
I20251213 09:05:23.847213 19075 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 7 FOLLOWER]: Advancing to term 8
I20251213 09:05:23.848156 19075 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:23.848471 19075 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 election: Requested vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:23.848851 19019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" candidate_term: 8 candidate_status { last_received { term: 7 index: 267 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87"
I20251213 09:05:23.848973 19019 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 5 FOLLOWER]: Advancing to term 8
W20251213 09:05:23.849472 18638 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:23.850924 19019 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ef4ffe02ab44248dc97cb1c5cceac1 in term 8.
I20251213 09:05:23.851272 18641 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982
I20251213 09:05:23.851488 19075 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 8 FOLLOWER]: Leader election won for term 8
I20251213 09:05:23.851709 19075 raft_consensus.cc:697] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 8 LEADER]: Becoming Leader. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Running, Role: LEADER
I20251213 09:05:23.851976 19075 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 267, Committed index: 267, Last appended: 7.267, Last appended by leader: 267, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:23.852914 19079 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ef4ffe02ab44248dc97cb1c5cceac1. Latest consensus state: current_term: 8 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:23.853029 19079 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:23.853374 19081 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:05:23.855871 19081 catalog_manager.cc:679] Loaded metadata for table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:23.856521 19081 catalog_manager.cc:679] Loaded metadata for table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]
I20251213 09:05:23.856747 19081 catalog_manager.cc:679] Loaded metadata for table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]
I20251213 09:05:23.856988 19081 catalog_manager.cc:679] Loaded metadata for table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]
I20251213 09:05:23.857213 19081 catalog_manager.cc:679] Loaded metadata for table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]
I20251213 09:05:23.857425 19081 catalog_manager.cc:679] Loaded metadata for table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]
I20251213 09:05:23.857779 19081 catalog_manager.cc:679] Loaded metadata for table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:23.858137 19081 catalog_manager.cc:679] Loaded metadata for table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]
I20251213 09:05:23.858464 19081 catalog_manager.cc:679] Loaded metadata for table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:23.858688 19081 catalog_manager.cc:679] Loaded metadata for table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]
I20251213 09:05:23.858922 19081 catalog_manager.cc:679] Loaded metadata for table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]
I20251213 09:05:23.859193 19081 catalog_manager.cc:679] Loaded metadata for table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:05:23.859488 19081 catalog_manager.cc:679] Loaded metadata for table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]
I20251213 09:05:23.859723 19081 catalog_manager.cc:679] Loaded metadata for table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:05:23.860097 19081 catalog_manager.cc:679] Loaded metadata for table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]
I20251213 09:05:23.860529 19081 catalog_manager.cc:679] Loaded metadata for table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:23.860772 19081 catalog_manager.cc:679] Loaded metadata for table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]
I20251213 09:05:23.860963 19081 catalog_manager.cc:679] Loaded metadata for table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]
I20251213 09:05:23.861281 19081 catalog_manager.cc:679] Loaded metadata for table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]
I20251213 09:05:23.861531 19081 catalog_manager.cc:679] Loaded metadata for table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]
I20251213 09:05:23.861693 19081 catalog_manager.cc:679] Loaded metadata for table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:23.861861 19081 catalog_manager.cc:679] Loaded metadata for table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]
I20251213 09:05:23.862022 19081 catalog_manager.cc:679] Loaded metadata for table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:23.862182 19081 catalog_manager.cc:679] Loaded metadata for table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:23.862341 19081 catalog_manager.cc:679] Loaded metadata for table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:23.862588 19081 catalog_manager.cc:679] Loaded metadata for table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]
I20251213 09:05:23.862751 19081 catalog_manager.cc:679] Loaded metadata for table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]
I20251213 09:05:23.862906 19081 catalog_manager.cc:679] Loaded metadata for table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]
I20251213 09:05:23.865412 19081 tablet_loader.cc:96] loaded metadata for tablet 12254c0d95144f8e8d958647924a5ee2 (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f])
I20251213 09:05:23.865604 19081 tablet_loader.cc:96] loaded metadata for tablet 1391d28e1e4046b4af9f0b06ae539c0d (table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d])
I20251213 09:05:23.865813 19081 tablet_loader.cc:96] loaded metadata for tablet 1ef26c19666f4a0194c172a7ca4a922f (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5])
I20251213 09:05:23.866098 19081 tablet_loader.cc:96] loaded metadata for tablet 2a1ac8e79b9f457eac1214d52872f8b7 (table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee])
I20251213 09:05:23.866304 19081 tablet_loader.cc:96] loaded metadata for tablet 33e5ff40d6b24f51956d050c23d41eb7 (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454])
I20251213 09:05:23.866436 19081 tablet_loader.cc:96] loaded metadata for tablet 362edc0369024cc6b1c4acce115c4f1f (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d])
I20251213 09:05:23.866880 19081 tablet_loader.cc:96] loaded metadata for tablet 4451b0205d96405ca64a9f027749b7af (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46])
I20251213 09:05:23.867245 19081 tablet_loader.cc:96] loaded metadata for tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb])
I20251213 09:05:23.867658 19081 tablet_loader.cc:96] loaded metadata for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a])
I20251213 09:05:23.868023 19081 tablet_loader.cc:96] loaded metadata for tablet 5e23c178da6f47c487ed085718b83ce6 (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e])
I20251213 09:05:23.868455 19081 tablet_loader.cc:96] loaded metadata for tablet 62236955121e49ec800c5e37a40c5b19 (table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644])
I20251213 09:05:23.868578 19081 tablet_loader.cc:96] loaded metadata for tablet 639c8c290eb6413e9b343b8c132d8152 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f])
I20251213 09:05:23.868707 19081 tablet_loader.cc:96] loaded metadata for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253])
I20251213 09:05:23.869062 19081 tablet_loader.cc:96] loaded metadata for tablet 79d28675183f4fb1ad9a573cab3bba32 (table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a])
I20251213 09:05:23.869266 19081 tablet_loader.cc:96] loaded metadata for tablet 7e1aeb5749684d268d61d9601c2f8efd (table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907])
I20251213 09:05:23.870147 19081 tablet_loader.cc:96] loaded metadata for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893])
I20251213 09:05:23.870824 19081 tablet_loader.cc:96] loaded metadata for tablet c034dfd35b7b471a8343b1f4e62c4757 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd])
I20251213 09:05:23.871004 19081 tablet_loader.cc:96] loaded metadata for tablet c15dfcf0143a480da7a2c0befd55e18d (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07])
I20251213 09:05:23.871207 19081 tablet_loader.cc:96] loaded metadata for tablet c46becb97a3f4c8398752f647efdc190 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d])
I20251213 09:05:23.871351 19081 tablet_loader.cc:96] loaded metadata for tablet c5adcb68c5b9438da10370479acbed52 (table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba])
I20251213 09:05:23.871567 19081 tablet_loader.cc:96] loaded metadata for tablet c75672e770be41aeb9fe180521d3f7af (table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad])
I20251213 09:05:23.871696 19081 tablet_loader.cc:96] loaded metadata for tablet c8276392af2740258e804f72f7529d16 (table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd])
I20251213 09:05:23.871820 19081 tablet_loader.cc:96] loaded metadata for tablet d1af0e247ba24ebe9adab2cfda9a16aa (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8])
I20251213 09:05:23.871941 19081 tablet_loader.cc:96] loaded metadata for tablet d49fcf75fc57485fa8ab3ee432aa3772 (table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa])
I20251213 09:05:23.872061 19081 tablet_loader.cc:96] loaded metadata for tablet d680eb65e2a9499897a362e09bc772b9 (table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d])
I20251213 09:05:23.872483 19081 tablet_loader.cc:96] loaded metadata for tablet e74f37bdb74e4102931e51914c24d217 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c])
I20251213 09:05:23.872786 19081 tablet_loader.cc:96] loaded metadata for tablet e8e967a592a442c28f19f8ab943a8528 (table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce])
I20251213 09:05:23.873165 19081 tablet_loader.cc:96] loaded metadata for tablet f394b4d388cd43a49ae4c3db293a893c (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1])
I20251213 09:05:23.873677 19081 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:05:23.875387 19081 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:23.875468 19081 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:05:23.876855 19081 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:05:23.878247 19081 catalog_manager.cc:6038] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Loaded TSK: 0
I20251213 09:05:23.879101 19081 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:05:23.880282 19081 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:05:23.881374 19081 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 76
I20251213 09:05:23.935920 18655 master_service.cc:954] ReplaceTablet: received request to replace tablet 639c8c290eb6413e9b343b8c132d8152 from {username='slave'} at 127.0.0.1:36662
I20251213 09:05:23.936604 18653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36662:
table { table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" } modify_external_catalogs: true
I20251213 09:05:23.936786 18653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36662:
table { table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" } modify_external_catalogs: true
I20251213 09:05:23.936821 18648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36662:
name: "default.Table_af6c4a1282d24b2283671da41b9b0400"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:23.936604 18651 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36662:
table { table_name: "default.Table_a90e27bac3a946e5bdd85f229deeb4be" } new_table_name: "default.Table_08f61de8c46c467ba64e2ccbc392e100" modify_external_catalogs: true
I20251213 09:05:23.937217 18657 master_service.cc:954] ReplaceTablet: received request to replace tablet 7e1aeb5749684d268d61d9601c2f8efd from {username='slave'} at 127.0.0.1:36662
I20251213 09:05:23.937397 18649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36662:
name: "default.Table_e3c10aee5e2044a5b15b49197906acde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:23.937595 18654 master_service.cc:954] ReplaceTablet: received request to replace tablet c15dfcf0143a480da7a2c0befd55e18d from {username='slave'} at 127.0.0.1:36662
I20251213 09:05:23.937903 18656 master_service.cc:954] ReplaceTablet: received request to replace tablet d1af0e247ba24ebe9adab2cfda9a16aa from {username='slave'} at 127.0.0.1:36662
I20251213 09:05:23.937960 18652 master_service.cc:954] ReplaceTablet: received request to replace tablet f394b4d388cd43a49ae4c3db293a893c from {username='slave'} at 127.0.0.1:36662
I20251213 09:05:23.937903 18650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36662:
table { table_name: "default.Table_20afd9b96f7e403d9c185f93b6567f19" } modify_external_catalogs: true
I20251213 09:05:23.938637 18650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36662:
table { table_name: "default.Table_20afd9b96f7e403d9c185f93b6567f19" } modify_external_catalogs: true
I20251213 09:05:23.939893 19019 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Refusing update from remote peer f0ef4ffe02ab44248dc97cb1c5cceac1: Log matching property violated. Preceding OpId in replica: term: 5 index: 254. Preceding OpId from leader: term: 8 index: 269. (index mismatch)
I20251213 09:05:23.940454 19079 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 268, Last known committed idx: 254, Time since last communication: 0.000s
W20251213 09:05:23.940734 18638 consensus_peers.cc:597] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 -> Peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Couldn't send request to peer 8fe04e8d31ac4cd9bca8f96335ff1982. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
F20251213 09:05:23.942175 18714 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 6 out of 12 received events: NotificationEvent(eventId=77, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_82ff078f92894308a9243b01684306d0, message={"server":"","servicePrincipal":"","db":"default","table":"table_82ff078f92894308a9243b01684306d0","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_82ff078f92894308a9243b01684306d0\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_82ff078f92894308a9243b01684306d0\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_82ff078f92894308a9243b01684306d0\",\"transient_lastDdlTime\":\"1765616707\",\"kudu.table_id\":\"9e2a6770e19d4fde8081928cfa9612bd\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1765616707, eventType=CREATE_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_77ba98ea391f495daa07e314094f52c2, message={"server":"","servicePrincipal":"","db":"default","table":"table_731dc67a6a2b407180abef538691c40c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_731dc67a6a2b407180abef538691c40c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_731dc67a6a2b407180abef538691c40c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_731dc67a6a2b407180abef538691c40c\",\"transient_lastDdlTime\":\"1765616703\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_77ba98ea391f495daa07e314094f52c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_77ba98ea391f495daa07e314094f52c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_77ba98ea391f495daa07e314094f52c2\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"transient_lastDdlTime\":\"1765616703\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_cfb419171a574069b4e41856a31a16f7, message={"server":"","servicePrincipal":"","db":"default","table":"table_cfb419171a574069b4e41856a31a16f7","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_cfb419171a574069b4e41856a31a16f7\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_cfb419171a574069b4e41856a31a16f7\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_cfb419171a574069b4e41856a31a16f7\",\"kudu.table_id\":\"75537d22d2274862a5106e7a3cdf7992\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_08f61de8c46c467ba64e2ccbc392e100, message={"server":"","servicePrincipal":"","db":"default","table":"table_a90e27bac3a946e5bdd85f229deeb4be","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_a90e27bac3a946e5bdd85f229deeb4be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a90e27bac3a946e5bdd85f229deeb4be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a90e27bac3a946e5bdd85f229deeb4be\",\"transient_lastDdlTime\":\"1765616701\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_08f61de8c46c467ba64e2ccbc392e100\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_08f61de8c46c467ba64e2ccbc392e100\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_08f61de8c46c467ba64e2ccbc392e100\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"transient_lastDdlTime\":\"1765616701\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
@ 0x7f606ca41dcd google::LogMessage::Fail() at ??:0
@ 0x7f606ca45b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f606ca417cc google::LogMessage::Flush() at ??:0
I20251213 09:05:23.951177 19051 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ef4ffe02ab44248dc97cb1c5cceac1. Latest consensus state: current_term: 8 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:23.951288 19051 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:23.951375 19051 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:23.951434 19051 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:23.952418 19089 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:23.952716 19089 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:23.953337 19084 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:23.953434 19084 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:23.954062 18657 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 7e1aeb5749684d268d61d9601c2f8efd
I20251213 09:05:23.954497 19089 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:23.954583 19089 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:23.954846 18655 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet 639c8c290eb6413e9b343b8c132d8152
@ 0x7f606ca41a11 google::LogMessage::~LogMessage() at ??:0
I20251213 09:05:23.956019 18657 catalog_manager.cc:6724] ReplaceTablet: tablet 7e1aeb5749684d268d61d9601c2f8efd deleted and replaced by tablet 274e6dd40a1f46c3a3a1dcb715c66d09
I20251213 09:05:23.956579 18655 catalog_manager.cc:6724] ReplaceTablet: tablet 639c8c290eb6413e9b343b8c132d8152 deleted and replaced by tablet 651bb66490104f53b901a19fde816bf1
I20251213 09:05:23.956508 18657 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36662:
name: "default.Table_82ff078f92894308a9243b01684306d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:23.956780 18655 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36662:
table { table_name: "default.Table_432a26ea35484c14b07c89f682c923e3" } new_table_name: "default.Table_404d066ee1b14871b9972b685635fe46" modify_external_catalogs: true
I20251213 09:05:23.957376 18652 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet f394b4d388cd43a49ae4c3db293a893c
I20251213 09:05:23.957513 18654 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet c15dfcf0143a480da7a2c0befd55e18d
I20251213 09:05:23.957713 18652 catalog_manager.cc:6724] ReplaceTablet: tablet f394b4d388cd43a49ae4c3db293a893c deleted and replaced by tablet ee4217a512f84af49e180d28c7b4cb42
I20251213 09:05:23.957763 18654 catalog_manager.cc:6724] ReplaceTablet: tablet c15dfcf0143a480da7a2c0befd55e18d deleted and replaced by tablet a5e98dc388f54933916e6c4421ce217a
I20251213 09:05:23.957909 18654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36662:
name: "default.Table_2dc90a5c5ed546fc91a933d1157d4271"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:23.957926 18652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36662:
name: "default.Table_9b48a97fa9d7493e90bdd14e64693cdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:23.958561 18656 catalog_manager.cc:5941] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Sending DeleteTablet for 3 replicas of tablet d1af0e247ba24ebe9adab2cfda9a16aa
I20251213 09:05:23.958875 18656 catalog_manager.cc:6724] ReplaceTablet: tablet d1af0e247ba24ebe9adab2cfda9a16aa deleted and replaced by tablet a8a7e9b0b60d4a4b964b37febf8584ed
I20251213 09:05:23.959082 18656 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36662:
table { table_name: "default.Table_6b013204511a4b49bd1c108904225841" } new_table_name: "default.Table_d364163ef2394c35b078e79e43b16a89" modify_external_catalogs: true
@ 0x7f6071bb5279 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20251213 09:05:23.966899 19086 mvcc.cc:204] Tried to move back new op lower bound from 7231966101263364096 to 7231966057474719744. Current Snapshot: MvccSnapshot[applied={T|T < 7231966101257543680}]
@ 0x7f6071bb4190 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20251213 09:05:23.969121 17068 tablet_service.cc:1552] Processing DeleteTablet for tablet 639c8c290eb6413e9b343b8c132d8152 with delete_type TABLET_DATA_DELETED (replaced by tablet 651bb66490104f53b901a19fde816bf1) from {username='slave'} at 127.0.0.1:58982
I20251213 09:05:23.969354 17066 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e1aeb5749684d268d61d9601c2f8efd with delete_type TABLET_DATA_DELETED (replaced by tablet 274e6dd40a1f46c3a3a1dcb715c66d09) from {username='slave'} at 127.0.0.1:58982
I20251213 09:05:23.969472 17067 tablet_service.cc:1552] Processing DeleteTablet for tablet f394b4d388cd43a49ae4c3db293a893c with delete_type TABLET_DATA_DELETED (replaced by tablet ee4217a512f84af49e180d28c7b4cb42) from {username='slave'} at 127.0.0.1:58982
I20251213 09:05:23.969561 17069 tablet_service.cc:1552] Processing DeleteTablet for tablet c15dfcf0143a480da7a2c0befd55e18d with delete_type TABLET_DATA_DELETED (replaced by tablet a5e98dc388f54933916e6c4421ce217a) from {username='slave'} at 127.0.0.1:58982
I20251213 09:05:23.969645 17071 tablet_service.cc:1552] Processing DeleteTablet for tablet d1af0e247ba24ebe9adab2cfda9a16aa with delete_type TABLET_DATA_DELETED (replaced by tablet a8a7e9b0b60d4a4b964b37febf8584ed) from {username='slave'} at 127.0.0.1:58982
I20251213 09:05:23.969753 16796 tablet_service.cc:1552] Processing DeleteTablet for tablet 639c8c290eb6413e9b343b8c132d8152 with delete_type TABLET_DATA_DELETED (replaced by tablet 651bb66490104f53b901a19fde816bf1) from {username='slave'} at 127.0.0.1:33168
I20251213 09:05:23.969962 16798 tablet_service.cc:1552] Processing DeleteTablet for tablet f394b4d388cd43a49ae4c3db293a893c with delete_type TABLET_DATA_DELETED (replaced by tablet ee4217a512f84af49e180d28c7b4cb42) from {username='slave'} at 127.0.0.1:33168
I20251213 09:05:23.970023 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet c15dfcf0143a480da7a2c0befd55e18d with delete_type TABLET_DATA_DELETED (replaced by tablet a5e98dc388f54933916e6c4421ce217a) from {username='slave'} at 127.0.0.1:33168
I20251213 09:05:23.970140 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet d1af0e247ba24ebe9adab2cfda9a16aa with delete_type TABLET_DATA_DELETED (replaced by tablet a8a7e9b0b60d4a4b964b37febf8584ed) from {username='slave'} at 127.0.0.1:33168
I20251213 09:05:23.969753 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e1aeb5749684d268d61d9601c2f8efd with delete_type TABLET_DATA_DELETED (replaced by tablet 274e6dd40a1f46c3a3a1dcb715c66d09) from {username='slave'} at 127.0.0.1:33168
I20251213 09:05:23.971419 19105 tablet_replica.cc:333] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:23.971556 19105 raft_consensus.cc:2243] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:23.971666 19105 raft_consensus.cc:2272] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:23.972034 16932 tablet_service.cc:1552] Processing DeleteTablet for tablet 639c8c290eb6413e9b343b8c132d8152 with delete_type TABLET_DATA_DELETED (replaced by tablet 651bb66490104f53b901a19fde816bf1) from {username='slave'} at 127.0.0.1:56578
I20251213 09:05:23.972294 16935 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e1aeb5749684d268d61d9601c2f8efd with delete_type TABLET_DATA_DELETED (replaced by tablet 274e6dd40a1f46c3a3a1dcb715c66d09) from {username='slave'} at 127.0.0.1:56578
I20251213 09:05:23.972434 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet f394b4d388cd43a49ae4c3db293a893c with delete_type TABLET_DATA_DELETED (replaced by tablet ee4217a512f84af49e180d28c7b4cb42) from {username='slave'} at 127.0.0.1:56578
I20251213 09:05:23.972520 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet c15dfcf0143a480da7a2c0befd55e18d with delete_type TABLET_DATA_DELETED (replaced by tablet a5e98dc388f54933916e6c4421ce217a) from {username='slave'} at 127.0.0.1:56578
I20251213 09:05:23.972599 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet d1af0e247ba24ebe9adab2cfda9a16aa with delete_type TABLET_DATA_DELETED (replaced by tablet a8a7e9b0b60d4a4b964b37febf8584ed) from {username='slave'} at 127.0.0.1:56578
I20251213 09:05:23.972856 19105 ts_tablet_manager.cc:1916] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f6071bb38f3 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20251213 09:05:23.974283 16938 tablet_service.cc:1505] Processing CreateTablet for tablet 274e6dd40a1f46c3a3a1dcb715c66d09 (DEFAULT_TABLE table=default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:23.974619 16938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274e6dd40a1f46c3a3a1dcb715c66d09. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:23.975306 16933 tablet_service.cc:1505] Processing CreateTablet for tablet 651bb66490104f53b901a19fde816bf1 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:23.975746 16933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651bb66490104f53b901a19fde816bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:23.976517 19105 ts_tablet_manager.cc:1929] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:23.976619 19105 log.cc:1199] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/639c8c290eb6413e9b343b8c132d8152
I20251213 09:05:23.976948 19105 ts_tablet_manager.cc:1950] T 639c8c290eb6413e9b343b8c132d8152 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
@ 0x7f6071bb8ffa _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20251213 09:05:23.977209 16800 tablet_service.cc:1505] Processing CreateTablet for tablet 651bb66490104f53b901a19fde816bf1 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:23.977615 16797 tablet_service.cc:1505] Processing CreateTablet for tablet 274e6dd40a1f46c3a3a1dcb715c66d09 (DEFAULT_TABLE table=default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:23.977888 19105 tablet_replica.cc:333] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:23.978078 19105 raft_consensus.cc:2243] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
@ 0x56232e6d8a0a std::function<>::operator()() at ??:0
I20251213 09:05:23.978305 19105 raft_consensus.cc:2272] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:23.978670 17071 tablet_service.cc:1505] Processing CreateTablet for tablet 651bb66490104f53b901a19fde816bf1 (DEFAULT_TABLE table=default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:23.978783 19105 ts_tablet_manager.cc:1916] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:23.979072 17069 tablet_service.cc:1505] Processing CreateTablet for tablet 274e6dd40a1f46c3a3a1dcb715c66d09 (DEFAULT_TABLE table=default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:23.979306 17069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274e6dd40a1f46c3a3a1dcb715c66d09. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f606de9b7dc kudu::Thread::SuperviseThread() at ??:0
I20251213 09:05:23.981249 18641 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 639c8c290eb6413e9b343b8c132d8152 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]) successfully deleted
I20251213 09:05:23.981644 16800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651bb66490104f53b901a19fde816bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:23.981981 17071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651bb66490104f53b901a19fde816bf1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:23.983449 19106 tablet_replica.cc:333] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:23.983651 19106 raft_consensus.cc:2243] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:23.983780 19106 raft_consensus.cc:2272] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7f606e7346db start_thread at ??:0
I20251213 09:05:23.984201 19106 ts_tablet_manager.cc:1916] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:23.984679 16797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 274e6dd40a1f46c3a3a1dcb715c66d09. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f606bbf871f clone at ??:0
I20251213 09:05:23.986443 19105 ts_tablet_manager.cc:1929] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:23.986539 19105 log.cc:1199] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/7e1aeb5749684d268d61d9601c2f8efd
I20251213 09:05:23.986824 19105 ts_tablet_manager.cc:1950] T 7e1aeb5749684d268d61d9601c2f8efd P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:23.986886 19108 tablet_bootstrap.cc:492] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:23.987430 19105 tablet_replica.cc:333] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:23.987439 19107 tablet_replica.cc:333] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:23.987550 19107 raft_consensus.cc:2243] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:23.987545 19109 tablet_bootstrap.cc:492] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:23.987749 19107 raft_consensus.cc:2272] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:23.987548 19105 raft_consensus.cc:2243] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:23.987893 19105 raft_consensus.cc:2272] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:23.988204 19105 ts_tablet_manager.cc:1916] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:23.988854 19109 tablet_bootstrap.cc:654] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:23.988946 19108 tablet_bootstrap.cc:654] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:23.989344 19106 ts_tablet_manager.cc:1929] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:23.989418 19106 log.cc:1199] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/639c8c290eb6413e9b343b8c132d8152
I20251213 09:05:23.988126 19107 ts_tablet_manager.cc:1916] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:23.989681 19106 ts_tablet_manager.cc:1950] T 639c8c290eb6413e9b343b8c132d8152 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:23.989686 19110 tablet_bootstrap.cc:492] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:23.991291 19105 ts_tablet_manager.cc:1929] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:23.991348 19105 log.cc:1199] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/f394b4d388cd43a49ae4c3db293a893c
I20251213 09:05:23.991648 19105 ts_tablet_manager.cc:1950] T f394b4d388cd43a49ae4c3db293a893c P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:23.991904 19107 ts_tablet_manager.cc:1929] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:23.991966 19107 log.cc:1199] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/639c8c290eb6413e9b343b8c132d8152
I20251213 09:05:23.992014 19110 tablet_bootstrap.cc:654] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:23.992209 19107 ts_tablet_manager.cc:1950] T 639c8c290eb6413e9b343b8c132d8152 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:23.992245 19105 tablet_replica.cc:333] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:23.992404 19105 raft_consensus.cc:2243] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:23.992501 19105 raft_consensus.cc:2272] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:23.992839 19105 ts_tablet_manager.cc:1916] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:23.992888 19107 tablet_replica.cc:333] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:23.992993 19107 raft_consensus.cc:2243] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:23.993093 19107 raft_consensus.cc:2272] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:23.993438 19107 ts_tablet_manager.cc:1916] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:23.994678 19105 ts_tablet_manager.cc:1929] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:23.994735 19105 log.cc:1199] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/c15dfcf0143a480da7a2c0befd55e18d
I20251213 09:05:23.994971 19105 ts_tablet_manager.cc:1950] T c15dfcf0143a480da7a2c0befd55e18d P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:23.995493 19107 ts_tablet_manager.cc:1929] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:23.995553 19107 log.cc:1199] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/7e1aeb5749684d268d61d9601c2f8efd
I20251213 09:05:23.995736 19106 tablet_replica.cc:333] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:23.995855 19106 raft_consensus.cc:2243] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:23.996016 19108 tablet_bootstrap.cc:492] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:23.996057 19106 raft_consensus.cc:2272] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:23.996094 19108 ts_tablet_manager.cc:1403] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:23.996440 19106 ts_tablet_manager.cc:1916] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:23.996464 19109 tablet_bootstrap.cc:492] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:23.996554 19109 ts_tablet_manager.cc:1403] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:23.996572 19108 raft_consensus.cc:359] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:23.996694 19108 raft_consensus.cc:385] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:23.996727 19108 raft_consensus.cc:740] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:23.996851 19108 consensus_queue.cc:260] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:23.997031 19109 raft_consensus.cc:359] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:23.997135 19109 raft_consensus.cc:385] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:23.997172 19109 raft_consensus.cc:740] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:23.997310 19109 consensus_queue.cc:260] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:23.997632 19109 ts_tablet_manager.cc:1434] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:23.998303 19110 tablet_bootstrap.cc:492] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:23.998373 19110 ts_tablet_manager.cc:1403] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251213 09:05:23.998670 19106 ts_tablet_manager.cc:1929] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:23.998740 19106 log.cc:1199] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/f394b4d388cd43a49ae4c3db293a893c
I20251213 09:05:23.998860 19110 raft_consensus.cc:359] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:23.998955 19110 raft_consensus.cc:385] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:23.998993 19110 raft_consensus.cc:740] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:23.999218 19110 consensus_queue.cc:260] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:23.999503 19110 ts_tablet_manager.cc:1434] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:23.999667 19110 tablet_bootstrap.cc:492] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:23.999675 19108 ts_tablet_manager.cc:1434] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251213 09:05:24.000636 19110 tablet_bootstrap.cc:654] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:24.001194 19108 tablet_bootstrap.cc:492] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:24.002174 19108 tablet_bootstrap.cc:654] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:23.998989 19106 ts_tablet_manager.cc:1950] T f394b4d388cd43a49ae4c3db293a893c P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:24.003191 19106 tablet_replica.cc:333] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:24.003325 19106 raft_consensus.cc:2243] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:24.003577 19106 raft_consensus.cc:2272] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:24.003969 19107 ts_tablet_manager.cc:1950] T 7e1aeb5749684d268d61d9601c2f8efd P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:24.003975 19106 ts_tablet_manager.cc:1916] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:24.004619 19107 tablet_replica.cc:333] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:24.004734 19107 raft_consensus.cc:2243] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:24.004834 19107 raft_consensus.cc:2272] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:24.005163 19108 tablet_bootstrap.cc:492] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:24.005280 19108 ts_tablet_manager.cc:1403] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251213 09:05:24.005175 19107 ts_tablet_manager.cc:1916] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:24.005700 19110 tablet_bootstrap.cc:492] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:24.005769 19110 ts_tablet_manager.cc:1403] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:24.005837 19108 raft_consensus.cc:359] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.005939 19108 raft_consensus.cc:385] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:24.005967 19108 raft_consensus.cc:740] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:24.006083 19108 consensus_queue.cc:260] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.006176 19110 raft_consensus.cc:359] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.006268 19110 raft_consensus.cc:385] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:24.006297 19110 raft_consensus.cc:740] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:24.006368 19108 ts_tablet_manager.cc:1434] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:24.006421 19110 consensus_queue.cc:260] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.006722 19110 ts_tablet_manager.cc:1434] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:24.007441 19109 tablet_bootstrap.cc:492] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:24.008502 19109 tablet_bootstrap.cc:654] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:24.010793 19105 tablet_replica.cc:333] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:24.010926 19105 raft_consensus.cc:2243] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:24.011027 19105 raft_consensus.cc:2272] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:24.011435 19105 ts_tablet_manager.cc:1916] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:24.012863 19106 ts_tablet_manager.cc:1929] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:24.012929 19106 log.cc:1199] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/c15dfcf0143a480da7a2c0befd55e18d
I20251213 09:05:24.013259 19106 ts_tablet_manager.cc:1950] T c15dfcf0143a480da7a2c0befd55e18d P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:24.013818 19105 ts_tablet_manager.cc:1929] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:24.013883 19105 log.cc:1199] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/d1af0e247ba24ebe9adab2cfda9a16aa
I20251213 09:05:24.013921 19106 tablet_replica.cc:333] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:24.013948 19107 ts_tablet_manager.cc:1929] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:24.014010 19107 log.cc:1199] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/f394b4d388cd43a49ae4c3db293a893c
I20251213 09:05:24.014053 19106 raft_consensus.cc:2243] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:24.014125 19105 ts_tablet_manager.cc:1950] T d1af0e247ba24ebe9adab2cfda9a16aa P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:24.014153 19106 raft_consensus.cc:2272] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:24.014251 19107 ts_tablet_manager.cc:1950] T f394b4d388cd43a49ae4c3db293a893c P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:24.014659 19106 ts_tablet_manager.cc:1916] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:24.015017 19107 tablet_replica.cc:333] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:24.015182 19107 raft_consensus.cc:2243] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:24.015344 19107 raft_consensus.cc:2272] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:24.015744 19107 ts_tablet_manager.cc:1916] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:24.016724 19106 ts_tablet_manager.cc:1929] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:24.016784 19106 log.cc:1199] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/d1af0e247ba24ebe9adab2cfda9a16aa
I20251213 09:05:24.017014 19106 ts_tablet_manager.cc:1950] T d1af0e247ba24ebe9adab2cfda9a16aa P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:24.017721 19107 ts_tablet_manager.cc:1929] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251213 09:05:24.017781 19107 log.cc:1199] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/c15dfcf0143a480da7a2c0befd55e18d
I20251213 09:05:24.017777 19109 tablet_bootstrap.cc:492] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:24.017885 19109 ts_tablet_manager.cc:1403] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251213 09:05:24.018021 19107 ts_tablet_manager.cc:1950] T c15dfcf0143a480da7a2c0befd55e18d P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:24.018421 19109 raft_consensus.cc:359] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.018535 19109 raft_consensus.cc:385] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:24.018571 19109 raft_consensus.cc:740] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:24.018646 19107 tablet_replica.cc:333] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:24.018703 19109 consensus_queue.cc:260] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.018757 19107 raft_consensus.cc:2243] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:24.018963 19109 ts_tablet_manager.cc:1434] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251213 09:05:24.019145 19107 raft_consensus.cc:2272] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:24.019467 19107 ts_tablet_manager.cc:1916] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:24.020164 19106 tablet_replica.cc:333] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:24.020279 19106 raft_consensus.cc:2243] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:24.020385 19106 raft_consensus.cc:2272] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:24.020720 19106 ts_tablet_manager.cc:1916] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:24.022599 19106 ts_tablet_manager.cc:1929] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:24.022579 19107 ts_tablet_manager.cc:1929] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:24.022652 19106 log.cc:1199] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/7e1aeb5749684d268d61d9601c2f8efd
I20251213 09:05:24.022652 19107 log.cc:1199] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/d1af0e247ba24ebe9adab2cfda9a16aa
I20251213 09:05:24.022886 19106 ts_tablet_manager.cc:1950] T 7e1aeb5749684d268d61d9601c2f8efd P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:24.022886 19107 ts_tablet_manager.cc:1950] T d1af0e247ba24ebe9adab2cfda9a16aa P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:24.027544 18967 raft_consensus.cc:493] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:24.027623 18967 raft_consensus.cc:515] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.027915 18967 leader_election.cc:290] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:24.028266 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "274e6dd40a1f46c3a3a1dcb715c66d09" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce" is_pre_election: true
I20251213 09:05:24.028266 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "274e6dd40a1f46c3a3a1dcb715c66d09" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:24.028386 16819 raft_consensus.cc:2468] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:24.028398 17092 raft_consensus.cc:2468] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 0.
I20251213 09:05:24.028683 16894 leader_election.cc:304] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:24.028910 18967 raft_consensus.cc:2804] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:24.028959 18967 raft_consensus.cc:493] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:24.028990 18967 raft_consensus.cc:3060] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:24.029698 18967 raft_consensus.cc:515] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.029995 18967 leader_election.cc:290] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:24.030345 17092 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "274e6dd40a1f46c3a3a1dcb715c66d09" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9714e48438da4ed8b629934850b1f7ce"
I20251213 09:05:24.030345 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "274e6dd40a1f46c3a3a1dcb715c66d09" candidate_uuid: "ba49ca51d8eb4be288091d19e7114792" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:24.030436 16819 raft_consensus.cc:3060] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:24.030436 17092 raft_consensus.cc:3060] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:24.031373 16819 raft_consensus.cc:2468] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:24.031441 17092 raft_consensus.cc:2468] T 274e6dd40a1f46c3a3a1dcb715c66d09 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba49ca51d8eb4be288091d19e7114792 in term 1.
I20251213 09:05:24.031745 16894 leader_election.cc:304] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:24.031883 18967 raft_consensus.cc:2804] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:24.031961 18967 raft_consensus.cc:697] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Becoming Leader. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Running, Role: LEADER
I20251213 09:05:24.032085 18967 consensus_queue.cc:237] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.076089 19073 raft_consensus.cc:493] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:24.076249 19073 raft_consensus.cc:515] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.076820 19073 leader_election.cc:290] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:24.077086 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "651bb66490104f53b901a19fde816bf1" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:24.077224 16819 raft_consensus.cc:2468] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:24.077226 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "651bb66490104f53b901a19fde816bf1" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:24.077355 16957 raft_consensus.cc:2468] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:24.077524 17026 leader_election.cc:304] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:24.077697 19073 raft_consensus.cc:2804] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:24.077761 19073 raft_consensus.cc:493] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:24.077814 19073 raft_consensus.cc:3060] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:24.078660 19073 raft_consensus.cc:515] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:24.078981 19073 leader_election.cc:290] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:24.079301 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "651bb66490104f53b901a19fde816bf1" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:24.079357 16957 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "651bb66490104f53b901a19fde816bf1" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:24.079432 16819 raft_consensus.cc:3060] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:24.079486 16957 raft_consensus.cc:3060] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:24.080227 16957 raft_consensus.cc:2468] T 651bb66490104f53b901a19fde816bf1 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:24.080525 17028 leader_election.cc:304] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce, ba49ca51d8eb4be288091d19e7114792; no voters:
I20251213 09:05:24.080528 16819 raft_consensus.cc:2468] T 651bb66490104f53b901a19fde816bf1 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:24.080691 19073 raft_consensus.cc:2804] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:24.080778 19073 raft_consensus.cc:697] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:24.081290 19073 consensus_queue.cc:237] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
W20251213 09:05:24.172060 17029 connection.cc:537] server connection from 127.0.0.1:58982 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:24.172060 16754 connection.cc:537] server connection from 127.0.0.1:33168 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:24.172089 16893 connection.cc:537] server connection from 127.0.0.1:56578 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:24.172359 16893 connection.cc:537] client connection to 127.15.213.61:38171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:24.172385 16756 connection.cc:537] client connection to 127.15.213.61:38171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:24.173552 17028 connection.cc:537] client connection to 127.15.213.61:38171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:24.173734 17148 connection.cc:537] client connection to 127.15.213.61:38171 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:24.174084 19071 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:24.173009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.61:38171 (local address 127.15.213.1:38565)
1213 09:05:24.173170 (+ 161us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:24.173187 (+ 17us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:24.173306 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:24.173969 (+ 663us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":59}
W20251213 09:05:24.174137 17148 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.61:38171)
W20251213 09:05:24.174489 17148 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.213.61:38171)
W20251213 09:05:24.174751 17148 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.15.213.61:38171)
W20251213 09:05:24.174902 17148 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.15.213.61:38171)
W20251213 09:05:24.175201 19069 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:24.173318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.61:38171 (local address 127.15.213.2:41163)
1213 09:05:24.173488 (+ 170us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:24.173503 (+ 15us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:24.173581 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:24.175070 (+ 1489us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":79}
I20251213 09:05:24.482012 19131 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:24.482134 19131 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:24.483460 19131 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:24.483943 18989 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:24.484928 18989 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:24.485105 18991 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
I20251213 09:05:24.485172 18991 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:24.485343 19131 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20251213 09:05:24.519524 18967 consensus_queue.cc:1048] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:24.523011 18967 consensus_queue.cc:1048] T 274e6dd40a1f46c3a3a1dcb715c66d09 P ba49ca51d8eb4be288091d19e7114792 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:24.526918 18988 consensus_queue.cc:1048] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:24.530527 19073 consensus_queue.cc:1048] T 651bb66490104f53b901a19fde816bf1 P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:25.130301 19151 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:25.130450 19151 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:25.130921 19151 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:25.132290 18991 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
W20251213 09:05:25.132516 18989 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:25.132587 18989 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:25.132792 19151 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20251213 09:05:25.653326 19159 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:25.653463 19159 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:25.653913 19159 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:25.655170 18991 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
W20251213 09:05:25.655269 18989 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:25.655333 18989 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:25.655493 19159 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20251213 09:05:26.449016 19174 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:26.449157 19174 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:26.449589 19174 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:26.450767 18991 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171): Network error: Client connection negotiation failed: client connection to 127.15.213.61:38171: connect: Connection refused (error 111)
W20251213 09:05:26.450910 18989 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:26.450971 18989 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, f0ef4ffe02ab44248dc97cb1c5cceac1
I20251213 09:05:26.451107 19174 raft_consensus.cc:2749] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20251213 09:05:26.640694 16212 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
/tmp/dist-test-taskyiO_0l/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--webserver_interface=127.15.213.61
--webserver_port=46495
--builtin_ntp_servers=127.15.213.20:40971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251213 09:05:26.754432 19185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251213 09:05:26.754671 19185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251213 09:05:26.754711 19185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251213 09:05:26.758114 19185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251213 09:05:26.758164 19185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251213 09:05:26.758185 19185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251213 09:05:26.758224 19185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251213 09:05:26.761754 19185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.15.213.20:40971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:41793
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.15.213.61:38171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.15.213.61
--webserver_port=46495
--never_fsync=true
--heap_profile_path=/tmp/kudu.19185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type DEBUG
built by None at 13 Dec 2025 08:43:13 UTC on 24a791456cd2
build id 9490
I20251213 09:05:26.762794 19185 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251213 09:05:26.763906 19185 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251213 09:05:26.769379 19192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251213 09:05:26.769375 19191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:26.769454 19185 server_base.cc:1047] running on GCE node
W20251213 09:05:26.769372 19194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251213 09:05:26.770151 19185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251213 09:05:26.771027 19185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251213 09:05:26.772174 19185 hybrid_clock.cc:648] HybridClock initialized: now 1765616726772160 us; error 35 us; skew 500 ppm
I20251213 09:05:26.773898 19185 webserver.cc:492] Webserver started at http://127.15.213.61:46495/ using document root <none> and password file <none>
I20251213 09:05:26.774458 19185 fs_manager.cc:362] Metadata directory not provided
I20251213 09:05:26.774525 19185 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251213 09:05:26.777779 19185 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:26.779726 19200 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251213 09:05:26.780814 19185 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:26.780930 19185 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data,/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
format_stamp: "Formatted at 2025-12-13 09:04:57 on dist-test-slave-rpq5"
I20251213 09:05:26.781319 19185 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251213 09:05:26.800591 19185 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251213 09:05:26.801318 19185 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251213 09:05:26.801504 19185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251213 09:05:26.809226 19185 rpc_server.cc:307] RPC server started. Bound to: 127.15.213.61:38171
I20251213 09:05:26.809402 19254 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.213.61:38171 every 8 connection(s)
I20251213 09:05:26.810496 19185 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/master-1/data/info.pb
I20251213 09:05:26.815644 19255 sys_catalog.cc:263] Verifying existing consensus state
I20251213 09:05:26.816999 16212 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskyiO_0l/build/debug/bin/kudu as pid 19185
I20251213 09:05:26.817363 19255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap starting.
I20251213 09:05:26.837356 19255 log.cc:826] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Log is configured to *not* fsync() on all Append() calls
I20251213 09:05:26.966178 19255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=275 overwritten=0 applied=274 ignored=0} inserts{seen=174 ignored=0} mutations{seen=252 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20251213 09:05:26.966647 19255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: Bootstrap complete.
I20251213 09:05:26.969789 19255 raft_consensus.cc:359] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 8 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:26.971654 19255 raft_consensus.cc:740] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ef4ffe02ab44248dc97cb1c5cceac1, State: Initialized, Role: FOLLOWER
I20251213 09:05:26.972080 19255 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 274, Last appended: 8.275, Last appended by leader: 275, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:26.972478 19261 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:26.972575 19261 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:26.973066 19255 sys_catalog.cc:565] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: configured and running, proceeding with master startup.
I20251213 09:05:26.980130 19275 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:26.980276 19275 catalog_manager.cc:1562] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: loading cluster ID for follower catalog manager: success
I20251213 09:05:26.979776 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:26.981765 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:26.984267 19275 catalog_manager.cc:1584] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: acquiring CA information for follower catalog manager: success
I20251213 09:05:26.986515 19275 catalog_manager.cc:1612] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251213 09:05:27.032617 17006 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:27.034857 19218 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" instance_seqno: 1765616698285818) as {username='slave'} at 127.15.213.2:55201; Asking this server to re-register.
I20251213 09:05:27.035501 17006 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:27.037444 19218 ts_manager.cc:194] Registered new tserver with Master: ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:27.040805 16870 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:27.042284 19218 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" instance_seqno: 1765616698094467) as {username='slave'} at 127.15.213.1:34019; Asking this server to re-register.
I20251213 09:05:27.042829 16870 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:27.044147 19218 ts_manager.cc:194] Registered new tserver with Master: 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147)
I20251213 09:05:27.150951 17141 heartbeater.cc:344] Connected to a master server at 127.15.213.61:38171
I20251213 09:05:27.152194 19218 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" instance_seqno: 1765616698457693) as {username='slave'} at 127.15.213.3:40649; Asking this server to re-register.
I20251213 09:05:27.152721 17141 heartbeater.cc:461] Registering TS with master...
I20251213 09:05:27.153899 19218 ts_manager.cc:194] Registered new tserver with Master: 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367)
I20251213 09:05:27.202862 19283 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:27.203017 19283 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:27.203554 19283 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
W20251213 09:05:27.204676 18989 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:27.206933 19229 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7f61ccb4ffd4066babfa94938e28b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 275 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" is_pre_election: true
I20251213 09:05:27.207267 19229 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7f61ccb4ffd4066babfa94938e28b87 in term 8.
I20251213 09:05:27.207746 18991 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982
I20251213 09:05:27.207942 19283 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20251213 09:05:27.207998 19283 raft_consensus.cc:493] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f0ef4ffe02ab44248dc97cb1c5cceac1)
I20251213 09:05:27.208029 19283 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 8 FOLLOWER]: Advancing to term 9
I20251213 09:05:27.209093 19283 raft_consensus.cc:515] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:27.209398 19283 leader_election.cc:290] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 election: Requested vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), f0ef4ffe02ab44248dc97cb1c5cceac1 (127.15.213.61:38171)
I20251213 09:05:27.209731 19229 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7f61ccb4ffd4066babfa94938e28b87" candidate_term: 9 candidate_status { last_received { term: 8 index: 275 } } ignore_live_leader: false dest_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1"
I20251213 09:05:27.209849 19229 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 8 FOLLOWER]: Advancing to term 9
W20251213 09:05:27.210269 18989 leader_election.cc:336] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:27.211581 19229 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7f61ccb4ffd4066babfa94938e28b87 in term 9.
I20251213 09:05:27.211858 18991 leader_election.cc:304] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d7f61ccb4ffd4066babfa94938e28b87, f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982
I20251213 09:05:27.212020 19283 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 9 FOLLOWER]: Leader election won for term 9
I20251213 09:05:27.212208 19283 raft_consensus.cc:697] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [term 9 LEADER]: Becoming Leader. State: Replica: d7f61ccb4ffd4066babfa94938e28b87, State: Running, Role: LEADER
I20251213 09:05:27.212462 19283 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 274, Committed index: 274, Last appended: 8.275, Last appended by leader: 275, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:27.213382 19287 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7f61ccb4ffd4066babfa94938e28b87. Latest consensus state: current_term: 9 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:27.213490 19287 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: LEADER
W20251213 09:05:27.647199 18989 consensus_peers.cc:597] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 -> Peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Couldn't send request to peer 8fe04e8d31ac4cd9bca8f96335ff1982. Status: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251213 09:05:27.832535 19229 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Refusing update from remote peer d7f61ccb4ffd4066babfa94938e28b87: Log matching property violated. Preceding OpId in replica: term: 8 index: 275. Preceding OpId from leader: term: 9 index: 276. (index mismatch)
I20251213 09:05:27.833158 19293 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:27.833123 19287 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 276, Last known committed idx: 274, Time since last communication: 0.000s
I20251213 09:05:27.833277 19293 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:27.834481 19293 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
I20251213 09:05:27.834908 19294 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7f61ccb4ffd4066babfa94938e28b87. Latest consensus state: current_term: 9 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
W20251213 09:05:27.835013 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:27.835382 19294 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
W20251213 09:05:27.836012 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:27.837059 19294 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:27.837172 19294 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [sys.catalog]: This master's current role is: FOLLOWER
I20251213 09:05:27.837425 19300 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "d7f61ccb4ffd4066babfa94938e28b87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } } }
I20251213 09:05:27.837572 19300 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87 [sys.catalog]: This master's current role is: LEADER
I20251213 09:05:27.838989 19019 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" candidate_term: 10 candidate_status { last_received { term: 8 index: 275 } } ignore_live_leader: false dest_uuid: "d7f61ccb4ffd4066babfa94938e28b87" is_pre_election: true
I20251213 09:05:27.839548 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:27.839753 19294 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:27.858212 19289 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251213 09:05:27.861377 19289 catalog_manager.cc:679] Loaded metadata for table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d]
I20251213 09:05:27.861836 19289 catalog_manager.cc:679] Loaded metadata for table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46]
I20251213 09:05:27.862042 19289 catalog_manager.cc:679] Loaded metadata for table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d]
I20251213 09:05:27.862263 19289 catalog_manager.cc:679] Loaded metadata for table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa]
I20251213 09:05:27.862476 19289 catalog_manager.cc:679] Loaded metadata for table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893]
I20251213 09:05:27.862675 19289 catalog_manager.cc:679] Loaded metadata for table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454]
I20251213 09:05:27.862960 19289 catalog_manager.cc:679] Loaded metadata for table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1]
I20251213 09:05:27.863341 19289 catalog_manager.cc:679] Loaded metadata for table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644]
I20251213 09:05:27.863633 19289 catalog_manager.cc:679] Loaded metadata for table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce]
I20251213 09:05:27.863833 19289 catalog_manager.cc:679] Loaded metadata for table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee]
I20251213 09:05:27.864059 19289 catalog_manager.cc:679] Loaded metadata for table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253]
I20251213 09:05:27.864264 19289 catalog_manager.cc:679] Loaded metadata for table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd]
I20251213 09:05:27.864531 19289 catalog_manager.cc:679] Loaded metadata for table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907]
I20251213 09:05:27.864717 19289 catalog_manager.cc:679] Loaded metadata for table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]
I20251213 09:05:27.865067 19289 catalog_manager.cc:679] Loaded metadata for table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]
I20251213 09:05:27.865329 19289 catalog_manager.cc:679] Loaded metadata for table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a]
I20251213 09:05:27.865542 19289 catalog_manager.cc:679] Loaded metadata for table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d]
I20251213 09:05:27.865739 19289 catalog_manager.cc:679] Loaded metadata for table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad]
I20251213 09:05:27.866106 19289 catalog_manager.cc:679] Loaded metadata for table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f]
I20251213 09:05:27.866448 19289 catalog_manager.cc:679] Loaded metadata for table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f]
I20251213 09:05:27.866755 19289 catalog_manager.cc:679] Loaded metadata for table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8]
I20251213 09:05:27.867044 19289 catalog_manager.cc:679] Loaded metadata for table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]
I20251213 09:05:27.867278 19289 catalog_manager.cc:679] Loaded metadata for table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5]
I20251213 09:05:27.867493 19289 catalog_manager.cc:679] Loaded metadata for table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07]
I20251213 09:05:27.867712 19289 catalog_manager.cc:679] Loaded metadata for table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba]
I20251213 09:05:27.867991 19289 catalog_manager.cc:679] Loaded metadata for table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e]
I20251213 09:05:27.868209 19289 catalog_manager.cc:679] Loaded metadata for table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]
I20251213 09:05:27.868414 19289 catalog_manager.cc:679] Loaded metadata for table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a]
I20251213 09:05:27.870889 19289 tablet_loader.cc:96] loaded metadata for tablet 12254c0d95144f8e8d958647924a5ee2 (table default.table_72b6ade0720a4ca696c10b619535e2b9 [id=c5c8c2c3dae848b1afff2fc38230a65f])
I20251213 09:05:27.871094 19289 tablet_loader.cc:96] loaded metadata for tablet 1391d28e1e4046b4af9f0b06ae539c0d (table default.table_3bdf6aed0ee54ebb8b7bf14c832ceae6 [id=b1729dc398c84d178ffc92c632fdc08d])
I20251213 09:05:27.871435 19289 tablet_loader.cc:96] loaded metadata for tablet 1ef26c19666f4a0194c172a7ca4a922f (table default.table_20afd9b96f7e403d9c185f93b6567f19 [id=de90070c4b0140e49f4f058c48aa4de5])
I20251213 09:05:27.871757 19289 tablet_loader.cc:96] loaded metadata for tablet 274e6dd40a1f46c3a3a1dcb715c66d09 (table default.table_9875930af7074cd8b3baeb132c88b19a [id=6d12506ceb06414dbd055e0a048c1907])
I20251213 09:05:27.872052 19289 tablet_loader.cc:96] loaded metadata for tablet 2a1ac8e79b9f457eac1214d52872f8b7 (table default.table_3f366169f90d4115bc094d525207e859 [id=4ec61addd21c4307bce7a9891a6983ee])
I20251213 09:05:27.872337 19289 tablet_loader.cc:96] loaded metadata for tablet 33e5ff40d6b24f51956d050c23d41eb7 (table default.table_be02832fc0574645929e026489c9e677 [id=26100504d2dc4aa89c7484bcde13e454])
I20251213 09:05:27.872524 19289 tablet_loader.cc:96] loaded metadata for tablet 362edc0369024cc6b1c4acce115c4f1f (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d])
I20251213 09:05:27.873363 19289 tablet_loader.cc:96] loaded metadata for tablet 4451b0205d96405ca64a9f027749b7af (table default.table_724fda2f787b4496b3133ceb99be2012 [id=102e2c3131734392b7c5d603015c2b46])
I20251213 09:05:27.873705 19289 tablet_loader.cc:96] loaded metadata for tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb])
I20251213 09:05:27.874218 19289 tablet_loader.cc:96] loaded metadata for tablet 5982bb569c3d48c0aeb7bc4018cfa533 (table default.table_a8f6f2502bcb441eb0710b3dbbc5aad3 [id=f4e627a281b14e5f8d99e77e64f3162a])
I20251213 09:05:27.874696 19289 tablet_loader.cc:96] loaded metadata for tablet 5e23c178da6f47c487ed085718b83ce6 (table default.table_c92c10038983476b9e3c8db243dcd67a [id=f22159672ee7408e9a2fa8683784b63e])
I20251213 09:05:27.875252 19289 tablet_loader.cc:96] loaded metadata for tablet 62236955121e49ec800c5e37a40c5b19 (table default.table_432a26ea35484c14b07c89f682c923e3 [id=3ff193025e8c46c9ba8ff470fdb4e644])
I20251213 09:05:27.875625 19289 tablet_loader.cc:96] loaded metadata for tablet 651bb66490104f53b901a19fde816bf1 (table default.table_0bc46ad17b194fbf831fab656bf97fd0 [id=bc64e1bdcfa24c079179f3cb4bf6ce9f])
I20251213 09:05:27.875809 19289 tablet_loader.cc:96] loaded metadata for tablet 6e0d9ba6a4d0401994b1b74449bd5cc7 (table default.table_2a73dd544c544da19748cbfd887fe768 [id=50e0912ce3374a73b75bad413c427253])
I20251213 09:05:27.876312 19289 tablet_loader.cc:96] loaded metadata for tablet 79d28675183f4fb1ad9a573cab3bba32 (table default.table_fd1d1908e83b4925a03e655168a92b9e [id=b0b7c327bfdc4b3c8b3cac529f747e9a])
I20251213 09:05:27.877611 19289 tablet_loader.cc:96] loaded metadata for tablet a5e98dc388f54933916e6c4421ce217a (table default.table_59d286f920344321bc3617bef4c8f32a [id=e5096b86f1244b13ad349eb23d8a0c07])
I20251213 09:05:27.877935 19289 tablet_loader.cc:96] loaded metadata for tablet a8a7e9b0b60d4a4b964b37febf8584ed (table default.table_7bb124a916904ca5b08081aae9ac54a0 [id=cea0f8601638444ab29e65ef35a65bf8])
I20251213 09:05:27.878131 19289 tablet_loader.cc:96] loaded metadata for tablet aa2cb21fb1a64b9d9c13d31cb9f49a5e (table default.table_c5239544ee2445018871c8161587d082 [id=223b3f16b6974a988bd8c492248bb893])
I20251213 09:05:27.878789 19289 tablet_loader.cc:96] loaded metadata for tablet c034dfd35b7b471a8343b1f4e62c4757 (table default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd])
I20251213 09:05:27.879055 19289 tablet_loader.cc:96] loaded metadata for tablet c46becb97a3f4c8398752f647efdc190 (table default.table_b13c688f2da847468824aefa65d4c4ab [id=045d3d231f2f407d93e565315930f71d])
I20251213 09:05:27.879243 19289 tablet_loader.cc:96] loaded metadata for tablet c5adcb68c5b9438da10370479acbed52 (table default.table_9f1d86677c6e4ef3ad9ce23c8915bb90 [id=e9b9d5d3630e485c8177b62bf7cbc8ba])
I20251213 09:05:27.879500 19289 tablet_loader.cc:96] loaded metadata for tablet c75672e770be41aeb9fe180521d3f7af (table default.table_a4cb549ba70e4c568666a6ff2e2c0cfb [id=b271eec18bd34fccb6b89ababb0c66ad])
I20251213 09:05:27.879681 19289 tablet_loader.cc:96] loaded metadata for tablet c8276392af2740258e804f72f7529d16 (table default.table_48ccfd3f31d24cd282be05bf417cd050 [id=57463d6c4bc24d45ab54ddf180a102cd])
I20251213 09:05:27.879971 19289 tablet_loader.cc:96] loaded metadata for tablet d49fcf75fc57485fa8ab3ee432aa3772 (table default.table_b120cf88360b42c5a8a808744097cded [id=19c22abba4b545659b28e8e9eda9a7aa])
I20251213 09:05:27.880174 19289 tablet_loader.cc:96] loaded metadata for tablet d680eb65e2a9499897a362e09bc772b9 (table default.table_9dc2b6abe24f4a86ade24c79c38fa2e3 [id=17e6b0ba44da493cabdc06a4622e068d])
I20251213 09:05:27.880690 19289 tablet_loader.cc:96] loaded metadata for tablet e74f37bdb74e4102931e51914c24d217 (table default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c])
I20251213 09:05:27.881119 19289 tablet_loader.cc:96] loaded metadata for tablet e8e967a592a442c28f19f8ab943a8528 (table default.table_42f74bdd72ac4f25bfeefe916379f135 [id=497850be5e0c40179bfa90c0c0d6f4ce])
I20251213 09:05:27.881479 19289 tablet_loader.cc:96] loaded metadata for tablet ee4217a512f84af49e180d28c7b4cb42 (table default.table_a90e27bac3a946e5bdd85f229deeb4be [id=2d68e83efb824395abc5357db8fd46c1])
I20251213 09:05:27.882191 19289 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251213 09:05:27.883648 19289 catalog_manager.cc:1269] Loaded cluster ID: 3aee379ed74d43119aaa33d1c88ea490
I20251213 09:05:27.883697 19289 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251213 09:05:27.885035 19289 catalog_manager.cc:1514] Loading token signing keys...
I20251213 09:05:27.886472 19289 catalog_manager.cc:6038] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Loaded TSK: 0
I20251213 09:05:27.887375 19289 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251213 09:05:27.888548 19289 catalog_manager.cc:1537] Loading latest processed Hive Metastore notification log event ID...
I20251213 09:05:27.889675 19289 catalog_manager.cc:5876] Last processed Hive Metastore notification event ID: 76
I20251213 09:05:27.973294 19002 master_service.cc:954] ReplaceTablet: received request to replace tablet 4828619293414834b2596a782008a5ed from {username='slave'} at 127.0.0.1:35722
I20251213 09:05:27.973345 19003 master_service.cc:954] ReplaceTablet: received request to replace tablet c034dfd35b7b471a8343b1f4e62c4757 from {username='slave'} at 127.0.0.1:35722
I20251213 09:05:27.973891 19006 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35722:
name: "default.Table_39e762e539224330b4bfb1f52c75c017"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:27.974010 19000 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35722:
table { table_name: "default.Table_7bb124a916904ca5b08081aae9ac54a0" } new_table_name: "default.Table_8ad4a38d0dcc447fb137dd4e3701421e" modify_external_catalogs: true
I20251213 09:05:27.974298 19009 master_service.cc:954] ReplaceTablet: received request to replace tablet 362edc0369024cc6b1c4acce115c4f1f from {username='slave'} at 127.0.0.1:35722
I20251213 09:05:27.974756 19005 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35722:
name: "default.Table_cfb419171a574069b4e41856a31a16f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:27.975008 19004 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35722:
name: "default.Table_a211b679083e4e4294bf4c97874b2d60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:27.975272 19008 master_service.cc:954] ReplaceTablet: received request to replace tablet c034dfd35b7b471a8343b1f4e62c4757 from {username='slave'} at 127.0.0.1:35722
I20251213 09:05:27.975253 19001 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35722:
name: "default.Table_a19aae3ffc1441ad9d2a8082df491a94"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251213 09:05:27.975427 19007 master_service.cc:954] ReplaceTablet: received request to replace tablet e74f37bdb74e4102931e51914c24d217 from {username='slave'} at 127.0.0.1:35722
F20251213 09:05:27.979069 19064 hms_notification_log_listener.cc:287] non-monotonous event IDs from HMS: current 81, previous 81; dumping first 6 out of 12 received events: NotificationEvent(eventId=77, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_82ff078f92894308a9243b01684306d0, message={"server":"","servicePrincipal":"","db":"default","table":"table_82ff078f92894308a9243b01684306d0","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_82ff078f92894308a9243b01684306d0\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_82ff078f92894308a9243b01684306d0\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_82ff078f92894308a9243b01684306d0\",\"transient_lastDdlTime\":\"1765616707\",\"kudu.table_id\":\"9e2a6770e19d4fde8081928cfa9612bd\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=78, eventTime=1765616707, eventType=CREATE_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707,"files":[]}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=79, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_77ba98ea391f495daa07e314094f52c2, message={"server":"","servicePrincipal":"","db":"default","table":"table_731dc67a6a2b407180abef538691c40c","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_731dc67a6a2b407180abef538691c40c\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_731dc67a6a2b407180abef538691c40c\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_731dc67a6a2b407180abef538691c40c\",\"transient_lastDdlTime\":\"1765616703\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_77ba98ea391f495daa07e314094f52c2\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616703},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_77ba98ea391f495daa07e314094f52c2\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_77ba98ea391f495daa07e314094f52c2\",\"kudu.table_id\":\"ddc2320ac07a41f5917210b36dbb05cb\",\"transient_lastDdlTime\":\"1765616703\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=80, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_cfb419171a574069b4e41856a31a16f7, message={"server":"","servicePrincipal":"","db":"default","table":"table_cfb419171a574069b4e41856a31a16f7","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_cfb419171a574069b4e41856a31a16f7\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_cfb419171a574069b4e41856a31a16f7\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_cfb419171a574069b4e41856a31a16f7\",\"kudu.table_id\":\"75537d22d2274862a5106e7a3cdf7992\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=ALTER_TABLE, dbName=default, tableName=table_08f61de8c46c467ba64e2ccbc392e100, message={"server":"","servicePrincipal":"","db":"default","table":"table_a90e27bac3a946e5bdd85f229deeb4be","tableType":"MANAGED_TABLE","tableObjBeforeJson":"{\"1\":{\"str\":\"table_a90e27bac3a946e5bdd85f229deeb4be\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a90e27bac3a946e5bdd85f229deeb4be\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a90e27bac3a946e5bdd85f229deeb4be\",\"transient_lastDdlTime\":\"1765616701\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","tableObjAfterJson":"{\"1\":{\"str\":\"table_08f61de8c46c467ba64e2ccbc392e100\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616701},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_08f61de8c46c467ba64e2ccbc392e100\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_08f61de8c46c467ba64e2ccbc392e100\",\"kudu.table_id\":\"2d68e83efb824395abc5357db8fd46c1\",\"transient_lastDdlTime\":\"1765616701\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"14\":{\"tf\":0},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","isTruncateOp":"false","timestamp":1765616707}, messageFormat=json-0.2, catName=hive); NotificationEvent(eventId=81, eventTime=1765616707, eventType=DROP_TABLE, dbName=default, tableName=table_a211b679083e4e4294bf4c97874b2d60, message={"server":"","servicePrincipal":"","db":"default","table":"table_a211b679083e4e4294bf4c97874b2d60","tableType":"MANAGED_TABLE","tableObjJson":"{\"1\":{\"str\":\"table_a211b679083e4e4294bf4c97874b2d60\"},\"2\":{\"str\":\"default\"},\"3\":{\"str\":\"slave\"},\"4\":{\"i32\":1765616707},\"5\":{\"i32\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"lst\":[\"rec\",1,{\"1\":{\"str\":\"key\"},\"2\":{\"str\":\"int\"},\"3\":{\"str\":\"\"}}]},\"2\":{\"str\":\"file:/tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/warehouse/table_a211b679083e4e4294bf4c97874b2d60\"},\"3\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduInputFormat\"},\"4\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduOutputFormat\"},\"5\":{\"tf\":0},\"6\":{\"i32\":0},\"7\":{\"rec\":{\"1\":{\"str\":\"\"},\"2\":{\"str\":\"org.apache.hadoop.hive.kudu.KuduSerDe\"},\"3\":{\"map\":[\"str\",\"str\",0,{}]}}},\"8\":{\"lst\":[\"str\",0]},\"9\":{\"lst\":[\"rec\",0]},\"10\":{\"map\":[\"str\",\"str\",0,{}]},\"11\":{\"rec\":{\"1\":{\"lst\":[\"str\",0]},\"2\":{\"lst\":[\"lst\",0]},\"3\":{\"map\":[\"lst\",\"str\",0,{}]}}},\"12\":{\"tf\":0}}},\"8\":{\"lst\":[\"rec\",0]},\"9\":{\"map\":[\"str\",\"str\",7,{\"kudu.table_name\":\"default.table_a211b679083e4e4294bf4c97874b2d60\",\"kudu.table_id\":\"a6b238f424744d26948f94e973ea18cb\",\"transient_lastDdlTime\":\"1765616707\",\"comment\":\"\",\"kudu.master_addresses\":\"127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605\",\"storage_handler\":\"org.apache.hadoop.hive.kudu.KuduStorageHandler\",\"kudu.cluster_id\":\"3aee379ed74d43119aaa33d1c88ea490\"}]},\"10\":{\"str\":\"\"},\"11\":{\"str\":\"\"},\"12\":{\"str\":\"MANAGED_TABLE\"},\"15\":{\"tf\":0},\"17\":{\"str\":\"hive\"},\"18\":{\"i32\":1}}","timestamp":1765616707}, messageFormat=json-0.2, catName=hive);
*** Check failure stack trace: ***
I20251213 09:05:27.979267 19009 catalog_manager.cc:5941] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Sending DeleteTablet for 3 replicas of tablet 362edc0369024cc6b1c4acce115c4f1f
I20251213 09:05:27.980551 19009 catalog_manager.cc:6724] ReplaceTablet: tablet 362edc0369024cc6b1c4acce115c4f1f deleted and replaced by tablet 77400db16a9e4924a820465ba858d4ef
I20251213 09:05:27.980865 19009 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35722:
name: "default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
@ 0x7ff3cabf6dcd google::LogMessage::Fail() at ??:0
I20251213 09:05:27.983384 19002 catalog_manager.cc:5941] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Sending DeleteTablet for 3 replicas of tablet 4828619293414834b2596a782008a5ed
I20251213 09:05:27.983661 19007 catalog_manager.cc:5941] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Sending DeleteTablet for 3 replicas of tablet e74f37bdb74e4102931e51914c24d217
I20251213 09:05:27.983687 19002 catalog_manager.cc:6724] ReplaceTablet: tablet 4828619293414834b2596a782008a5ed deleted and replaced by tablet ec0b4ab9fdbe40848097017c061c2393
I20251213 09:05:27.983872 19007 catalog_manager.cc:6724] ReplaceTablet: tablet e74f37bdb74e4102931e51914c24d217 deleted and replaced by tablet 0519a6b1a0e04c90a005adaf90992007
I20251213 09:05:27.984035 19007 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35722:
table { table_name: "default.Table_fd1d1908e83b4925a03e655168a92b9e" } modify_external_catalogs: true
I20251213 09:05:27.984146 19007 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35722:
table { table_name: "default.Table_fd1d1908e83b4925a03e655168a92b9e" } modify_external_catalogs: true
I20251213 09:05:27.983872 19002 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35722:
table { table_name: "default.Table_430d04b174a84f139dae2021743273d2" } modify_external_catalogs: true
I20251213 09:05:27.984416 19002 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35722:
table { table_name: "default.Table_430d04b174a84f139dae2021743273d2" } modify_external_catalogs: true
I20251213 09:05:27.984907 19003 catalog_manager.cc:5941] T 00000000000000000000000000000000 P d7f61ccb4ffd4066babfa94938e28b87: Sending DeleteTablet for 3 replicas of tablet c034dfd35b7b471a8343b1f4e62c4757
I20251213 09:05:27.985173 19003 catalog_manager.cc:6724] ReplaceTablet: tablet c034dfd35b7b471a8343b1f4e62c4757 deleted and replaced by tablet f67b495541524e01be263eabcdcbb0d0
I20251213 09:05:27.985333 19008 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35722:
table { table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" } modify_external_catalogs: true
I20251213 09:05:27.985440 19008 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35722:
table { table_name: "default.Table_b13c688f2da847468824aefa65d4c4ab" } modify_external_catalogs: true
@ 0x7ff3cabfab93 google::LogMessage::SendToLog() at ??:0
@ 0x7ff3cabf67cc google::LogMessage::Flush() at ??:0
@ 0x7ff3cabf6a11 google::LogMessage::~LogMessage() at ??:0
I20251213 09:05:27.989683 16938 tablet_service.cc:1552] Processing DeleteTablet for tablet 362edc0369024cc6b1c4acce115c4f1f with delete_type TABLET_DATA_DELETED (replaced by tablet 77400db16a9e4924a820465ba858d4ef) from {username='slave'} at 127.0.0.1:51490
I20251213 09:05:27.989848 16933 tablet_service.cc:1552] Processing DeleteTablet for tablet 4828619293414834b2596a782008a5ed with delete_type TABLET_DATA_DELETED (replaced by tablet ec0b4ab9fdbe40848097017c061c2393) from {username='slave'} at 127.0.0.1:51490
I20251213 09:05:27.989975 16936 tablet_service.cc:1552] Processing DeleteTablet for tablet e74f37bdb74e4102931e51914c24d217 with delete_type TABLET_DATA_DELETED (replaced by tablet 0519a6b1a0e04c90a005adaf90992007) from {username='slave'} at 127.0.0.1:51490
I20251213 09:05:27.990074 16935 tablet_service.cc:1552] Processing DeleteTablet for tablet c034dfd35b7b471a8343b1f4e62c4757 with delete_type TABLET_DATA_DELETED (replaced by tablet f67b495541524e01be263eabcdcbb0d0) from {username='slave'} at 127.0.0.1:51490
I20251213 09:05:27.985350 19003 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35722:
table { table_name: "default.Table_731dc67a6a2b407180abef538691c40c" } new_table_name: "default.Table_77ba98ea391f495daa07e314094f52c2" modify_external_catalogs: true
I20251213 09:05:27.991351 16797 tablet_service.cc:1552] Processing DeleteTablet for tablet 362edc0369024cc6b1c4acce115c4f1f with delete_type TABLET_DATA_DELETED (replaced by tablet 77400db16a9e4924a820465ba858d4ef) from {username='slave'} at 127.0.0.1:45592
I20251213 09:05:27.991384 16798 tablet_service.cc:1552] Processing DeleteTablet for tablet c034dfd35b7b471a8343b1f4e62c4757 with delete_type TABLET_DATA_DELETED (replaced by tablet f67b495541524e01be263eabcdcbb0d0) from {username='slave'} at 127.0.0.1:45592
I20251213 09:05:27.991568 16800 tablet_service.cc:1552] Processing DeleteTablet for tablet 4828619293414834b2596a782008a5ed with delete_type TABLET_DATA_DELETED (replaced by tablet ec0b4ab9fdbe40848097017c061c2393) from {username='slave'} at 127.0.0.1:45592
I20251213 09:05:27.991668 16801 tablet_service.cc:1552] Processing DeleteTablet for tablet e74f37bdb74e4102931e51914c24d217 with delete_type TABLET_DATA_DELETED (replaced by tablet 0519a6b1a0e04c90a005adaf90992007) from {username='slave'} at 127.0.0.1:45592
I20251213 09:05:27.992944 19316 tablet_replica.cc:333] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:27.993084 19316 raft_consensus.cc:2243] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:27.993196 19316 raft_consensus.cc:2272] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:27.993633 19316 ts_tablet_manager.cc:1916] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7ff3cfd6a279 kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20251213 09:05:27.996052 17071 tablet_service.cc:1552] Processing DeleteTablet for tablet 362edc0369024cc6b1c4acce115c4f1f with delete_type TABLET_DATA_DELETED (replaced by tablet 77400db16a9e4924a820465ba858d4ef) from {username='slave'} at 127.0.0.1:50960
I20251213 09:05:27.996248 19315 tablet_replica.cc:333] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:27.996423 19315 raft_consensus.cc:2243] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:27.996483 17069 tablet_service.cc:1552] Processing DeleteTablet for tablet 4828619293414834b2596a782008a5ed with delete_type TABLET_DATA_DELETED (replaced by tablet ec0b4ab9fdbe40848097017c061c2393) from {username='slave'} at 127.0.0.1:50960
I20251213 09:05:27.996572 19315 raft_consensus.cc:2272] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:27.997016 19315 ts_tablet_manager.cc:1916] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:27.997782 17066 tablet_service.cc:1552] Processing DeleteTablet for tablet c034dfd35b7b471a8343b1f4e62c4757 with delete_type TABLET_DATA_DELETED (replaced by tablet f67b495541524e01be263eabcdcbb0d0) from {username='slave'} at 127.0.0.1:50960
I20251213 09:05:27.998126 17067 tablet_service.cc:1552] Processing DeleteTablet for tablet e74f37bdb74e4102931e51914c24d217 with delete_type TABLET_DATA_DELETED (replaced by tablet 0519a6b1a0e04c90a005adaf90992007) from {username='slave'} at 127.0.0.1:50960
I20251213 09:05:27.998317 16801 tablet_service.cc:1505] Processing CreateTablet for tablet 77400db16a9e4924a820465ba858d4ef (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:27.998560 16801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77400db16a9e4924a820465ba858d4ef. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7ff3cfd69190 kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20251213 09:05:28.000012 19315 ts_tablet_manager.cc:1929] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.000084 19315 log.cc:1199] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/362edc0369024cc6b1c4acce115c4f1f
I20251213 09:05:28.000365 19315 ts_tablet_manager.cc:1950] T 362edc0369024cc6b1c4acce115c4f1f P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:28.001008 19315 tablet_replica.cc:333] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:28.001125 19317 tablet_replica.cc:333] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:28.001122 19315 raft_consensus.cc:2243] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:28.001210 19315 raft_consensus.cc:2272] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.001250 19317 raft_consensus.cc:2243] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:28.001451 19317 raft_consensus.cc:2272] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.001500 16935 tablet_service.cc:1505] Processing CreateTablet for tablet 77400db16a9e4924a820465ba858d4ef (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:28.001654 19316 ts_tablet_manager.cc:1929] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.001710 19316 log.cc:1199] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/362edc0369024cc6b1c4acce115c4f1f
I20251213 09:05:28.001785 16935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77400db16a9e4924a820465ba858d4ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:28.001963 19316 ts_tablet_manager.cc:1950] T 362edc0369024cc6b1c4acce115c4f1f P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:28.001955 19317 ts_tablet_manager.cc:1916] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.002233 18991 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 362edc0369024cc6b1c4acce115c4f1f (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]) successfully deleted
@ 0x7ff3cfd688f3 _ZZN4kudu6master30HmsNotificationLogListenerTask4InitEvENKUlvE_clEv at ??:0
I20251213 09:05:28.001518 19315 ts_tablet_manager.cc:1916] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.004588 17067 tablet_service.cc:1505] Processing CreateTablet for tablet 77400db16a9e4924a820465ba858d4ef (DEFAULT_TABLE table=default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:28.004665 19315 ts_tablet_manager.cc:1929] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.004719 19315 log.cc:1199] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/4828619293414834b2596a782008a5ed
I20251213 09:05:28.004768 19317 ts_tablet_manager.cc:1929] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.004835 17067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77400db16a9e4924a820465ba858d4ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:28.004844 19317 log.cc:1199] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/362edc0369024cc6b1c4acce115c4f1f
I20251213 09:05:28.004985 19315 ts_tablet_manager.cc:1950] T 4828619293414834b2596a782008a5ed P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:28.005173 19317 ts_tablet_manager.cc:1950] T 362edc0369024cc6b1c4acce115c4f1f P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
@ 0x7ff3cfd6dffa _ZNSt17_Function_handlerIFvvEZN4kudu6master30HmsNotificationLogListenerTask4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
I20251213 09:05:28.005561 19315 tablet_replica.cc:333] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:28.005687 19315 raft_consensus.cc:2243] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:28.005852 19317 tablet_replica.cc:333] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:28.006006 19317 raft_consensus.cc:2243] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:28.006111 19317 raft_consensus.cc:2272] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x55b262320a0a std::function<>::operator()() at ??:0
I20251213 09:05:28.006404 19316 tablet_replica.cc:333] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:28.006515 19317 ts_tablet_manager.cc:1916] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.006565 19316 raft_consensus.cc:2243] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:28.006768 19316 raft_consensus.cc:2272] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.007094 18992 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 362edc0369024cc6b1c4acce115c4f1f (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]) successfully deleted
I20251213 09:05:28.007283 19316 ts_tablet_manager.cc:1916] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.007447 18989 catalog_manager.cc:4985] TS 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): tablet 362edc0369024cc6b1c4acce115c4f1f (table default.table_6b013204511a4b49bd1c108904225841 [id=ac51e6353aeb41b7836d834c7a18946d]) successfully deleted
I20251213 09:05:28.007692 18991 catalog_manager.cc:4985] TS ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]) successfully deleted
I20251213 09:05:28.008957 19317 ts_tablet_manager.cc:1929] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
@ 0x7ff3cc0507dc kudu::Thread::SuperviseThread() at ??:0
I20251213 09:05:28.009028 19317 log.cc:1199] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/4828619293414834b2596a782008a5ed
I20251213 09:05:28.009294 19317 ts_tablet_manager.cc:1950] T 4828619293414834b2596a782008a5ed P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:28.009336 19316 ts_tablet_manager.cc:1929] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.009438 19316 log.cc:1199] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/c034dfd35b7b471a8343b1f4e62c4757
I20251213 09:05:28.010097 19320 tablet_bootstrap.cc:492] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:28.010843 19315 raft_consensus.cc:2272] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.011404 19320 tablet_bootstrap.cc:654] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
@ 0x7ff3cc8e96db start_thread at ??:0
I20251213 09:05:28.011232 19315 ts_tablet_manager.cc:1916] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.012331 19317 tablet_replica.cc:333] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:28.012358 19316 ts_tablet_manager.cc:1950] T c034dfd35b7b471a8343b1f4e62c4757 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:28.012486 19317 raft_consensus.cc:2243] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:28.012593 19317 raft_consensus.cc:2272] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.012988 19317 ts_tablet_manager.cc:1916] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7ff3c9dad71f clone at ??:0
I20251213 09:05:28.013396 18992 catalog_manager.cc:4985] TS 9714e48438da4ed8b629934850b1f7ce (127.15.213.3:40367): tablet 4828619293414834b2596a782008a5ed (table default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]) successfully deleted
I20251213 09:05:28.013865 19316 tablet_replica.cc:333] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:28.014012 19316 raft_consensus.cc:2243] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 1 LEADER]: Raft consensus shutting down.
I20251213 09:05:28.014170 17066 tablet_service.cc:1505] Processing CreateTablet for tablet 0519a6b1a0e04c90a005adaf90992007 (DEFAULT_TABLE table=default.table_bd51adb8915743138d7a842893d52f60 [id=73b5f4e0be40400a98d4a95538a99e1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:28.014223 19316 raft_consensus.cc:2272] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.014402 17066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0519a6b1a0e04c90a005adaf90992007. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:28.014564 19316 ts_tablet_manager.cc:1916] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.015354 17069 tablet_service.cc:1505] Processing CreateTablet for tablet ec0b4ab9fdbe40848097017c061c2393 (DEFAULT_TABLE table=default.table_731dc67a6a2b407180abef538691c40c [id=ddc2320ac07a41f5917210b36dbb05cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:28.015571 17069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0b4ab9fdbe40848097017c061c2393. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:28.015929 19317 ts_tablet_manager.cc:1929] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.015995 19317 log.cc:1199] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/c034dfd35b7b471a8343b1f4e62c4757
I20251213 09:05:28.016275 19317 ts_tablet_manager.cc:1950] T c034dfd35b7b471a8343b1f4e62c4757 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:28.016592 19316 ts_tablet_manager.cc:1929] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.016662 19316 log.cc:1199] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/4828619293414834b2596a782008a5ed
I20251213 09:05:28.016847 19320 tablet_bootstrap.cc:492] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:28.016929 19320 ts_tablet_manager.cc:1403] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251213 09:05:28.016950 19316 ts_tablet_manager.cc:1950] T 4828619293414834b2596a782008a5ed P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:28.017671 19319 tablet_bootstrap.cc:492] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152: Bootstrap starting.
I20251213 09:05:28.017623 19320 raft_consensus.cc:359] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.017745 19320 raft_consensus.cc:385] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:28.017783 19320 raft_consensus.cc:740] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:28.017902 19320 consensus_queue.cc:260] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.018756 19319 tablet_bootstrap.cc:654] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:28.019013 19315 ts_tablet_manager.cc:1929] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.019068 19315 log.cc:1199] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/e74f37bdb74e4102931e51914c24d217
I20251213 09:05:28.019375 19315 ts_tablet_manager.cc:1950] T e74f37bdb74e4102931e51914c24d217 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:28.019831 19317 tablet_replica.cc:333] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: stopping tablet replica
I20251213 09:05:28.019979 19315 tablet_replica.cc:333] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: stopping tablet replica
I20251213 09:05:28.020023 19317 raft_consensus.cc:2243] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:28.020097 19315 raft_consensus.cc:2243] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:28.020117 19317 raft_consensus.cc:2272] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.020198 19315 raft_consensus.cc:2272] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.020455 19317 ts_tablet_manager.cc:1916] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.020484 19315 ts_tablet_manager.cc:1916] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.021742 17067 tablet_service.cc:1505] Processing CreateTablet for tablet f67b495541524e01be263eabcdcbb0d0 (DEFAULT_TABLE table=default.table_430d04b174a84f139dae2021743273d2 [id=f49de92593644a14a779b22e01e511dd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251213 09:05:28.022010 17067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67b495541524e01be263eabcdcbb0d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251213 09:05:28.022956 19315 ts_tablet_manager.cc:1929] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.023029 19315 log.cc:1199] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-1/wal/wals/c034dfd35b7b471a8343b1f4e62c4757
I20251213 09:05:28.023240 19320 ts_tablet_manager.cc:1434] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20251213 09:05:28.023290 19315 ts_tablet_manager.cc:1950] T c034dfd35b7b471a8343b1f4e62c4757 P ba49ca51d8eb4be288091d19e7114792: Deleting consensus metadata
I20251213 09:05:28.023411 19320 tablet_bootstrap.cc:492] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:28.024374 19320 tablet_bootstrap.cc:654] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:28.025027 19324 tablet_bootstrap.cc:492] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792: Bootstrap starting.
I20251213 09:05:28.025480 19316 tablet_replica.cc:333] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: stopping tablet replica
I20251213 09:05:28.025610 19316 raft_consensus.cc:2243] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251213 09:05:28.025720 19316 raft_consensus.cc:2272] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251213 09:05:28.025940 19324 tablet_bootstrap.cc:654] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:28.026073 19316 ts_tablet_manager.cc:1916] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251213 09:05:28.025347 19320 tablet_bootstrap.cc:492] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:28.026355 19320 ts_tablet_manager.cc:1403] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:28.026794 19320 raft_consensus.cc:359] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.026885 19320 raft_consensus.cc:385] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:28.026913 19320 raft_consensus.cc:740] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:28.027242 19320 consensus_queue.cc:260] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.027454 19319 tablet_bootstrap.cc:492] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152: No bootstrap required, opened a new log
I20251213 09:05:28.027556 19319 ts_tablet_manager.cc:1403] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251213 09:05:28.028148 19319 raft_consensus.cc:359] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.028262 19319 raft_consensus.cc:385] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:28.028301 19319 raft_consensus.cc:740] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42c0ccabbfc1460685086e58e05cd152, State: Initialized, Role: FOLLOWER
I20251213 09:05:28.028448 19319 consensus_queue.cc:260] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.028838 19319 ts_tablet_manager.cc:1434] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:28.029306 19317 ts_tablet_manager.cc:1929] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.029364 19317 log.cc:1199] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-2/wal/wals/e74f37bdb74e4102931e51914c24d217
I20251213 09:05:28.029605 19317 ts_tablet_manager.cc:1950] T e74f37bdb74e4102931e51914c24d217 P 9714e48438da4ed8b629934850b1f7ce: Deleting consensus metadata
I20251213 09:05:28.031270 19316 ts_tablet_manager.cc:1929] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251213 09:05:28.031338 19316 log.cc:1199] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: Deleting WAL directory at /tmp/dist-test-taskyiO_0l/test-tmp/master-stress-test.2.CatalogManagerConfigurations_MasterStressTest.Test_2.1765616682970095-16212-0/minicluster-data/ts-0/wal/wals/e74f37bdb74e4102931e51914c24d217
I20251213 09:05:28.031747 19316 ts_tablet_manager.cc:1950] T e74f37bdb74e4102931e51914c24d217 P 42c0ccabbfc1460685086e58e05cd152: Deleting consensus metadata
I20251213 09:05:28.032573 19320 ts_tablet_manager.cc:1434] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251213 09:05:28.033368 19320 tablet_bootstrap.cc:492] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:28.034454 19320 tablet_bootstrap.cc:654] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:28.035722 19324 tablet_bootstrap.cc:492] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792: No bootstrap required, opened a new log
I20251213 09:05:28.035770 19320 tablet_bootstrap.cc:492] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:28.035856 19320 ts_tablet_manager.cc:1403] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251213 09:05:28.035943 19324 ts_tablet_manager.cc:1403] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251213 09:05:28.036332 19320 raft_consensus.cc:359] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.036435 19320 raft_consensus.cc:385] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:28.036466 19320 raft_consensus.cc:740] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:28.036463 19324 raft_consensus.cc:359] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.036542 19324 raft_consensus.cc:385] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:28.036564 19324 raft_consensus.cc:740] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba49ca51d8eb4be288091d19e7114792, State: Initialized, Role: FOLLOWER
I20251213 09:05:28.036607 19320 consensus_queue.cc:260] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.036880 19320 ts_tablet_manager.cc:1434] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251213 09:05:28.037094 19320 tablet_bootstrap.cc:492] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce: Bootstrap starting.
I20251213 09:05:28.038115 19320 tablet_bootstrap.cc:654] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce: Neither blocks nor log segments found. Creating new log.
I20251213 09:05:28.039249 19320 tablet_bootstrap.cc:492] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce: No bootstrap required, opened a new log
I20251213 09:05:28.039244 19324 consensus_queue.cc:260] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.039327 19320 ts_tablet_manager.cc:1403] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251213 09:05:28.039984 19320 raft_consensus.cc:359] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.040086 19320 raft_consensus.cc:385] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251213 09:05:28.040119 19320 raft_consensus.cc:740] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Initialized, Role: FOLLOWER
I20251213 09:05:28.040280 19320 consensus_queue.cc:260] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.040587 19320 ts_tablet_manager.cc:1434] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251213 09:05:28.042286 19324 ts_tablet_manager.cc:1434] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251213 09:05:28.048662 19186 raft_consensus.cc:493] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:28.048794 19186 raft_consensus.cc:515] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.049258 19186 leader_election.cc:290] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:28.049696 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77400db16a9e4924a820465ba858d4ef" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152" is_pre_election: true
I20251213 09:05:28.049825 16819 raft_consensus.cc:2468] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:28.049767 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77400db16a9e4924a820465ba858d4ef" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792" is_pre_election: true
I20251213 09:05:28.049930 16956 raft_consensus.cc:2468] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 0.
I20251213 09:05:28.050138 17026 leader_election.cc:304] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:28.050314 19186 raft_consensus.cc:2804] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251213 09:05:28.050372 19186 raft_consensus.cc:493] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251213 09:05:28.050412 19186 raft_consensus.cc:3060] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:28.051646 19186 raft_consensus.cc:515] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.052003 19186 leader_election.cc:290] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Requested vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
I20251213 09:05:28.052353 16819 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77400db16a9e4924a820465ba858d4ef" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "42c0ccabbfc1460685086e58e05cd152"
I20251213 09:05:28.052452 16819 raft_consensus.cc:3060] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:28.052436 16956 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77400db16a9e4924a820465ba858d4ef" candidate_uuid: "9714e48438da4ed8b629934850b1f7ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba49ca51d8eb4be288091d19e7114792"
I20251213 09:05:28.052556 16956 raft_consensus.cc:3060] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792 [term 0 FOLLOWER]: Advancing to term 1
I20251213 09:05:28.053422 16819 raft_consensus.cc:2468] T 77400db16a9e4924a820465ba858d4ef P 42c0ccabbfc1460685086e58e05cd152 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:28.053717 17026 leader_election.cc:304] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42c0ccabbfc1460685086e58e05cd152, 9714e48438da4ed8b629934850b1f7ce; no voters:
I20251213 09:05:28.053719 16956 raft_consensus.cc:2468] T 77400db16a9e4924a820465ba858d4ef P ba49ca51d8eb4be288091d19e7114792 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9714e48438da4ed8b629934850b1f7ce in term 1.
I20251213 09:05:28.053879 19186 raft_consensus.cc:2804] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 1 FOLLOWER]: Leader election won for term 1
I20251213 09:05:28.053964 19186 raft_consensus.cc:697] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [term 1 LEADER]: Becoming Leader. State: Replica: 9714e48438da4ed8b629934850b1f7ce, State: Running, Role: LEADER
I20251213 09:05:28.054106 19186 consensus_queue.cc:237] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } }
I20251213 09:05:28.174404 19171 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:28.174551 19171 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.175001 19171 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:28.176054 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:05:28.176146 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:05:28.176218 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:28.176482 19340 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:05:28.185585 16754 connection.cc:537] server connection from 127.0.0.1:45592 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:28.185606 16893 connection.cc:537] server connection from 127.0.0.1:51490 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:28.185707 17026 connection.cc:537] server connection from 127.0.0.1:50960 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:28.186194 16757 connection.cc:537] client connection to 127.15.213.60:37605 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:28.186321 16894 connection.cc:537] client connection to 127.15.213.60:37605 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:28.187088 17029 connection.cc:537] client connection to 127.15.213.60:37605 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:28.187798 17149 connection.cc:537] client connection to 127.15.213.60:37605 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251213 09:05:28.188203 17149 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.60:37605)
W20251213 09:05:28.188354 17149 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.15.213.60:37605)
W20251213 09:05:28.188462 17149 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.15.213.60:37605)
W20251213 09:05:28.188563 17149 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.15.213.60:37605)
W20251213 09:05:28.189152 19183 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:28.187650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.60:37605 (local address 127.15.213.3:33371)
1213 09:05:28.187843 (+ 193us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:28.187858 (+ 15us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:28.187936 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:28.189054 (+ 1118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":106}
W20251213 09:05:28.189433 19280 negotiation.cc:337] Failed RPC negotiation. Trace:
1213 09:05:28.187088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.15.213.60:37605 (local address 127.15.213.2:53971)
1213 09:05:28.187619 (+ 531us) negotiation.cc:107] Waiting for socket to connect
1213 09:05:28.187636 (+ 17us) client_negotiation.cc:174] Beginning negotiation
1213 09:05:28.187730 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1213 09:05:28.189322 (+ 1592us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":442}
I20251213 09:05:28.212322 19340 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:28.212489 19340 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.212994 19340 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:28.213902 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:05:28.214063 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:05:28.214143 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:28.214290 19340 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:28.284092 19340 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:28.284241 19340 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:28.284710 19340 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:28.285521 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:05:28.285862 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:05:28.285935 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:28.286089 19340 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:28.508960 19343 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:28.509083 19343 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:28.509498 19343 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:28.510562 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:28.616851 19171 consensus_queue.cc:1048] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251213 09:05:28.620497 19339 consensus_queue.cc:1048] T 77400db16a9e4924a820465ba858d4ef P 9714e48438da4ed8b629934850b1f7ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251213 09:05:28.632251 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 21: this message will repeat every 5th retry.
W20251213 09:05:29.043993 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Timed out: connection negotiation to 127.15.213.60:37605 for RPC RequestConsensusVote timed out after 0.532s (ON_OUTBOUND_QUEUE)
I20251213 09:05:29.044111 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:29.044481 19356 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20251213 09:05:29.211702 17149 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.15.213.60:37605)
I20251213 09:05:29.458453 16212 master-stress-test.cc:577] Killing test thread 1/25
I20251213 09:05:29.683192 19368 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:29.683344 19368 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:29.683873 19368 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:29.684999 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:29.685261 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:29.685324 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:29.685469 19368 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:29.722922 19339 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:29.723081 19339 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:29.723568 19339 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:29.724275 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:05:29.724359 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:05:29.724455 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:29.724607 19339 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:29.979012 19339 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:29.979159 19339 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:29.979616 19339 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:29.980180 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:05:29.980264 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:05:29.980311 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:29.980436 19339 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:30.290647 19171 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:30.290772 19171 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:30.291155 19171 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:30.291683 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:05:30.293581 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:05:30.293658 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:30.293826 19171 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:30.568307 19377 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:30.568439 19377 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:30.568862 19377 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:30.570058 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:30.570150 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:30.570226 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:30.570363 19377 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:31.667907 19397 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:31.668032 19397 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:31.668394 19397 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:31.669521 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:31.669709 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:31.669792 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:31.669936 19397 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:31.982656 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:31.982770 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:31.985267 19339 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:31.985373 19339 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:31.985749 19339 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:31.986351 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:05:31.986442 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:05:31.986557 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:31.986701 19339 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:33.099874 19409 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:33.100010 19409 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:33.100453 19409 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:33.101212 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:05:33.101298 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:05:33.101392 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:33.101529 19409 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:05:33.315028 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 26: this message will repeat every 5th retry.
I20251213 09:05:33.610268 19415 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:33.610387 19415 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:33.610749 19415 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:33.611366 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:05:33.611519 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:05:33.611603 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:33.611748 19415 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:33.865132 19427 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:33.865283 19427 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:33.865711 19427 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:33.866276 19206 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111) [suppressed 8 similar messages]
W20251213 09:05:33.866910 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:33.867007 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:33.867079 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:33.867303 19427 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:34.882917 19445 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:34.883059 19445 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:34.883554 19445 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:34.884824 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:34.884907 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:05:34.884968 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:34.885089 19445 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:36.274997 19462 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:36.275141 19462 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:36.275646 19462 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:36.276297 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:05:36.276383 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:05:36.276484 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:36.276620 19462 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:36.983811 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:36.983953 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:37.984939 19455 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:37.985077 19455 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:37.985477 19455 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:37.986131 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:05:37.986289 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:05:37.986358 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:37.986502 19455 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:38.017436 19455 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:38.017589 19455 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:38.017939 19455 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:38.018594 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:05:38.018682 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:05:38.018743 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:38.018874 19455 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:05:38.185108 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 31: this message will repeat every 5th retry.
I20251213 09:05:38.443779 19443 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:38.443912 19443 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:38.444271 19443 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:38.444895 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:05:38.445004 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:05:38.445099 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:38.445230 19443 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:39.122123 19498 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:39.122243 19498 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:39.122694 19498 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:39.123298 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20251213 09:05:39.124094 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:39.124173 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:39.124236 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:39.124356 19498 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:41.280766 19526 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:41.280907 19526 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:41.281306 19526 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:41.282392 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:41.282480 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:41.282553 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:41.282677 19526 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:41.984725 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:41.984848 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:42.011029 19542 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:42.011204 19542 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:42.011597 19542 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:42.012324 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:05:42.012429 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:05:42.012519 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:42.012678 19542 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:05:42.988487 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 36: this message will repeat every 5th retry.
I20251213 09:05:43.496464 19557 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:43.496579 19557 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:43.496981 19557 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:43.497474 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:05:43.497560 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:05:43.497615 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:43.497738 19557 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:45.586426 19573 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:45.586552 19573 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:45.586961 19573 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:45.587687 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:05:45.587770 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:05:45.587828 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:45.587993 19573 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:46.985941 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:46.986083 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:05:47.463748 19617 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:47.463878 19617 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:47.464285 19617 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:47.464905 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:05:47.465003 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:05:47.465091 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:47.465209 19617 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:05:48.274974 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 41: this message will repeat every 5th retry.
I20251213 09:05:49.022130 19617 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:49.022253 19617 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:49.022655 19617 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:49.023308 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:05:49.023396 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:05:49.023505 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:49.023674 19617 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:51.851013 19685 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:05:51.851155 19685 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:05:51.851622 19685 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:05:51.852136 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20251213 09:05:51.852842 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:51.853139 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:05:51.853204 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:05:51.853344 19685 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:05:51.986944 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:51.987056 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:05:53.154188 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 46: this message will repeat every 5th retry.
I20251213 09:05:54.124877 19695 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:54.125061 19695 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:54.125712 19695 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:54.126655 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:05:54.126760 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:05:54.126814 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:54.126981 19695 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:56.562948 19734 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:05:56.563087 19734 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:05:56.563520 19734 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:05:56.564242 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:05:56.564332 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:05:56.564453 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:05:56.564602 19734 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:05:56.988266 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:05:56.988425 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:05:57.994976 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 51: this message will repeat every 5th retry.
W20251213 09:05:58.685626 16869 heartbeater.cc:646] Failed to heartbeat to 127.15.213.62:42117 (93 consecutive failures): Network error: Failed to ping master at 127.15.213.62:42117: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:05:58.974854 17139 heartbeater.cc:646] Failed to heartbeat to 127.15.213.60:37605 (92 consecutive failures): Network error: Failed to ping master at 127.15.213.60:37605: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:05:59.186877 17004 heartbeater.cc:646] Failed to heartbeat to 127.15.213.60:37605 (65 consecutive failures): Network error: Failed to ping master at 127.15.213.60:37605: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:06:01.393262 19805 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:01.393399 19805 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:01.393836 19805 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:01.394629 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:06:01.394730 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:06:01.394790 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:01.394941 19805 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:01.989390 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:01.989506 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:02.768633 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 56: this message will repeat every 5th retry.
I20251213 09:06:05.871910 19868 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:05.872054 19868 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:05.872437 19868 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:05.873113 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:06:05.873238 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:06:05.873328 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:05.873461 19868 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:06.990413 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:06.990532 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:06:07.215271 19868 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:07.215402 19868 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:07.215821 19868 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:07.216428 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:06:07.216526 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:06:07.216606 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:07.216727 19868 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:07.402740 19888 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:06:07.402913 19888 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:06:07.403470 19888 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:06:07.403998 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:06:07.404740 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:06:07.404836 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:06:07.404917 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:06:07.405077 19888 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20251213 09:06:07.820576 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 61: this message will repeat every 5th retry.
I20251213 09:06:11.991623 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:11.991748 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:12.979086 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 66: this message will repeat every 5th retry.
I20251213 09:06:14.239183 19977 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:14.239300 19977 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:14.239760 19977 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:14.240350 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:06:14.240435 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:06:14.240520 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:14.240672 19977 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:15.676296 19959 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:15.676431 19959 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:15.676849 19959 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:15.677438 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:06:15.677526 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:06:15.677619 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:15.677750 19959 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:16.992753 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:16.992882 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:17.837954 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 71: this message will repeat every 5th retry.
I20251213 09:06:18.530083 20033 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:06:18.530226 20033 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:06:18.530690 20033 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:06:18.531339 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:06:18.532066 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:06:18.532164 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:06:18.532243 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:06:18.532367 20033 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:06:18.967676 20021 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:18.967826 20021 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:18.968286 20021 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:18.968995 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:06:18.969084 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:06:18.969166 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:18.969285 20021 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:21.993916 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:21.994052 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:22.917228 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 76: this message will repeat every 5th retry.
I20251213 09:06:26.995213 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:26.995360 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:27.767627 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 81: this message will repeat every 5th retry.
I20251213 09:06:31.996196 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:31.996332 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:32.574595 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 86: this message will repeat every 5th retry.
I20251213 09:06:33.017985 20218 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:33.018113 20218 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:33.018697 20218 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:33.019400 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:06:33.019614 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:06:33.019701 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:33.019836 20218 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:33.939232 20235 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:06:33.939378 20235 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:06:33.939918 20235 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:06:33.940457 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:06:33.941293 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:06:33.941632 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:06:33.941704 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:06:33.941841 20235 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:06:34.084245 20239 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:34.084388 20239 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:34.084844 20239 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:34.085531 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:06:34.085623 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:06:34.085711 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:34.085872 20239 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:36.997375 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:36.997500 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:37.570806 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 91: this message will repeat every 5th retry.
I20251213 09:06:38.277057 20300 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:38.277182 20300 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:38.277531 20300 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:38.278122 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:06:38.278216 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:06:38.278303 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:38.278441 20300 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:41.998621 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:41.998741 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:42.320595 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 96: this message will repeat every 5th retry.
I20251213 09:06:46.999842 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:46.999948 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:06:47.272873 20412 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:06:47.273020 20412 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:06:47.273455 20412 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:06:47.273962 19206 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:06:47.274861 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:06:47.274941 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:06:47.275033 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:06:47.275238 20412 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20251213 09:06:47.355216 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 101: this message will repeat every 5th retry.
I20251213 09:06:48.134601 20425 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:48.134768 20425 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:48.135396 20425 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:48.136125 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:06:48.136214 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:06:48.136286 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:48.136423 20425 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:51.096737 20446 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:51.096884 20446 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:51.097384 20446 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:51.098157 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:06:51.098263 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:06:51.098328 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:51.098459 20446 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:52.000972 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:52.001097 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:52.071805 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 106: this message will repeat every 5th retry.
I20251213 09:06:52.647647 20469 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:52.647797 20469 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:52.648229 20469 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:52.648836 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:06:52.648916 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:06:52.649034 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:52.649180 20469 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:06:52.702116 20469 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:06:52.702273 20469 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:06:52.702754 20469 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:06:52.703500 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:06:52.703585 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:06:52.703671 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:06:52.703816 20469 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:06:56.632004 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 111: this message will repeat every 5th retry.
I20251213 09:06:57.002135 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:06:57.002275 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:06:58.818739 16869 heartbeater.cc:646] Failed to heartbeat to 127.15.213.62:42117 (213 consecutive failures): Network error: Failed to ping master at 127.15.213.62:42117: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:06:59.277552 17139 heartbeater.cc:646] Failed to heartbeat to 127.15.213.60:37605 (269 consecutive failures): Network error: Failed to ping master at 127.15.213.60:37605: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:06:59.320034 17005 heartbeater.cc:646] Failed to heartbeat to 127.15.213.62:42117 (218 consecutive failures): Network error: Failed to ping master at 127.15.213.62:42117: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:07:01.294956 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 116: this message will repeat every 5th retry.
I20251213 09:07:02.003244 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:02.003382 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:07:02.999159 20608 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:02.999316 20608 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:02.999791 20608 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:03.000578 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:07:03.000663 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:07:03.000754 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:03.000897 20608 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:03.495702 20621 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:07:03.495852 20621 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:07:03.496454 20621 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:07:03.496989 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:07:03.497586 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:07:03.497684 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:07:03.497758 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:07:03.497890 20621 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:07:03.714855 20611 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:03.714975 20611 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:03.715503 20611 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:03.716150 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:07:03.716230 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:07:03.716290 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:03.716421 20611 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:07:06.542086 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 121: this message will repeat every 5th retry.
I20251213 09:07:07.004561 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:07.004673 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:07:09.562515 20691 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:09.562641 20691 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:09.562996 20691 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:09.563627 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:07:09.563738 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:07:09.563835 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:09.563980 20691 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:11.157990 20727 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:11.158144 20727 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:11.158548 20727 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:11.159317 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:07:11.159417 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:07:11.159489 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:11.159669 20727 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:12.005712 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:12.005863 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:07:12.116238 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 126: this message will repeat every 5th retry.
I20251213 09:07:16.082178 20802 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:07:16.082352 20802 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:07:16.082835 20802 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:07:16.083389 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:07:16.084028 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:07:16.084144 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:07:16.084218 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:07:16.084350 20802 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:07:17.010380 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:17.010501 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:07:17.041998 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 131: this message will repeat every 5th retry.
I20251213 09:07:21.104656 20855 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:21.104823 20855 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:21.105445 20855 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:21.106215 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:07:21.106299 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:07:21.106369 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:21.106516 20855 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:07:21.649288 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 136: this message will repeat every 5th retry.
I20251213 09:07:22.011754 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:22.011893 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:07:22.020673 20776 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:22.020785 20776 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:22.021174 20776 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:22.021752 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:07:22.021853 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:07:22.021909 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:22.022029 20776 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:26.774683 20934 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:26.774828 20934 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:26.775367 20934 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:26.776047 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:07:26.776132 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:07:26.776232 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:26.776412 20934 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:27.012931 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:27.013054 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:07:27.071401 20934 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:27.071527 20934 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:27.071888 20934 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:27.072436 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:07:27.072518 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:07:27.072623 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:27.072782 20934 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:27.209722 19208 maintenance_manager.cc:419] P f0ef4ffe02ab44248dc97cb1c5cceac1: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033399
I20251213 09:07:27.263684 19207 maintenance_manager.cc:643] P f0ef4ffe02ab44248dc97cb1c5cceac1: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.053s user 0.016s sys 0.006s Metrics: {"bytes_written":49037,"cfile_init":1,"dirs.queue_time_us":198,"dirs.run_cpu_time_us":226,"dirs.run_wall_time_us":1040,"drs_written":1,"lbm_read_time_us":51,"lbm_reads_lt_1ms":4,"lbm_write_time_us":532,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":139,"thread_start_us":166,"threads_started":2,"wal-append.queue_time_us":173}
I20251213 09:07:27.264706 19208 maintenance_manager.cc:419] P f0ef4ffe02ab44248dc97cb1c5cceac1: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11757 bytes on disk
I20251213 09:07:27.265357 19207 maintenance_manager.cc:643] P f0ef4ffe02ab44248dc97cb1c5cceac1: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":73,"lbm_reads_lt_1ms":4}
W20251213 09:07:27.353631 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 141: this message will repeat every 5th retry.
I20251213 09:07:28.344152 20964 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:28.344300 20964 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:28.344766 20964 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:28.345491 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:07:28.345582 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:07:28.345677 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:28.345871 20964 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:31.107895 21002 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:31.108009 21002 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:31.108413 21002 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:31.108908 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:07:31.108985 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:07:31.109040 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:31.109158 21002 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:32.014118 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:32.014241 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:07:32.272867 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 146: this message will repeat every 5th retry.
I20251213 09:07:33.533155 21032 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:07:33.533318 21032 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:07:33.533861 21032 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:07:33.534394 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:07:33.535014 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:07:33.535089 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:07:33.535195 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:07:33.535356 21032 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:07:37.015312 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:37.015460 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:07:37.053611 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 151: this message will repeat every 5th retry.
I20251213 09:07:37.151027 21095 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:37.151196 21095 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:37.151753 21095 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:37.152509 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:07:37.152611 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:07:37.152698 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:37.152843 21095 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:38.381165 21110 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:38.381318 21110 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:38.381732 21110 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:38.382490 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:07:38.382576 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:07:38.382685 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:38.382826 21110 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:42.016695 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:42.016837 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:07:42.339267 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 156: this message will repeat every 5th retry.
I20251213 09:07:47.018050 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:47.018200 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:07:47.316637 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 161: this message will repeat every 5th retry.
I20251213 09:07:51.021375 21300 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:51.021497 21300 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:51.021907 21300 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:51.022562 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:07:51.022658 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:07:51.022744 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:51.022877 21300 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:51.091313 21300 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:51.091450 21300 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:51.091893 21300 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:51.092641 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:07:51.092727 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:07:51.092840 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:51.092957 21300 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:51.300194 21334 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:07:51.300348 21334 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:07:51.300844 21334 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:07:51.301384 19206 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:07:51.301386 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:07:51.302115 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:07:51.302191 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:07:51.302250 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:07:51.302404 21334 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:07:52.019179 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:52.019356 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:07:52.438472 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 166: this message will repeat every 5th retry.
I20251213 09:07:52.652437 21364 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:07:52.652567 21364 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:07:52.652928 21364 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:07:52.654209 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:07:52.654384 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:07:52.654461 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:07:52.654650 21364 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:07:56.768522 21390 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:07:56.768651 21390 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:07:56.769105 21390 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:07:56.769750 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:07:56.769841 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:07:56.769922 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:07:56.770066 21390 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:07:57.020363 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:07:57.020484 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:07:57.426097 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 171: this message will repeat every 5th retry.
W20251213 09:07:58.945454 16869 heartbeater.cc:646] Failed to heartbeat to 127.15.213.62:42117 (333 consecutive failures): Network error: Failed to ping master at 127.15.213.62:42117: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:07:59.298826 17140 heartbeater.cc:646] Failed to heartbeat to 127.15.213.62:42117 (497 consecutive failures): Network error: Failed to ping master at 127.15.213.62:42117: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:07:59.446729 17005 heartbeater.cc:646] Failed to heartbeat to 127.15.213.62:42117 (338 consecutive failures): Network error: Failed to ping master at 127.15.213.62:42117: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:08:01.651381 21506 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:01.651496 21506 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:01.651855 21506 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:01.652441 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:08:01.652520 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:08:01.652568 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:01.652719 21506 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:02.021485 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:02.021620 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:02.097059 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 176: this message will repeat every 5th retry.
I20251213 09:08:02.263509 21529 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:08:02.263630 21529 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:08:02.263975 21529 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:08:02.264432 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20251213 09:08:02.265202 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:08:02.265277 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:08:02.265354 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:08:02.265472 21529 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:08:03.166435 21538 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:03.166610 21538 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:03.167011 21538 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:03.168042 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:08:03.168149 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:08:03.168211 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:03.168365 21538 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:08:07.005399 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 181: this message will repeat every 5th retry.
I20251213 09:08:07.022640 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:07.022763 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:08:09.413158 21646 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:09.413276 21646 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:09.413710 21646 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:09.414336 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:08:09.414418 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:08:09.414500 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:09.414652 21646 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:12.023833 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:12.023949 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:12.336623 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 186: this message will repeat every 5th retry.
I20251213 09:08:15.678617 21698 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:15.678748 21698 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:15.679232 21698 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:15.679989 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:08:15.680107 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:08:15.680169 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:15.680290 21698 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:15.730839 21698 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:15.730965 21698 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:15.731554 21698 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:15.732048 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:08:15.732146 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:08:15.732210 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:15.732338 21698 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:17.025105 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:17.025219 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:17.062999 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 191: this message will repeat every 5th retry.
I20251213 09:08:18.514003 21785 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:18.514142 21785 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:18.514611 21785 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:18.515309 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:08:18.515431 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:08:18.515492 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:18.515615 21785 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:21.315980 21843 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:08:21.316123 21843 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:08:21.316654 21843 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:08:21.317271 19206 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:08:21.317972 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:08:21.318045 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:08:21.318142 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:08:21.318344 21843 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:08:22.026227 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:22.026345 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:22.055477 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 196: this message will repeat every 5th retry.
I20251213 09:08:27.027391 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:27.027554 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:27.272159 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 201: this message will repeat every 5th retry.
I20251213 09:08:32.028542 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:32.028674 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:32.381475 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 206: this message will repeat every 5th retry.
I20251213 09:08:33.440268 22045 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:33.440425 22045 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:33.440976 22045 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:33.441713 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:08:33.441846 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:08:33.441923 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:33.442066 22045 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:34.238281 22065 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:34.238462 22065 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:34.238909 22065 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:34.239624 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:08:34.239705 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:08:34.239795 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:34.239921 22065 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:36.054991 22103 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:08:36.055099 22103 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:08:36.055511 22103 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:08:36.055930 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:08:36.056576 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:08:36.056715 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:08:36.056797 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:08:36.056929 22103 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:08:37.030256 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:37.030445 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:37.311209 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 211: this message will repeat every 5th retry.
I20251213 09:08:37.786525 22128 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:37.786695 22128 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:37.787213 22128 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:37.787946 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:08:37.788036 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:08:37.788137 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:37.788277 22128 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:42.031541 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:42.031663 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:42.414230 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 216: this message will repeat every 5th retry.
I20251213 09:08:42.556053 22154 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:42.556196 22154 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:42.556640 22154 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:42.557353 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:08:42.557523 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:08:42.557581 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:42.557753 22154 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:45.114375 22263 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:08:45.114524 22263 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:08:45.115005 22263 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:08:45.115617 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:08:45.116350 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:08:45.116439 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:08:45.116524 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:08:45.116677 22263 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:08:45.117975 22154 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:45.118072 22154 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:45.118468 22154 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:45.119153 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:08:45.119385 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:08:45.119531 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:45.119736 22154 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:08:47.032773 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:47.032898 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:08:47.683202 22276 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:47.683331 22276 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:47.683764 22276 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:47.684329 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:08:47.684412 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:08:47.684515 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:47.684652 22276 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:08:47.768584 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 221: this message will repeat every 5th retry.
I20251213 09:08:52.034039 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:52.034188 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:08:52.665308 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 226: this message will repeat every 5th retry.
I20251213 09:08:53.177604 22399 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:08:53.177747 22399 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:08:53.178202 22399 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:08:53.178764 19206 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:08:53.179477 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:08:53.179569 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:08:53.179656 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:08:53.179780 22399 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:08:57.035267 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:08:57.035392 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:08:57.482995 22463 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:08:57.483170 22463 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:08:57.483714 22463 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:08:57.484555 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:08:57.484697 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:08:57.484762 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:08:57.484941 22463 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:08:58.149242 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 231: this message will repeat every 5th retry.
W20251213 09:08:59.077044 16868 heartbeater.cc:646] Failed to heartbeat to 127.15.213.60:37605 (422 consecutive failures): Network error: Failed to ping master at 127.15.213.60:37605: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:08:59.561704 17140 heartbeater.cc:646] Failed to heartbeat to 127.15.213.62:42117 (683 consecutive failures): Network error: Failed to ping master at 127.15.213.62:42117: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:08:59.578159 17004 heartbeater.cc:646] Failed to heartbeat to 127.15.213.60:37605 (425 consecutive failures): Network error: Failed to ping master at 127.15.213.60:37605: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:09:00.795979 22532 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:00.796128 22532 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:00.796553 22532 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:00.797080 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:09:00.797715 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:09:00.797796 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:09:00.797874 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:00.798019 22532 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:09:01.171365 22537 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:01.171556 22537 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:01.172014 22537 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:01.172719 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:09:01.172818 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:09:01.172919 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:01.173074 22537 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:02.036561 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:02.036721 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:09:03.449494 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 236: this message will repeat every 5th retry.
I20251213 09:09:04.268690 22590 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:04.268829 22590 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:04.269191 22590 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:04.269773 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:09:04.269887 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:09:04.269987 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:04.270123 22590 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:04.610852 22590 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:04.610980 22590 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:04.611388 22590 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:04.612077 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:09:04.612186 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:09:04.612308 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:04.612464 22590 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:07.038246 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:07.038386 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:08.082945 22642 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:08.083096 22642 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:08.083585 22642 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:08.084309 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:09:08.084398 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:09:08.084465 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:08.084610 22642 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:09:08.919971 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 241: this message will repeat every 5th retry.
I20251213 09:09:09.996236 22695 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:09.996369 22695 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:09.996786 22695 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:09.997336 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:09:09.997963 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:09:09.998054 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:09:09.998136 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:09.998274 22695 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:09:12.039636 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:12.039798 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:13.543063 22747 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:13.543198 22747 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:13.543773 22747 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:13.544342 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:09:13.544422 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:09:13.544478 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:13.544608 22747 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:14.003083 22747 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:14.003252 22747 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:14.003682 22747 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:14.004439 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:09:14.004526 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:09:14.004631 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:14.004765 22747 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:09:14.245213 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 246: this message will repeat every 5th retry.
I20251213 09:09:16.748585 22794 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:16.748725 22794 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:16.749135 22794 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:16.749562 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:09:16.750126 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:09:16.750198 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:09:16.750269 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:16.750382 22794 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:09:17.040829 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:17.040952 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:18.516430 22822 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:18.516557 22822 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:18.516952 22822 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:18.518040 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:09:18.518496 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:09:18.518575 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:18.518731 22822 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20251213 09:09:19.229242 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 251: this message will repeat every 5th retry.
I20251213 09:09:21.816653 22854 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:21.816776 22854 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:21.817150 22854 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:21.817770 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:09:21.817849 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:09:21.817917 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:21.818038 22854 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:22.041893 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:22.042009 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:22.853255 22881 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:22.853381 22881 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:22.853804 22881 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:22.854517 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:09:22.854606 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:09:22.854714 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:22.854897 22881 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:23.529335 22881 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:23.529459 22881 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:23.529816 22881 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:23.530370 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:09:23.530465 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:09:23.530561 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:23.530718 22881 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:09:24.368400 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 256: this message will repeat every 5th retry.
I20251213 09:09:27.042955 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:27.043066 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:09:29.692426 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 261: this message will repeat every 5th retry.
I20251213 09:09:31.153363 23013 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:31.153501 23013 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:31.154047 23013 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:31.154605 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:09:31.154801 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:09:31.154877 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:31.155010 23013 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:32.044051 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:32.044178 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:32.799290 23047 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:32.799422 23047 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:32.799769 23047 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:32.800442 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:09:32.800531 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:09:32.800745 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:32.800921 23047 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:33.917649 23061 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:33.917804 23061 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:33.918238 23061 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:33.919080 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:09:33.919191 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:09:33.919386 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:33.919566 23061 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:09:35.012722 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 266: this message will repeat every 5th retry.
I20251213 09:09:35.600672 23101 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:35.600805 23101 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:35.601244 23101 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:35.601918 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:09:35.602007 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:09:35.602100 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:35.602254 23101 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:37.045092 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:37.045212 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:37.323091 23132 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:37.323253 23132 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:37.323868 23132 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:37.324352 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20251213 09:09:37.325089 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:09:37.325172 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:09:37.325263 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:37.325410 23132 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20251213 09:09:40.031783 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 271: this message will repeat every 5th retry.
I20251213 09:09:41.582798 23196 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:41.582950 23196 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:41.583455 23196 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:41.584626 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:09:41.584723 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:09:41.584801 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:41.584930 23196 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:09:42.046066 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:42.046181 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:42.164217 23207 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:42.164455 23207 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:42.165024 23207 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:42.165856 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:09:42.165982 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:09:42.166065 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:42.166215 23207 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:42.179567 23213 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:42.179826 23213 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:42.180294 23213 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:42.181430 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:09:42.181530 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:09:42.181622 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:42.181814 23213 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20251213 09:09:45.124643 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 276: this message will repeat every 5th retry.
I20251213 09:09:45.948191 23271 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:45.948393 23271 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:45.948971 23271 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:45.949605 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:09:45.949689 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:09:45.949760 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:45.949959 23271 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:47.047221 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:47.047377 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:50.281157 23353 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:50.281287 23353 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:50.281683 23353 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:50.282217 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20251213 09:09:50.282882 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:09:50.282967 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
I20251213 09:09:50.283062 19206 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:50.283226 23353 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:09:50.441040 23345 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:50.441181 23345 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:50.441864 23345 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:50.442715 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:09:50.442811 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:09:50.442862 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:50.443037 23345 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:09:50.568850 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 281: this message will repeat every 5th retry.
I20251213 09:09:52.048317 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:52.048430 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:09:55.456987 23430 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:09:55.457149 23430 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:09:55.457576 23430 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:09:55.458175 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:09:55.458799 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:09:55.458882 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:09:55.458961 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:09:55.459100 23430 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20251213 09:09:55.595595 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 286: this message will repeat every 5th retry.
I20251213 09:09:55.670534 23436 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:09:55.670660 23436 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:09:55.671016 23436 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:09:55.671654 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:09:55.671742 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:09:55.671854 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:09:55.672000 23436 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:09:57.049324 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:09:57.049444 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:09:59.203308 16869 heartbeater.cc:646] Failed to heartbeat to 127.15.213.62:42117 (573 consecutive failures): Network error: Failed to ping master at 127.15.213.62:42117: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
W20251213 09:09:59.630285 17139 heartbeater.cc:646] Failed to heartbeat to 127.15.213.60:37605 (821 consecutive failures): Network error: Failed to ping master at 127.15.213.60:37605: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:09:59.704306 17004 heartbeater.cc:646] Failed to heartbeat to 127.15.213.60:37605 (545 consecutive failures): Network error: Failed to ping master at 127.15.213.60:37605: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:10:00.073438 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 291: this message will repeat every 5th retry.
I20251213 09:10:01.913967 23509 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:01.914115 23509 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:01.914489 23509 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:01.915309 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:10:01.915401 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:10:01.915504 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:01.915652 23509 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:10:02.050486 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:10:02.050629 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:10:02.108510 23509 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:02.108657 23509 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:02.109081 23509 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:02.109628 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:10:02.109723 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:10:02.109813 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:02.109961 23509 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:10:03.938387 23509 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:03.938504 23509 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:03.938903 23509 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:03.939538 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:10:03.939618 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:10:03.939687 17028 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:03.939864 23509 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:10:04.179461 23509 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:04.179621 23509 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:04.180078 23509 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:04.180732 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:10:04.180816 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:10:04.180904 17026 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:04.181035 23509 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:10:04.761721 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 296: this message will repeat every 5th retry.
I20251213 09:10:04.897290 23568 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:04.897406 23568 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:04.897778 23568 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:04.898392 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:10:04.898473 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:10:04.898530 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:04.898654 23568 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:10:07.051602 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:10:07.051725 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251213 09:10:09.768055 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 301: this message will repeat every 5th retry.
I20251213 09:10:10.299144 23655 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:10:10.299297 23655 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:10:10.299774 23655 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:10:10.300390 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:10:10.301137 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:10:10.301225 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:10:10.301311 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:10:10.301445 23655 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:10:12.052755 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:10:12.052904 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:10:12.529299 23684 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:12.529444 23684 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:12.529927 23684 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:12.530632 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:10:12.530712 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:10:12.530794 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:12.530923 23684 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:10:14.511374 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 306: this message will repeat every 5th retry.
I20251213 09:10:17.053856 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:10:17.053980 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:10:18.456617 23713 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:18.456790 23713 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:18.457211 23713 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:18.457880 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:10:18.457981 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:10:18.458096 17026 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:18.458240 23713 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:10:19.345410 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 311: this message will repeat every 5th retry.
I20251213 09:10:22.054958 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:10:22.055074 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:10:22.926841 23841 raft_consensus.cc:493] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader d7f61ccb4ffd4066babfa94938e28b87)
I20251213 09:10:22.927011 23841 raft_consensus.cc:515] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fe04e8d31ac4cd9bca8f96335ff1982" member_type: VOTER last_known_addr { host: "127.15.213.62" port: 42117 } } peers { permanent_uuid: "f0ef4ffe02ab44248dc97cb1c5cceac1" member_type: VOTER last_known_addr { host: "127.15.213.61" port: 38171 } } peers { permanent_uuid: "d7f61ccb4ffd4066babfa94938e28b87" member_type: VOTER last_known_addr { host: "127.15.213.60" port: 37605 } }
I20251213 09:10:22.927488 23841 leader_election.cc:290] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117), d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605)
W20251213 09:10:22.928005 19203 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20251213 09:10:22.928642 19206 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer d7f61ccb4ffd4066babfa94938e28b87 (127.15.213.60:37605): Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:10:22.928721 19203 leader_election.cc:336] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8fe04e8d31ac4cd9bca8f96335ff1982 (127.15.213.62:42117): Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111)
I20251213 09:10:22.928813 19203 leader_election.cc:304] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0ef4ffe02ab44248dc97cb1c5cceac1; no voters: 8fe04e8d31ac4cd9bca8f96335ff1982, d7f61ccb4ffd4066babfa94938e28b87
I20251213 09:10:22.928947 23841 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f0ef4ffe02ab44248dc97cb1c5cceac1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20251213 09:10:23.125013 23713 raft_consensus.cc:493] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:23.125149 23713 raft_consensus.cc:515] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:23.125532 23713 leader_election.cc:290] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:23.126169 17026 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
W20251213 09:10:23.126255 17028 leader_election.cc:343] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: ec0b4ab9fdbe40848097017c061c2393
I20251213 09:10:23.126339 17028 leader_election.cc:304] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:23.126502 23713 raft_consensus.cc:2749] T ec0b4ab9fdbe40848097017c061c2393 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:10:23.807560 23820 raft_consensus.cc:493] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:23.807721 23820 raft_consensus.cc:515] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:23.808183 23820 leader_election.cc:290] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:23.808987 17028 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
W20251213 09:10:23.809080 17026 leader_election.cc:343] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: f67b495541524e01be263eabcdcbb0d0
I20251213 09:10:23.809160 17026 leader_election.cc:304] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:23.809329 23820 raft_consensus.cc:2749] T f67b495541524e01be263eabcdcbb0d0 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251213 09:10:23.901803 17026 consensus_peers.cc:597] T 8a9c4e8b224d440dbab9d693bbba9e37 P 9714e48438da4ed8b629934850b1f7ce -> Peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Couldn't send request to peer 42c0ccabbfc1460685086e58e05cd152. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a9c4e8b224d440dbab9d693bbba9e37. This is attempt 316: this message will repeat every 5th retry.
I20251213 09:10:25.590881 23820 raft_consensus.cc:493] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251213 09:10:25.591050 23820 raft_consensus.cc:515] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42c0ccabbfc1460685086e58e05cd152" member_type: VOTER last_known_addr { host: "127.15.213.1" port: 45147 } } peers { permanent_uuid: "9714e48438da4ed8b629934850b1f7ce" member_type: VOTER last_known_addr { host: "127.15.213.3" port: 40367 } } peers { permanent_uuid: "ba49ca51d8eb4be288091d19e7114792" member_type: VOTER last_known_addr { host: "127.15.213.2" port: 38345 } }
I20251213 09:10:25.591507 23820 leader_election.cc:290] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147), ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345)
W20251213 09:10:25.591991 17026 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 42c0ccabbfc1460685086e58e05cd152 (127.15.213.1:45147): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
W20251213 09:10:25.592201 17028 leader_election.cc:343] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ba49ca51d8eb4be288091d19e7114792 (127.15.213.2:38345): Not found: Tablet not found: 0519a6b1a0e04c90a005adaf90992007
I20251213 09:10:25.592293 17028 leader_election.cc:304] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9714e48438da4ed8b629934850b1f7ce; no voters: 42c0ccabbfc1460685086e58e05cd152, ba49ca51d8eb4be288091d19e7114792
I20251213 09:10:25.592435 23820 raft_consensus.cc:2749] T 0519a6b1a0e04c90a005adaf90992007 P 9714e48438da4ed8b629934850b1f7ce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251213 09:10:27.056231 19185 master_runner.cc:186] Error getting master registration for 127.15.213.62:42117: Network error: Client connection negotiation failed: client connection to 127.15.213.62:42117: connect: Connection refused (error 111),
I20251213 09:10:27.056381 19185 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251213 09:10:28.013217 19208 maintenance_manager.cc:419] P f0ef4ffe02ab44248dc97cb1c5cceac1: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11757 bytes on disk
I20251213 09:10:28.015928 19207 maintenance_manager.cc:643] P f0ef4ffe02ab44248dc97cb1c5cceac1: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s user 0.001s sys 0.002s Metrics: {"dirs.queue_time_us":199,"thread_start_us":142,"threads_started":2,"wal-append.queue_time_us":175}
W20251213 09:10:28.224694 17148 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:10:28.224864 17148 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:10:28.224903 17148 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
W20251213 09:10:28.224920 17148 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
F20251213 09:10:28.235406 17168 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
*** Aborted at 1765617028 (unix time) try "date -d @1765617028" if you are using GNU date ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)T*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800003f54) received by PID 16212 (TID 0x7fdd65af5700) from PID 16212; stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7fdd80953980 (unknown) at ??:0
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17158 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2dc90a5c5ed546fc91a933d1157d4271 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17158 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2dc90a5c5ed546fc91a933d1157d4271 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242532 17169 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17158 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2dc90a5c5ed546fc91a933d1157d4271 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242532 17169 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242540 17165 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17158 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2dc90a5c5ed546fc91a933d1157d4271 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242532 17169 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242540 17165 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243743 17178 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired @ 0x7fdd7e4b5fb7 gsignal
: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17158 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2dc90a5c5ed546fc91a933d1157d4271 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242532 17169 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242540 17165 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243743 17178 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243850 17173 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17158 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2dc90a5c5ed546fc91a933d1157d4271 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242532 17169 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242540 17165 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243743 17178 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243850 17173 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243851 17172 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243959 17160 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a211b679083e4e4294bf4c97874b2d60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.245010 17171 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17158 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2dc90a5c5ed546fc91a933d1157d4271 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242532 17169 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242540 17165 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243743 17178 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243850 17173 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243851 17172 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243959 17160 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a211b679083e4e4294bf4c97874b2d60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.245010 17171 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20251213 09:10:28.235466 17170 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235432 17154 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_82ff078f92894308a9243b01684306d0 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235508 17155 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a19aae3ffc1441ad9d2a8082df491a94 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.235591 17167 master-stress-test.cc:328] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237658 17174 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.237777 17161 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_e3c10aee5e2044a5b15b49197906acde on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:2F .20251213 9:10:28.237756 17153 master-stress-test.cc17156 :aster-stress-test.cc:297] 297Check failed: _s.ok() Bad status: Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_af6c4a1282d24b2283671da41b9b0400 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_a2f7bd9749b14ffcaf60f3fcfe79088e on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.F38976 20251213 9:10:28.238955 17162 master-stress-test.cc:297] 17164 master-stress-test.cc:Check failed: _s.ok() Bad status: 297] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)Timed out: Error creating table default.Table_cfb419171a574069b4e41856a31a16f7 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240160 17166 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240163 17177 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240258 17176 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.240377 17163 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_9b48a97fa9d7493e90bdd14e64693cdf on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17159 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_39e762e539224330b4bfb1f52c75c017 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242550 17175 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242478 17158 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_2dc90a5c5ed546fc91a933d1157d4271 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242532 17169 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.242540 17165 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243743 17178 master-stress-test.cc:391] Check failed: _s.ok() Bad status: Timed out: ReplaceTablet timed out after deadline expired: ReplaceTablet passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243850 17173 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243851 17172 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.243959 17160 master-stress-test.cc:297] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_a211b679083e4e4294bf4c97874b2d60 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)F20251213 09:10:28.245010 17171 master-stress-test.cc:351] Check failed: _s.ok() Bad status: Timed out: DeleteTable timed out after deadline expired: DeleteTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.15.213.62:42117,127.15.213.61:38171,127.15.213.60:37605, num_attempts: 770) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.15.213.60:37605: connect: Connection refused (error 111)
*** Check failure stack trace: ***
@ 0x7fdd7e4b7921 abort at ??:0
@ 0x7fdd7f31edcd google::LogMessage::Fail() at ??:0
@ 0x7fdd7f322b93 google::LogMessage::SendToLog() at ??:0
@ 0x7fdd7f31e7cc google::LogMessage::Flush() at ??:0
@ 0x7fdd7f31ff59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x55645dde8327 kudu::MasterStressTest::AlterTableThread() at ??:0
@ 0x55645ddfaa04 std::__invoke_impl<>() at ??:0
@ 0x55645ddf8740 std::__invoke<>() at ??:0
@ 0x55645ddffd91 _ZNSt6thread8_InvokerISt5tupleIJMN4kudu16MasterStressTestEFvvEPNS2_26MasterStressTest_Test_TestEEEE9_M_invokeIJLm0ELm1EEEEDTcl8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at ??:0
@ 0x55645ddfed95 std::thread::_Invoker<>::operator()() at ??:0
@ 0x55645ddfdb12 std::thread::_State_impl<>::_M_run() at ??:0
@ 0x7fdd7eb3d6df (unknown) at ??:0
@ 0x7fdd809486db start_thread at ??:0
@ 0x7fdd7e59871f clone at ??:0