Note: This is test shard 4 of 8.
[==========] Running 3 tests from 3 test suites.
[----------] Global test environment set-up.
[----------] 1 test from AllTypesItest/1, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)3> >
[ RUN ] AllTypesItest/1.TestTimestampPadding
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 20:57:56.008850 27563 test_util.cc:268] Using random seed: -680173747
2026-08-12T20:57:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:57:56Z Disabled control of system clock
I20260812 20:57:56.027640 27563 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
/tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.234.254:39269
--webserver_interface=127.26.234.254
--webserver_port=0
--builtin_ntp_servers=127.26.234.212:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.234.254:39269 with env {}
W20260812 20:57:56.132966 27571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:57:56.133208 27571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:57:56.133229 27571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:57:56.134440 27571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:57:56.134476 27571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:57:56.134490 27571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:57:56.134502 27571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:57:56.136034 27571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.234.212:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.234.254:39269
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.234.254:39269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.234.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.27571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:57:56.136379 27571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:57:56.136770 27571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:57:56.144767 27579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:56.144773 27578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:56.144868 27571 server_base.cc:1034] running on GCE node
W20260812 20:57:56.145128 27581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:56.145478 27571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:57:56.145856 27571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:57:56.147033 27571 hybrid_clock.cc:648] HybridClock initialized: now 1786568276147022 us; error 63 us; skew 500 ppm
I20260812 20:57:56.159605 27571 webserver.cc:460] Webserver started at http://127.26.234.254:32813/ using document root <none> and password file <none>
I20260812 20:57:56.160079 27571 fs_manager.cc:359] Metadata directory not provided
I20260812 20:57:56.160174 27571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:57:56.160375 27571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:57:56.161846 27571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/instance:
uuid: "1bab88402b9d4b6e918c26c424c52b4e"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.162482 27571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal/instance:
uuid: "1bab88402b9d4b6e918c26c424c52b4e"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.164671 27571 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260812 20:57:56.165879 27587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.166285 27571 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:57:56.166427 27571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
uuid: "1bab88402b9d4b6e918c26c424c52b4e"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.166543 27571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:57:56.176550 27571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:57:56.177107 27571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:57:56.177315 27571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:57:56.189985 27571 rpc_server.cc:307] RPC server started. Bound to: 127.26.234.254:39269
I20260812 20:57:56.190188 27640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.234.254:39269 every 8 connection(s)
I20260812 20:57:56.190881 27571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/info.pb
I20260812 20:57:56.192454 27641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.195235 27563 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu as pid 27571
I20260812 20:57:56.195384 27563 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal/instance
I20260812 20:57:56.197721 27641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e: Bootstrap starting.
I20260812 20:57:56.199479 27641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.200268 27641 log.cc:824] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e: Log is configured to *not* fsync() on all Append() calls
I20260812 20:57:56.201330 27641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e: No bootstrap required, opened a new log
I20260812 20:57:56.206650 27641 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bab88402b9d4b6e918c26c424c52b4e" member_type: VOTER last_known_addr { host: "127.26.234.254" port: 39269 } }
I20260812 20:57:56.206880 27641 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.206947 27641 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bab88402b9d4b6e918c26c424c52b4e, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.207166 27641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bab88402b9d4b6e918c26c424c52b4e" member_type: VOTER last_known_addr { host: "127.26.234.254" port: 39269 } }
I20260812 20:57:56.207337 27641 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 20:57:56.207381 27641 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 20:57:56.207442 27641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:56.208482 27641 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bab88402b9d4b6e918c26c424c52b4e" member_type: VOTER last_known_addr { host: "127.26.234.254" port: 39269 } }
I20260812 20:57:56.208696 27641 leader_election.cc:302] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bab88402b9d4b6e918c26c424c52b4e; no voters:
I20260812 20:57:56.209075 27641 leader_election.cc:288] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260812 20:57:56.209139 27646 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:57:56.209607 27646 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [term 1 LEADER]: Becoming Leader. State: Replica: 1bab88402b9d4b6e918c26c424c52b4e, State: Running, Role: LEADER
I20260812 20:57:56.209733 27641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 20:57:56.209838 27646 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bab88402b9d4b6e918c26c424c52b4e" member_type: VOTER last_known_addr { host: "127.26.234.254" port: 39269 } }
I20260812 20:57:56.210804 27648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bab88402b9d4b6e918c26c424c52b4e. Latest consensus state: current_term: 1 leader_uuid: "1bab88402b9d4b6e918c26c424c52b4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bab88402b9d4b6e918c26c424c52b4e" member_type: VOTER last_known_addr { host: "127.26.234.254" port: 39269 } } }
I20260812 20:57:56.210891 27647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bab88402b9d4b6e918c26c424c52b4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bab88402b9d4b6e918c26c424c52b4e" member_type: VOTER last_known_addr { host: "127.26.234.254" port: 39269 } } }
I20260812 20:57:56.210939 27648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [sys.catalog]: This master's current role is: LEADER
I20260812 20:57:56.210992 27647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e [sys.catalog]: This master's current role is: LEADER
I20260812 20:57:56.212373 27652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 20:57:56.214547 27652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 20:57:56.217422 27652 catalog_manager.cc:1347] Generated new cluster ID: 175719d51e034f5e960cfc4d2dea1f45
I20260812 20:57:56.217483 27652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 20:57:56.231164 27652 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 20:57:56.232120 27652 catalog_manager.cc:1504] Loading token signing keys...
I20260812 20:57:56.245786 27652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bab88402b9d4b6e918c26c424c52b4e: Generated new TSK 0
I20260812 20:57:56.246026 27652 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 20:57:56.250103 27563 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
/tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.234.193:0
--local_ip_for_outbound_sockets=127.26.234.193
--webserver_interface=127.26.234.193
--webserver_port=0
--tserver_master_addrs=127.26.234.254:39269
--builtin_ntp_servers=127.26.234.212:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
W20260812 20:57:56.368765 27666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:57:56.369041 27666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:57:56.369094 27666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:57:56.370770 27666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:57:56.370859 27666 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260812 20:57:56.370913 27666 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260812 20:57:56.370958 27666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.234.193
I20260812 20:57:56.372587 27666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.234.212:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.234.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.26.234.193
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.26.234.254:39269
--never_fsync=true
--heap_profile_path=/tmp/kudu.27666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.234.193
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:57:56.372957 27666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:57:56.373275 27666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:57:56.379032 27671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:56.379026 27672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:56.379274 27674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:56.379539 27666 server_base.cc:1034] running on GCE node
I20260812 20:57:56.379776 27666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:57:56.380128 27666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:57:56.381292 27666 hybrid_clock.cc:648] HybridClock initialized: now 1786568276381281 us; error 29 us; skew 500 ppm
I20260812 20:57:56.382814 27666 webserver.cc:460] Webserver started at http://127.26.234.193:34541/ using document root <none> and password file <none>
I20260812 20:57:56.383092 27666 fs_manager.cc:359] Metadata directory not provided
I20260812 20:57:56.383164 27666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:57:56.383327 27666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:57:56.384456 27666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data/instance:
uuid: "b02f2d29b5db41c19d893a4729e948ec"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.384927 27666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/wal/instance:
uuid: "b02f2d29b5db41c19d893a4729e948ec"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.386454 27666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260812 20:57:56.387382 27680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.387645 27666 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260812 20:57:56.387774 27666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data,/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/wal
uuid: "b02f2d29b5db41c19d893a4729e948ec"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.387864 27666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:57:56.405721 27666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:57:56.406100 27666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:57:56.406266 27666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:57:56.406663 27666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:57:56.407232 27666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:57:56.407336 27666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.407370 27666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:57:56.407387 27666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.422816 27666 rpc_server.cc:307] RPC server started. Bound to: 127.26.234.193:41581
I20260812 20:57:56.423010 27795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.234.193:41581 every 8 connection(s)
I20260812 20:57:56.423597 27666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data/info.pb
I20260812 20:57:56.427660 27563 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu as pid 27666
I20260812 20:57:56.427798 27563 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/wal/instance
I20260812 20:57:56.429817 27563 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
/tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.234.194:0
--local_ip_for_outbound_sockets=127.26.234.194
--webserver_interface=127.26.234.194
--webserver_port=0
--tserver_master_addrs=127.26.234.254:39269
--builtin_ntp_servers=127.26.234.212:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
I20260812 20:57:56.434173 27796 heartbeater.cc:347] Connected to a master server at 127.26.234.254:39269
I20260812 20:57:56.434356 27796 heartbeater.cc:464] Registering TS with master...
I20260812 20:57:56.434592 27796 heartbeater.cc:511] Master 127.26.234.254:39269 requested a full tablet report, sending...
I20260812 20:57:56.435662 27604 ts_manager.cc:194] Registered new tserver with Master: b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581)
I20260812 20:57:56.436710 27604 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.234.193:48247
W20260812 20:57:56.578763 27799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:57:56.579137 27799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:57:56.579190 27799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:57:56.581059 27799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:57:56.581182 27799 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260812 20:57:56.581210 27799 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260812 20:57:56.581260 27799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.234.194
I20260812 20:57:56.583526 27799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.234.212:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.234.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.26.234.194
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.26.234.254:39269
--never_fsync=true
--heap_profile_path=/tmp/kudu.27799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.234.194
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:57:56.583977 27799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:57:56.584489 27799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:57:56.592271 27806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:56.592254 27808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:56.592334 27805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:56.592726 27799 server_base.cc:1034] running on GCE node
I20260812 20:57:56.593007 27799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:57:56.593269 27799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:57:56.594463 27799 hybrid_clock.cc:648] HybridClock initialized: now 1786568276594432 us; error 49 us; skew 500 ppm
I20260812 20:57:56.596297 27799 webserver.cc:460] Webserver started at http://127.26.234.194:44401/ using document root <none> and password file <none>
I20260812 20:57:56.596650 27799 fs_manager.cc:359] Metadata directory not provided
I20260812 20:57:56.596736 27799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:57:56.596925 27799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:57:56.598282 27799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data/instance:
uuid: "bcfb4b7b35a241299a2490b9a5fc33f4"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.598793 27799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/wal/instance:
uuid: "bcfb4b7b35a241299a2490b9a5fc33f4"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.600756 27799 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260812 20:57:56.602029 27814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.602309 27799 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260812 20:57:56.602473 27799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data,/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/wal
uuid: "bcfb4b7b35a241299a2490b9a5fc33f4"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.602579 27799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:57:56.616914 27799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:57:56.617810 27799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:57:56.618188 27799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:57:56.618911 27799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:57:56.619571 27799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:57:56.619628 27799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.619664 27799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:57:56.619762 27799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.643411 27799 rpc_server.cc:307] RPC server started. Bound to: 127.26.234.194:45219
I20260812 20:57:56.643577 27928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.234.194:45219 every 8 connection(s)
I20260812 20:57:56.644119 27799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data/info.pb
I20260812 20:57:56.651546 27563 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu as pid 27799
I20260812 20:57:56.651706 27563 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/wal/instance
I20260812 20:57:56.653492 27563 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
/tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.26.234.195:0
--local_ip_for_outbound_sockets=127.26.234.195
--webserver_interface=127.26.234.195
--webserver_port=0
--tserver_master_addrs=127.26.234.254:39269
--builtin_ntp_servers=127.26.234.212:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
I20260812 20:57:56.654196 27929 heartbeater.cc:347] Connected to a master server at 127.26.234.254:39269
I20260812 20:57:56.654333 27929 heartbeater.cc:464] Registering TS with master...
I20260812 20:57:56.654557 27929 heartbeater.cc:511] Master 127.26.234.254:39269 requested a full tablet report, sending...
I20260812 20:57:56.655190 27604 ts_manager.cc:194] Registered new tserver with Master: bcfb4b7b35a241299a2490b9a5fc33f4 (127.26.234.194:45219)
I20260812 20:57:56.655824 27604 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.234.194:45151
W20260812 20:57:56.779192 27932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:57:56.779470 27932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:57:56.779517 27932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:57:56.780972 27932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:57:56.781028 27932 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260812 20:57:56.781041 27932 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260812 20:57:56.781061 27932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.26.234.195
I20260812 20:57:56.782430 27932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.234.212:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.26.234.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.26.234.195
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.26.234.254:39269
--never_fsync=true
--heap_profile_path=/tmp/kudu.27932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.26.234.195
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:57:56.782648 27932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:57:56.783007 27932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:57:56.790118 27939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:56.790153 27941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:57:56.790274 27938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:57:56.790602 27932 server_base.cc:1034] running on GCE node
I20260812 20:57:56.790829 27932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:57:56.791167 27932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:57:56.792364 27932 hybrid_clock.cc:648] HybridClock initialized: now 1786568276792343 us; error 51 us; skew 500 ppm
I20260812 20:57:56.794396 27932 webserver.cc:460] Webserver started at http://127.26.234.195:38347/ using document root <none> and password file <none>
I20260812 20:57:56.794672 27932 fs_manager.cc:359] Metadata directory not provided
I20260812 20:57:56.794745 27932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:57:56.794905 27932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:57:56.796181 27932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data/instance:
uuid: "3758c4edffa44cdda65e0a5c41fa6252"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.796593 27932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/wal/instance:
uuid: "3758c4edffa44cdda65e0a5c41fa6252"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.798194 27932 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260812 20:57:56.799185 27947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.799391 27932 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:57:56.799500 27932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data,/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/wal
uuid: "3758c4edffa44cdda65e0a5c41fa6252"
format_stamp: "Formatted at 2026-08-12 20:57:56 on dist-test-slave-bxbt"
I20260812 20:57:56.799577 27932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:57:56.820871 27932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:57:56.821519 27932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:57:56.821753 27932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:57:56.822188 27932 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 20:57:56.822686 27932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 20:57:56.822752 27932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.822791 27932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 20:57:56.822844 27932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.840282 27932 rpc_server.cc:307] RPC server started. Bound to: 127.26.234.195:37311
I20260812 20:57:56.840372 28061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.234.195:37311 every 8 connection(s)
I20260812 20:57:56.840901 27932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data/info.pb
I20260812 20:57:56.846354 27563 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu as pid 27932
I20260812 20:57:56.846438 27563 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/wal/instance
I20260812 20:57:56.848274 28062 heartbeater.cc:347] Connected to a master server at 127.26.234.254:39269
I20260812 20:57:56.848395 28062 heartbeater.cc:464] Registering TS with master...
I20260812 20:57:56.848582 28062 heartbeater.cc:511] Master 127.26.234.254:39269 requested a full tablet report, sending...
I20260812 20:57:56.848999 27604 ts_manager.cc:194] Registered new tserver with Master: 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
I20260812 20:57:56.849342 27604 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.26.234.195:54223
I20260812 20:57:56.859231 27563 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 20:57:56.868036 27604 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32836:
name: "all-types-table"
schema {
columns {
name: "key"
type: INT16
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int8_val"
type: INT8
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int16_val"
type: INT16
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int32_val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int64_val"
type: INT64
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "timestamp_val"
type: UNIXTIME_MICROS
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "date_val"
type: DATE
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "varchar_val"
type: VARCHAR
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
length: 65535
}
immutable: false
}
columns {
name: "bool_val"
type: BOOL
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "float_val"
type: FLOAT
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "double_val"
type: DOUBLE
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "binary_val"
type: BINARY
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "decimal32_val"
type: DECIMAL32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
precision: 9
scale: 0
}
immutable: false
}
columns {
name: "decimal64_val"
type: DECIMAL64
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
precision: 18
scale: 0
}
immutable: false
}
columns {
name: "decimal128_val"
type: DECIMAL128
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
precision: 38
scale: 0
}
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000\000\000\252*\004\001\000\000\000TU"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 20:57:56.870270 27604 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table all-types-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 20:57:56.879354 27729 tablet_service.cc:1467] Processing CreateTablet for tablet 2595e5db48f448c7ac339d12c0407172 (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION 10922 <= VALUES < 21844
I20260812 20:57:56.879962 27729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2595e5db48f448c7ac339d12c0407172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.880077 27863 tablet_service.cc:1467] Processing CreateTablet for tablet 446b52f8cef84a9ea9b6ae2f075d2b6c (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION VALUES < 10922
I20260812 20:57:56.880062 27862 tablet_service.cc:1467] Processing CreateTablet for tablet 2595e5db48f448c7ac339d12c0407172 (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION 10922 <= VALUES < 21844
I20260812 20:57:56.880574 27862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2595e5db48f448c7ac339d12c0407172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.880770 27863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446b52f8cef84a9ea9b6ae2f075d2b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.883508 28079 tablet_bootstrap.cc:492] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec: Bootstrap starting.
I20260812 20:57:56.883738 27728 tablet_service.cc:1467] Processing CreateTablet for tablet f8a7dfb94f8e45f4bffeb235fe6f94ca (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION 21844 <= VALUES
I20260812 20:57:56.883965 27728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8a7dfb94f8e45f4bffeb235fe6f94ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.885251 28079 tablet_bootstrap.cc:654] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.886324 28079 log.cc:824] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec: Log is configured to *not* fsync() on all Append() calls
I20260812 20:57:56.887283 27861 tablet_service.cc:1467] Processing CreateTablet for tablet f8a7dfb94f8e45f4bffeb235fe6f94ca (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION 21844 <= VALUES
I20260812 20:57:56.887418 27861 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8a7dfb94f8e45f4bffeb235fe6f94ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.887475 28079 tablet_bootstrap.cc:492] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec: No bootstrap required, opened a new log
I20260812 20:57:56.887527 28079 ts_tablet_manager.cc:1397] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260812 20:57:56.888883 27996 tablet_service.cc:1467] Processing CreateTablet for tablet 446b52f8cef84a9ea9b6ae2f075d2b6c (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION VALUES < 10922
I20260812 20:57:56.889341 27996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446b52f8cef84a9ea9b6ae2f075d2b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.889375 27730 tablet_service.cc:1467] Processing CreateTablet for tablet 446b52f8cef84a9ea9b6ae2f075d2b6c (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION VALUES < 10922
I20260812 20:57:56.889539 27730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 446b52f8cef84a9ea9b6ae2f075d2b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.891693 28081 tablet_bootstrap.cc:492] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4: Bootstrap starting.
I20260812 20:57:56.891654 28079 raft_consensus.cc:348] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.891857 28079 raft_consensus.cc:374] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.891896 28079 raft_consensus.cc:729] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02f2d29b5db41c19d893a4729e948ec, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.892069 28079 consensus_queue.cc:260] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.892467 28079 ts_tablet_manager.cc:1428] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260812 20:57:56.892515 28081 tablet_bootstrap.cc:654] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.892534 27796 heartbeater.cc:503] Master 127.26.234.254:39269 was elected leader, sending a full tablet report...
I20260812 20:57:56.892598 28079 tablet_bootstrap.cc:492] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec: Bootstrap starting.
I20260812 20:57:56.893455 28081 log.cc:824] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4: Log is configured to *not* fsync() on all Append() calls
I20260812 20:57:56.893741 28079 tablet_bootstrap.cc:654] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.893777 27995 tablet_service.cc:1467] Processing CreateTablet for tablet 2595e5db48f448c7ac339d12c0407172 (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION 10922 <= VALUES < 21844
I20260812 20:57:56.893918 27995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2595e5db48f448c7ac339d12c0407172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.894374 28084 tablet_bootstrap.cc:492] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252: Bootstrap starting.
I20260812 20:57:56.895198 28079 tablet_bootstrap.cc:492] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec: No bootstrap required, opened a new log
I20260812 20:57:56.895267 28079 ts_tablet_manager.cc:1397] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260812 20:57:56.895431 28079 raft_consensus.cc:348] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.895505 28079 raft_consensus.cc:374] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.895539 28079 raft_consensus.cc:729] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02f2d29b5db41c19d893a4729e948ec, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.895578 28079 consensus_queue.cc:260] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.895666 28079 ts_tablet_manager.cc:1428] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.895767 28079 tablet_bootstrap.cc:492] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec: Bootstrap starting.
I20260812 20:57:56.895824 28084 tablet_bootstrap.cc:654] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.888846 27994 tablet_service.cc:1467] Processing CreateTablet for tablet f8a7dfb94f8e45f4bffeb235fe6f94ca (DEFAULT_TABLE table=all-types-table [id=92359d5827f34c86b13118c2e6a02d18]), partition=RANGE (key) PARTITION 21844 <= VALUES
I20260812 20:57:56.896265 27994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8a7dfb94f8e45f4bffeb235fe6f94ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 20:57:56.896451 28079 tablet_bootstrap.cc:654] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.896607 28084 log.cc:824] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252: Log is configured to *not* fsync() on all Append() calls
I20260812 20:57:56.899382 28084 tablet_bootstrap.cc:492] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252: No bootstrap required, opened a new log
I20260812 20:57:56.899442 28079 tablet_bootstrap.cc:492] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec: No bootstrap required, opened a new log
I20260812 20:57:56.899468 28084 ts_tablet_manager.cc:1397] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260812 20:57:56.899510 28079 ts_tablet_manager.cc:1397] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260812 20:57:56.899645 28079 raft_consensus.cc:348] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.899760 28079 raft_consensus.cc:374] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.899793 28079 raft_consensus.cc:729] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b02f2d29b5db41c19d893a4729e948ec, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.899840 28079 consensus_queue.cc:260] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.899953 28079 ts_tablet_manager.cc:1428] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260812 20:57:56.900094 28081 tablet_bootstrap.cc:492] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4: No bootstrap required, opened a new log
I20260812 20:57:56.900157 28081 ts_tablet_manager.cc:1397] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260812 20:57:56.901353 28084 raft_consensus.cc:348] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.901469 28084 raft_consensus.cc:374] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.901489 28084 raft_consensus.cc:729] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3758c4edffa44cdda65e0a5c41fa6252, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.901574 28084 consensus_queue.cc:260] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.901597 28081 raft_consensus.cc:348] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.901731 28081 raft_consensus.cc:374] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.901752 28081 raft_consensus.cc:729] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcfb4b7b35a241299a2490b9a5fc33f4, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.901855 28081 consensus_queue.cc:260] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.901891 28084 ts_tablet_manager.cc:1428] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260812 20:57:56.901904 28062 heartbeater.cc:503] Master 127.26.234.254:39269 was elected leader, sending a full tablet report...
I20260812 20:57:56.901984 28084 tablet_bootstrap.cc:492] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252: Bootstrap starting.
I20260812 20:57:56.902201 28081 ts_tablet_manager.cc:1428] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260812 20:57:56.902256 27929 heartbeater.cc:503] Master 127.26.234.254:39269 was elected leader, sending a full tablet report...
I20260812 20:57:56.902289 28081 tablet_bootstrap.cc:492] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4: Bootstrap starting.
I20260812 20:57:56.902405 28084 tablet_bootstrap.cc:654] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.902740 28081 tablet_bootstrap.cc:654] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.903169 28084 tablet_bootstrap.cc:492] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252: No bootstrap required, opened a new log
I20260812 20:57:56.903268 28084 ts_tablet_manager.cc:1397] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260812 20:57:56.903461 28084 raft_consensus.cc:348] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.903551 28084 raft_consensus.cc:374] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.903568 28084 raft_consensus.cc:729] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3758c4edffa44cdda65e0a5c41fa6252, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.903635 28084 consensus_queue.cc:260] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.903664 28081 tablet_bootstrap.cc:492] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4: No bootstrap required, opened a new log
I20260812 20:57:56.903748 28084 ts_tablet_manager.cc:1428] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.903802 28084 tablet_bootstrap.cc:492] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252: Bootstrap starting.
I20260812 20:57:56.903786 28081 ts_tablet_manager.cc:1397] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:57:56.904062 28081 raft_consensus.cc:348] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.904158 28081 raft_consensus.cc:374] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.904182 28081 raft_consensus.cc:729] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcfb4b7b35a241299a2490b9a5fc33f4, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.904235 28081 consensus_queue.cc:260] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.904337 28081 ts_tablet_manager.cc:1428] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.904429 28081 tablet_bootstrap.cc:492] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4: Bootstrap starting.
I20260812 20:57:56.904564 28084 tablet_bootstrap.cc:654] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.904943 28081 tablet_bootstrap.cc:654] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4: Neither blocks nor log segments found. Creating new log.
I20260812 20:57:56.905668 28084 tablet_bootstrap.cc:492] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252: No bootstrap required, opened a new log
I20260812 20:57:56.905732 28084 ts_tablet_manager.cc:1397] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:57:56.905890 28084 raft_consensus.cc:348] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.905920 28081 tablet_bootstrap.cc:492] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4: No bootstrap required, opened a new log
I20260812 20:57:56.905948 28084 raft_consensus.cc:374] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.905958 28081 ts_tablet_manager.cc:1397] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260812 20:57:56.905975 28084 raft_consensus.cc:729] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3758c4edffa44cdda65e0a5c41fa6252, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.906026 28084 consensus_queue.cc:260] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.906049 28081 raft_consensus.cc:348] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.906108 28084 ts_tablet_manager.cc:1428] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260812 20:57:56.906114 28081 raft_consensus.cc:374] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 20:57:56.906138 28081 raft_consensus.cc:729] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcfb4b7b35a241299a2490b9a5fc33f4, State: Initialized, Role: FOLLOWER
I20260812 20:57:56.906199 28081 consensus_queue.cc:260] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.906332 28081 ts_tablet_manager.cc:1428] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260812 20:57:56.925019 27797 tablet.cc:2369] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:57:56.941231 28090 raft_consensus.cc:482] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:57:56.941352 28090 raft_consensus.cc:504] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.941949 28090 leader_election.cc:288] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
I20260812 20:57:56.945401 28016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446b52f8cef84a9ea9b6ae2f075d2b6c" candidate_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3758c4edffa44cdda65e0a5c41fa6252" is_pre_election: true
I20260812 20:57:56.945574 28016 raft_consensus.cc:2454] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bcfb4b7b35a241299a2490b9a5fc33f4 in term 0.
I20260812 20:57:56.945832 27817 leader_election.cc:302] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3758c4edffa44cdda65e0a5c41fa6252, bcfb4b7b35a241299a2490b9a5fc33f4; no voters:
I20260812 20:57:56.945988 28090 raft_consensus.cc:2781] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:57:56.946028 28090 raft_consensus.cc:482] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:57:56.946044 28090 raft_consensus.cc:3037] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:56.946686 28090 raft_consensus.cc:504] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.946792 28090 leader_election.cc:288] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 1 election: Requested vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
I20260812 20:57:56.947037 28016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446b52f8cef84a9ea9b6ae2f075d2b6c" candidate_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3758c4edffa44cdda65e0a5c41fa6252"
I20260812 20:57:56.947036 27749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446b52f8cef84a9ea9b6ae2f075d2b6c" candidate_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02f2d29b5db41c19d893a4729e948ec"
I20260812 20:57:56.947139 28016 raft_consensus.cc:3037] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:56.947167 27749 raft_consensus.cc:3037] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:56.947474 27750 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "446b52f8cef84a9ea9b6ae2f075d2b6c" candidate_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02f2d29b5db41c19d893a4729e948ec" is_pre_election: true
I20260812 20:57:56.948165 28016 raft_consensus.cc:2454] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcfb4b7b35a241299a2490b9a5fc33f4 in term 1.
I20260812 20:57:56.948165 27749 raft_consensus.cc:2454] T 446b52f8cef84a9ea9b6ae2f075d2b6c P b02f2d29b5db41c19d893a4729e948ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcfb4b7b35a241299a2490b9a5fc33f4 in term 1.
I20260812 20:57:56.948391 27817 leader_election.cc:302] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b02f2d29b5db41c19d893a4729e948ec, bcfb4b7b35a241299a2490b9a5fc33f4; no voters:
I20260812 20:57:56.948490 28090 raft_consensus.cc:2781] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:57:56.948673 28090 raft_consensus.cc:686] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 LEADER]: Becoming Leader. State: Replica: bcfb4b7b35a241299a2490b9a5fc33f4, State: Running, Role: LEADER
I20260812 20:57:56.948748 28090 consensus_queue.cc:237] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } }
I20260812 20:57:56.949730 27604 catalog_manager.cc:5495] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bcfb4b7b35a241299a2490b9a5fc33f4 (127.26.234.194). New cstate: current_term: 1 leader_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } health_report { overall_health: HEALTHY } } }
I20260812 20:57:56.970432 28089 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:57:56.970536 28089 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.970914 28089 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), bcfb4b7b35a241299a2490b9a5fc33f4 (127.26.234.194:45219)
I20260812 20:57:56.974336 27749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8a7dfb94f8e45f4bffeb235fe6f94ca" candidate_uuid: "3758c4edffa44cdda65e0a5c41fa6252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02f2d29b5db41c19d893a4729e948ec" is_pre_election: true
I20260812 20:57:56.974469 27749 raft_consensus.cc:2454] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3758c4edffa44cdda65e0a5c41fa6252 in term 0.
I20260812 20:57:56.974588 27883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8a7dfb94f8e45f4bffeb235fe6f94ca" candidate_uuid: "3758c4edffa44cdda65e0a5c41fa6252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" is_pre_election: true
I20260812 20:57:56.974711 27883 raft_consensus.cc:2454] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3758c4edffa44cdda65e0a5c41fa6252 in term 0.
I20260812 20:57:56.974661 27949 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec; no voters:
I20260812 20:57:56.974849 28089 raft_consensus.cc:2781] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:57:56.974903 28089 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:57:56.974920 28089 raft_consensus.cc:3037] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:56.975598 28089 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.975769 28089 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [CANDIDATE]: Term 1 election: Requested vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), bcfb4b7b35a241299a2490b9a5fc33f4 (127.26.234.194:45219)
I20260812 20:57:56.976052 27749 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8a7dfb94f8e45f4bffeb235fe6f94ca" candidate_uuid: "3758c4edffa44cdda65e0a5c41fa6252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b02f2d29b5db41c19d893a4729e948ec"
I20260812 20:57:56.976042 27883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8a7dfb94f8e45f4bffeb235fe6f94ca" candidate_uuid: "3758c4edffa44cdda65e0a5c41fa6252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4"
I20260812 20:57:56.976122 27883 raft_consensus.cc:3037] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:56.976148 27749 raft_consensus.cc:3037] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:56.976953 27749 raft_consensus.cc:2454] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3758c4edffa44cdda65e0a5c41fa6252 in term 1.
I20260812 20:57:56.976981 27883 raft_consensus.cc:2454] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3758c4edffa44cdda65e0a5c41fa6252 in term 1.
I20260812 20:57:56.977154 27951 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3758c4edffa44cdda65e0a5c41fa6252, bcfb4b7b35a241299a2490b9a5fc33f4; no voters:
I20260812 20:57:56.977262 28089 raft_consensus.cc:2781] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:57:56.977494 28089 raft_consensus.cc:686] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [term 1 LEADER]: Becoming Leader. State: Replica: 3758c4edffa44cdda65e0a5c41fa6252, State: Running, Role: LEADER
I20260812 20:57:56.977614 28089 consensus_queue.cc:237] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:56.978595 27604 catalog_manager.cc:5495] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195). New cstate: current_term: 1 leader_uuid: "3758c4edffa44cdda65e0a5c41fa6252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } health_report { overall_health: HEALTHY } } }
W20260812 20:57:57.091903 28063 tablet.cc:2369] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 20:57:57.145980 27930 tablet.cc:2369] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 20:57:57.172008 28083 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 20:57:57.172117 28083 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:57.172546 28083 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bcfb4b7b35a241299a2490b9a5fc33f4 (127.26.234.194:45219), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
I20260812 20:57:57.175791 27883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2595e5db48f448c7ac339d12c0407172" candidate_uuid: "b02f2d29b5db41c19d893a4729e948ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" is_pre_election: true
I20260812 20:57:57.175931 27883 raft_consensus.cc:2454] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02f2d29b5db41c19d893a4729e948ec in term 0.
I20260812 20:57:57.175921 28016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2595e5db48f448c7ac339d12c0407172" candidate_uuid: "b02f2d29b5db41c19d893a4729e948ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3758c4edffa44cdda65e0a5c41fa6252" is_pre_election: true
I20260812 20:57:57.176030 28016 raft_consensus.cc:2454] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b02f2d29b5db41c19d893a4729e948ec in term 0.
I20260812 20:57:57.176239 27682 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec; no voters:
I20260812 20:57:57.176426 28083 raft_consensus.cc:2781] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 20:57:57.176496 28083 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 20:57:57.176528 28083 raft_consensus.cc:3037] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:57.177189 28083 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:57.177342 28083 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [CANDIDATE]: Term 1 election: Requested vote from peers bcfb4b7b35a241299a2490b9a5fc33f4 (127.26.234.194:45219), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
I20260812 20:57:57.177541 28016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2595e5db48f448c7ac339d12c0407172" candidate_uuid: "b02f2d29b5db41c19d893a4729e948ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3758c4edffa44cdda65e0a5c41fa6252"
I20260812 20:57:57.177624 28016 raft_consensus.cc:3037] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:57.178146 28016 raft_consensus.cc:2454] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02f2d29b5db41c19d893a4729e948ec in term 1.
I20260812 20:57:57.178265 27883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2595e5db48f448c7ac339d12c0407172" candidate_uuid: "b02f2d29b5db41c19d893a4729e948ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4"
I20260812 20:57:57.178345 27883 raft_consensus.cc:3037] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 0 FOLLOWER]: Advancing to term 1
I20260812 20:57:57.178412 27682 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec; no voters:
I20260812 20:57:57.178568 28083 raft_consensus.cc:2781] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 1 FOLLOWER]: Leader election won for term 1
I20260812 20:57:57.178825 28083 raft_consensus.cc:686] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [term 1 LEADER]: Becoming Leader. State: Replica: b02f2d29b5db41c19d893a4729e948ec, State: Running, Role: LEADER
I20260812 20:57:57.178956 28083 consensus_queue.cc:237] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:57.179061 27883 raft_consensus.cc:2454] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b02f2d29b5db41c19d893a4729e948ec in term 1.
I20260812 20:57:57.179934 27604 catalog_manager.cc:5495] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec reported cstate change: term changed from 0 to 1, leader changed from <none> to b02f2d29b5db41c19d893a4729e948ec (127.26.234.193). New cstate: current_term: 1 leader_uuid: "b02f2d29b5db41c19d893a4729e948ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } health_report { overall_health: UNKNOWN } } }
I20260812 20:57:57.396562 27883 raft_consensus.cc:1261] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Refusing update from remote peer 3758c4edffa44cdda65e0a5c41fa6252: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:57:57.397078 28089 consensus_queue.cc:1035] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:57:57.411164 27749 raft_consensus.cc:1261] T f8a7dfb94f8e45f4bffeb235fe6f94ca P b02f2d29b5db41c19d893a4729e948ec [term 1 FOLLOWER]: Refusing update from remote peer 3758c4edffa44cdda65e0a5c41fa6252: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:57:57.411813 28089 consensus_queue.cc:1035] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:57:57.425594 28108 mvcc.cc:205] Tried to move back new op lower bound from 7317783664196120576 to 7317783662501212160. Current Snapshot: MvccSnapshot[applied={T|T < 7317783664196120576}]
I20260812 20:57:57.449378 28115 mvcc.cc:205] Tried to move back new op lower bound from 7317783664196120576 to 7317783662501212160. Current Snapshot: MvccSnapshot[applied={T|T < 7317783664196120576}]
I20260812 20:57:57.455662 28111 mvcc.cc:205] Tried to move back new op lower bound from 7317783664196120576 to 7317783662501212160. Current Snapshot: MvccSnapshot[applied={T|T < 7317783664196120576}]
I20260812 20:57:57.502205 28090 consensus_queue.cc:1035] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:57:57.511593 28016 raft_consensus.cc:1261] T 446b52f8cef84a9ea9b6ae2f075d2b6c P 3758c4edffa44cdda65e0a5c41fa6252 [term 1 FOLLOWER]: Refusing update from remote peer bcfb4b7b35a241299a2490b9a5fc33f4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:57:57.512524 28119 consensus_queue.cc:1035] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:57:57.515216 28016 raft_consensus.cc:1261] T 2595e5db48f448c7ac339d12c0407172 P 3758c4edffa44cdda65e0a5c41fa6252 [term 1 FOLLOWER]: Refusing update from remote peer b02f2d29b5db41c19d893a4729e948ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:57:57.515695 28083 consensus_queue.cc:1035] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:57:57.516124 27883 raft_consensus.cc:1261] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Refusing update from remote peer b02f2d29b5db41c19d893a4729e948ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 20:57:57.516615 28105 consensus_queue.cc:1035] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 20:57:57.592749 28063 maintenance_manager.cc:419] P 3758c4edffa44cdda65e0a5c41fa6252: Scheduling FlushMRSOp(f8a7dfb94f8e45f4bffeb235fe6f94ca): perf score=1.000000
I20260812 20:57:57.650501 27930 maintenance_manager.cc:419] P bcfb4b7b35a241299a2490b9a5fc33f4: Scheduling FlushMRSOp(446b52f8cef84a9ea9b6ae2f075d2b6c): perf score=1.937278
I20260812 20:57:57.676009 27797 maintenance_manager.cc:419] P b02f2d29b5db41c19d893a4729e948ec: Scheduling FlushMRSOp(2595e5db48f448c7ac339d12c0407172): perf score=1.937278
W20260812 20:57:57.797304 27685 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data/data (515014656 bytes available vs 518351011 bytes reserved) (error 28)
W20260812 20:57:57.798440 27952 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data/data (515014656 bytes available vs 518351011 bytes reserved) (error 28)
W20260812 20:57:57.800436 27685 tablet_replica_mm_ops.cc:214] T 2595e5db48f448c7ac339d12c0407172 P b02f2d29b5db41c19d893a4729e948ec: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet 2595e5db48f448c7ac339d12c0407172: unable to open output file for column decimal128_val DECIMAL(38, 0) NULLABLE: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 2595e5db48f448c7ac339d12c0407172's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260812 20:57:57.800828 27685 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet 2595e5db48f448c7ac339d12c0407172: unable to open output file for column decimal128_val DECIMAL(38, 0) NULLABLE: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 2595e5db48f448c7ac339d12c0407172's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
W20260812 20:57:57.800832 27952 tablet_replica_mm_ops.cc:214] T f8a7dfb94f8e45f4bffeb235fe6f94ca P 3758c4edffa44cdda65e0a5c41fa6252: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet f8a7dfb94f8e45f4bffeb235fe6f94ca: unable to open output file for column binary_val BINARY NULLABLE: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in f8a7dfb94f8e45f4bffeb235fe6f94ca's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260812 20:57:57.800899 27952 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet f8a7dfb94f8e45f4bffeb235fe6f94ca: unable to open output file for column binary_val BINARY NULLABLE: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in f8a7dfb94f8e45f4bffeb235fe6f94ca's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
*** Check failure stack trace: ***
I20260812 20:57:57.829144 27861 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260812 20:57:57.829885 27996 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
@ 0x7f9bd0ab89ad google::LogMessage::Fail() at ??:0
I20260812 20:57:57.832901 27729 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
@ 0x7f7769c999ad google::LogMessage::Fail() at ??:0
@ 0x7f7769c9c88a google::LogMessage::SendToLog() at ??:0
@ 0x7f7769c994de google::LogMessage::Flush() at ??:0
@ 0x7f7769c9aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9bd0abb88a google::LogMessage::SendToLog() at ??:0
@ 0x7f9bd0ab84de google::LogMessage::Flush() at ??:0
@ 0x7f9bd0ab9a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
1bab88402b9d4b6e918c26c424c52b4e | 127.26.234.254:39269 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.26.234.212:43515 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+----------------------+---------+----------+----------------+-----------------
3758c4edffa44cdda65e0a5c41fa6252 | 127.26.234.195:37311 | HEALTHY | <none> | 1 | 0
b02f2d29b5db41c19d893a4729e948ec | 127.26.234.193:41581 | HEALTHY | <none> | 1 | 0
bcfb4b7b35a241299a2490b9a5fc33f4 | 127.26.234.194:45219 | HEALTHY | <none> | 1 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
--------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
flush_threshold_mb | 1 | runtime,experimental | all 3 server(s) checked
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.26.234.193 | experimental | 127.26.234.193:41581
local_ip_for_outbound_sockets | 127.26.234.194 | experimental | 127.26.234.194:45219
local_ip_for_outbound_sockets | 127.26.234.195 | experimental | 127.26.234.195:37311
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-0/data/info.pb | hidden | 127.26.234.193:41581
server_dump_info_path | /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-1/data/info.pb | hidden | 127.26.234.194:45219
server_dump_info_path | /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/ts-2/data/info.pb | hidden | 127.26.234.195:37311
tablet_delta_store_major_compact_min_ratio | 0.001 | experimental | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+----------------------+-------------------------
builtin_ntp_servers | 127.26.234.212:43515 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------------+----+---------+---------------+---------+------------+------------------+-------------
all-types-table | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 3
First Quartile | 3
Median | 3
Third Quartile | 3
Maximum | 3
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 3
Replicas | 9
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260812 20:57:57.852941 27563 log_verifier.cc:126] Checking tablet 2595e5db48f448c7ac339d12c0407172
@ 0x7f7770dfa04f kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7f776bafc7c2 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7f9bd7c1904f kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7f9bd291b7c2 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7f9bd29860d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f776bb670d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9bd297b954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f9bd37df6db start_thread at ??:0
I20260812 20:57:57.897188 27820 maintenance_manager.cc:643] P bcfb4b7b35a241299a2490b9a5fc33f4: FlushMRSOp(446b52f8cef84a9ea9b6ae2f075d2b6c) complete. Timing: real 0.246s user 0.039s sys 0.062s Metrics: {"bytes_written":436310,"cfile_init":1,"compiler_manager_pool.queue_time_us":8303,"dirs.queue_time_us":12682,"dirs.run_cpu_time_us":212,"dirs.run_wall_time_us":1421,"drs_written":1,"lbm_read_time_us":28,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4323,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000,"thread_start_us":360,"threads_started":2}
I20260812 20:57:57.897650 27930 maintenance_manager.cc:419] P bcfb4b7b35a241299a2490b9a5fc33f4: Scheduling UndoDeltaBlockGCOp(446b52f8cef84a9ea9b6ae2f075d2b6c): 62919 bytes on disk
@ 0x7f9bcf5b661f clone at ??:0
@ 0x7f776bb5c954 kudu::Thread::SuperviseThread() at ??:0
I20260812 20:57:57.903815 27820 maintenance_manager.cc:643] P bcfb4b7b35a241299a2490b9a5fc33f4: UndoDeltaBlockGCOp(446b52f8cef84a9ea9b6ae2f075d2b6c) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4}
I20260812 20:57:57.904011 27930 maintenance_manager.cc:419] P bcfb4b7b35a241299a2490b9a5fc33f4: Scheduling FlushMRSOp(2595e5db48f448c7ac339d12c0407172): perf score=1.937278
@ 0x7f776c9c06db start_thread at ??:0
@ 0x7f776879761f clone at ??:0
I20260812 20:57:58.028319 27563 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 2595e5db48f448c7ac339d12c0407172
I20260812 20:57:58.028424 27563 log_verifier.cc:126] Checking tablet 446b52f8cef84a9ea9b6ae2f075d2b6c
I20260812 20:57:58.033159 27820 maintenance_manager.cc:643] P bcfb4b7b35a241299a2490b9a5fc33f4: FlushMRSOp(2595e5db48f448c7ac339d12c0407172) complete. Timing: real 0.129s user 0.039s sys 0.006s Metrics: {"bytes_written":471972,"cfile_init":1,"dirs.queue_time_us":13078,"dirs.run_cpu_time_us":283,"dirs.run_wall_time_us":1422,"drs_written":1,"lbm_read_time_us":30,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4010,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000}
I20260812 20:57:58.033465 27930 maintenance_manager.cc:419] P bcfb4b7b35a241299a2490b9a5fc33f4: Scheduling FlushMRSOp(f8a7dfb94f8e45f4bffeb235fe6f94ca): perf score=1.937278
I20260812 20:57:58.129274 27820 maintenance_manager.cc:643] P bcfb4b7b35a241299a2490b9a5fc33f4: FlushMRSOp(f8a7dfb94f8e45f4bffeb235fe6f94ca) complete. Timing: real 0.096s user 0.043s sys 0.003s Metrics: {"bytes_written":472920,"cfile_init":1,"dirs.queue_time_us":38,"dirs.run_cpu_time_us":183,"dirs.run_wall_time_us":1505,"drs_written":1,"lbm_read_time_us":21,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3593,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000}
I20260812 20:57:58.129501 27930 maintenance_manager.cc:419] P bcfb4b7b35a241299a2490b9a5fc33f4: Scheduling UndoDeltaBlockGCOp(f8a7dfb94f8e45f4bffeb235fe6f94ca): 63414 bytes on disk
I20260812 20:57:58.129667 27820 maintenance_manager.cc:643] P bcfb4b7b35a241299a2490b9a5fc33f4: UndoDeltaBlockGCOp(f8a7dfb94f8e45f4bffeb235fe6f94ca) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":31,"lbm_reads_lt_1ms":4}
I20260812 20:57:58.129782 27930 maintenance_manager.cc:419] P bcfb4b7b35a241299a2490b9a5fc33f4: Scheduling UndoDeltaBlockGCOp(2595e5db48f448c7ac339d12c0407172): 62919 bytes on disk
I20260812 20:57:58.129894 27820 maintenance_manager.cc:643] P bcfb4b7b35a241299a2490b9a5fc33f4: UndoDeltaBlockGCOp(2595e5db48f448c7ac339d12c0407172) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":22,"lbm_reads_lt_1ms":4}
I20260812 20:57:58.227792 27563 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 446b52f8cef84a9ea9b6ae2f075d2b6c
I20260812 20:57:58.227883 27563 log_verifier.cc:126] Checking tablet f8a7dfb94f8e45f4bffeb235fe6f94ca
W20260812 20:57:58.369057 27817 connection.cc:535] client connection to 127.26.234.193:41581 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 20:57:58.369203 27817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 20:57:58.369846 27563 log_verifier.cc:177] Verified matching terms for 3 ops in tablet f8a7dfb94f8e45f4bffeb235fe6f94ca
I20260812 20:57:58.370388 27563 test_util.cc:268] Using random seed: -677812145
W20260812 20:57:58.371061 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 20:57:58.385526 27563 all_types-itest.cc:600] Scanning tablet: [, int16 key=10922)
W20260812 20:57:58.415977 27817 connection.cc:535] client connection to 127.26.234.195:37311 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 20:57:58.416564 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 20:57:58.464836 27563 test_util.cc:268] Using random seed: -677717695
I20260812 20:57:58.465723 27563 meta_cache.cc:1510] marking tablet server 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311) as failed
W20260812 20:57:58.465873 27563 meta_cache.cc:302] tablet f8a7dfb94f8e45f4bffeb235fe6f94ca: replica 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311) has failed: Network error: TS failed: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
W20260812 20:57:58.466423 27843 tablet_service.cc:2970] error setting up scanner 03e39a0a03ff4def90927a95a1f651a6 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.838s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:57:58.503885 27843 tablet_service.cc:2970] error setting up scanner fdc8cd85dc0a4ba48500335b047544e4 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.875s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:57:58.557184 27843 tablet_service.cc:2970] error setting up scanner 193930189c7d4a029d432caea0b0ed31 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 0.929s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:57:58.646533 27843 tablet_service.cc:2970] error setting up scanner 72124172612e43628bbc8e1043b7a706 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.018s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:57:58.839754 27843 tablet_service.cc:2970] error setting up scanner 75d269929c644d469857260b167192d5 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.211s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
I20260812 20:57:59.094316 28199 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3758c4edffa44cdda65e0a5c41fa6252)
I20260812 20:57:59.094444 28199 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:59.094590 28199 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:57:59.095301 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:57:59.095382 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:57:59.095399 27817 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:57:59.095492 28199 raft_consensus.cc:2726] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 20:57:59.129040 28199 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02f2d29b5db41c19d893a4729e948ec)
I20260812 20:57:59.129187 28199 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:57:59.129419 28199 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:57:59.130349 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:57:59.130432 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:57:59.130461 27817 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:57:59.130581 28199 raft_consensus.cc:2726] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:57:59.160888 27843 tablet_service.cc:2970] error setting up scanner 534b4319e5e646889be222006b519ee5 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.532s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:58:00.314137 27843 tablet_service.cc:2970] error setting up scanner 9c80b480e03047599d596452ca9d56cc with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 2.686s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:58:00.540307 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260812 20:58:00.688802 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 20:58:01.194147 28199 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3758c4edffa44cdda65e0a5c41fa6252)
I20260812 20:58:01.194270 28199 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:01.194413 28199 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:01.195079 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:01.195156 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:01.195173 27817 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:01.195243 28199 raft_consensus.cc:2726] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 20:58:01.254521 28199 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02f2d29b5db41c19d893a4729e948ec)
I20260812 20:58:01.254662 28199 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:01.254894 28199 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:01.255626 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:01.255738 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:01.255765 27817 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:01.255856 28199 raft_consensus.cc:2726] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:01.979408 27843 tablet_service.cc:2970] error setting up scanner 0a0d6f8d4697461ea951e0eed0db9e69 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 4.351s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
I20260812 20:58:02.858074 28199 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3758c4edffa44cdda65e0a5c41fa6252)
I20260812 20:58:02.858213 28199 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:02.858438 28199 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:02.859159 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:02.859220 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:02.859234 27817 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:02.859305 28199 raft_consensus.cc:2726] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:03.266084 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260812 20:58:03.417457 27817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111) [suppressed 30 similar messages]
W20260812 20:58:03.417995 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 20:58:03.750506 28199 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02f2d29b5db41c19d893a4729e948ec)
I20260812 20:58:03.750643 28199 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:03.750926 28199 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:03.751837 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
W20260812 20:58:03.752005 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
I20260812 20:58:03.752063 27817 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:03.752178 28199 raft_consensus.cc:2726] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:04.540724 27843 tablet_service.cc:2970] error setting up scanner ebb32ac23ee541f0a9cdc46555d4c7fc with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 6.912s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:58:05.832408 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260812 20:58:05.904767 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 20:58:07.108831 28199 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3758c4edffa44cdda65e0a5c41fa6252)
I20260812 20:58:07.108978 28199 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:07.109149 28199 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:07.109872 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:07.109930 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:07.109946 27817 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:07.110018 28199 raft_consensus.cc:2726] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:07.614030 27843 tablet_service.cc:2970] error setting up scanner f2b8399e3a064de2a6a51c06230b73d4 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 9.985s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
I20260812 20:58:07.694906 28199 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02f2d29b5db41c19d893a4729e948ec)
I20260812 20:58:07.695086 28199 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:07.695294 28199 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:07.696151 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:07.696242 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:07.696264 27817 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:07.696394 28199 raft_consensus.cc:2726] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:08.366760 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260812 20:58:08.413290 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260812 20:58:08.684180 28199 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3758c4edffa44cdda65e0a5c41fa6252)
I20260812 20:58:08.684319 28199 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:08.684465 28199 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:08.684914 27817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111) [suppressed 26 similar messages]
W20260812 20:58:08.685349 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:08.685431 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:08.685451 27817 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:08.685520 28199 raft_consensus.cc:2726] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:10.431351 27843 tablet_service.cc:2970] error setting up scanner bd1e9b5bd8344ea68bf27a12fce2ecf6 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 12.803s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:58:11.120693 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260812 20:58:11.172941 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260812 20:58:12.217763 28199 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02f2d29b5db41c19d893a4729e948ec)
I20260812 20:58:12.218012 28199 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:12.218286 28199 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:12.219081 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:12.219156 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:12.219197 27817 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:12.219297 28199 raft_consensus.cc:2726] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:13.507792 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260812 20:58:13.616878 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260812 20:58:13.732661 28199 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3758c4edffa44cdda65e0a5c41fa6252)
I20260812 20:58:13.732788 28199 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:13.733006 28199 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:13.733366 27817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111) [suppressed 23 similar messages]
W20260812 20:58:13.733762 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:13.733880 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:13.733899 27817 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:13.733990 28199 raft_consensus.cc:2726] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:13.760785 27843 tablet_service.cc:2970] error setting up scanner 2240979ecfa74f469e25a90cfe13074b with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 16.132s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
I20260812 20:58:14.288141 28199 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02f2d29b5db41c19d893a4729e948ec)
I20260812 20:58:14.288268 28199 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:14.288497 28199 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:14.289304 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:14.289403 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:14.289441 27817 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:14.289549 28199 raft_consensus.cc:2726] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:15.885212 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 20:58:16.240053 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260812 20:58:16.834127 27843 tablet_service.cc:2970] error setting up scanner 1e8f7f18f8a44f998a90d572e9422e41 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 19.205s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
I20260812 20:58:17.169858 28199 raft_consensus.cc:482] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b02f2d29b5db41c19d893a4729e948ec)
I20260812 20:58:17.169986 28199 raft_consensus.cc:504] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:17.170187 28199 leader_election.cc:288] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:17.170969 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:17.171080 27817 leader_election.cc:334] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:17.171113 27817 leader_election.cc:302] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:17.171228 28199 raft_consensus.cc:2726] T 2595e5db48f448c7ac339d12c0407172 P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:18.238157 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 20:58:18.893376 27817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111) [suppressed 25 similar messages]
W20260812 20:58:18.893796 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260812 20:58:20.764619 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260812 20:58:20.931427 27843 tablet_service.cc:2970] error setting up scanner aaeaa34f0e7d4a6b97ea38133b376bc3 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 23.303s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:58:21.330333 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260812 20:58:22.171829 28199 raft_consensus.cc:482] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3758c4edffa44cdda65e0a5c41fa6252)
I20260812 20:58:22.171952 28199 raft_consensus.cc:504] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b02f2d29b5db41c19d893a4729e948ec" member_type: VOTER last_known_addr { host: "127.26.234.193" port: 41581 } } peers { permanent_uuid: "bcfb4b7b35a241299a2490b9a5fc33f4" member_type: VOTER last_known_addr { host: "127.26.234.194" port: 45219 } } peers { permanent_uuid: "3758c4edffa44cdda65e0a5c41fa6252" member_type: VOTER last_known_addr { host: "127.26.234.195" port: 37311 } }
I20260812 20:58:22.172161 28199 leader_election.cc:288] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581), 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311)
W20260812 20:58:22.172866 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111)
W20260812 20:58:22.172946 27817 leader_election.cc:334] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111)
I20260812 20:58:22.172983 27817 leader_election.cc:302] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bcfb4b7b35a241299a2490b9a5fc33f4; no voters: 3758c4edffa44cdda65e0a5c41fa6252, b02f2d29b5db41c19d893a4729e948ec
I20260812 20:58:22.173079 28199 raft_consensus.cc:2726] T f8a7dfb94f8e45f4bffeb235fe6f94ca P bcfb4b7b35a241299a2490b9a5fc33f4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 20:58:23.511379 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 20:58:23.783490 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260812 20:58:24.104470 27817 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111) [suppressed 21 similar messages]
W20260812 20:58:24.260731 27843 tablet_service.cc:2970] error setting up scanner 2f799c91c15b4046bb0a96938b93699d with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 26.632s (maximum allowed 0.750s): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:58:26.063169 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer b02f2d29b5db41c19d893a4729e948ec (127.26.234.193:41581): Couldn't send request to peer b02f2d29b5db41c19d893a4729e948ec. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.193:41581: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 20:58:26.167843 27817 consensus_peers.cc:487] T 446b52f8cef84a9ea9b6ae2f075d2b6c P bcfb4b7b35a241299a2490b9a5fc33f4 -> Peer 3758c4edffa44cdda65e0a5c41fa6252 (127.26.234.195:37311): Couldn't send request to peer 3758c4edffa44cdda65e0a5c41fa6252. Status: Network error: Client connection negotiation failed: client connection to 127.26.234.195:37311: connect: Connection refused (error 111). This is attempt 56: this message will repeat every 5th retry.
W20260812 20:58:28.358031 27843 tablet_service.cc:2970] error setting up scanner 1986be6968b549bfaa77ce6f61459b20 with request: Timed out: tablet is lagging too much to be able to serve a snapshot scan: current lag 30735 ms (maximum allowed 30000 ms): new_scan_request { tablet_id: "2595e5db48f448c7ac339d12c0407172" projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "key" type: INT16 is_key: false is_nullable: false immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7317783668260982784 start_primary_key: "<redacted>""\252\252" stop_primary_key: "<redacted>""\325T" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { lower: "<redacted>""\252*" upper: "<redacted>""TU" } } row_format_flags: 1 authz_token { token_data: "\010\201\277\363\323\006\"3\n\005slave\022*\n 92359d5827f34c86b13118c2e6a02d18\020\001\030\001 \001(\001" signature: "<redacted>""+\005\316\233[\230\301\242\212\226\345\343Fc\017\274\220\000>-O\240\211\216\213i5\006\224$\275\350V\335x\366C\014\013\350Z\333\025\007\222\336j\031i\360e\301\003\326\r\371\\\037\220\345\357|\343\317" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "30b57caf4a0647a0a2d535eba0e24388"
W20260812 20:58:28.358642 27563 scanner-internal.cc:458] Time spent opening tablet: real 29.894s user 0.005s sys 0.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/all_types-itest.cc:624: Failure
Failed
Bad status: Timed out: tablet is lagging too much to be able to serve a snapshot scan: current lag 30735 ms (maximum allowed 30000 ms)
E20260812 20:58:28.358902 27563 external_mini_cluster.cc:943] Process with UUID b02f2d29b5db41c19d893a4729e948ec has crashed
E20260812 20:58:28.358958 27563 external_mini_cluster.cc:943] Process with UUID 3758c4edffa44cdda65e0a5c41fa6252 has crashed
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/external_mini_cluster.cc:947: Failure
Expected equality of these values:
0
num_crashes
Which is: 2
At least one process crashed
I20260812 20:58:28.359323 27563 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu with pid 27799
I20260812 20:58:28.367491 27563 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu with pid 27571
2026-08-12T20:58:28Z chronyd exiting
I20260812 20:58:28.384903 27563 test_util.cc:175] -----------------------------------------------
I20260812 20:58:28.384965 27563 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_1.TestTimestampPadding.1786568275982794-27563-0
[ FAILED ] AllTypesItest/1.TestTimestampPadding, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)3> > (32377 ms)
[----------] 1 test from AllTypesItest/1 (32377 ms total)
[----------] 1 test from AllTypesItest/5, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)16> >
[ RUN ] AllTypesItest/5.TestTimestampPadding
I20260812 20:58:28.385977 27563 test_util.cc:268] Using random seed: -647796554
2026-08-12T20:58:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T20:58:28Z Disabled control of system clock
I20260812 20:58:28.397239 27563 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
/tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.234.254:33261
--webserver_interface=127.26.234.254
--webserver_port=0
--builtin_ntp_servers=127.26.234.212:46803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.26.234.254:33261 with env {}
W20260812 20:58:28.482697 28310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 20:58:28.482973 28310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 20:58:28.483011 28310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 20:58:28.484292 28310 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 20:58:28.484365 28310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 20:58:28.484388 28310 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 20:58:28.484409 28310 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 20:58:28.485925 28310 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.26.234.212:46803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.26.234.254:33261
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.26.234.254:33261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.26.234.254
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.28310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 12 Aug 2026 20:07:25 UTC on ccycloud.quasar-nfsqdf.root.comops.site
build id 4583594
I20260812 20:58:28.486212 28310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 20:58:28.486564 28310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 20:58:28.491917 28315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 20:58:28.491911 28316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:28.491938 28310 server_base.cc:1034] running on GCE node
W20260812 20:58:28.491911 28318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 20:58:28.492443 28310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 20:58:28.492712 28310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 20:58:28.493897 28310 hybrid_clock.cc:648] HybridClock initialized: now 1786568308493856 us; error 54 us; skew 500 ppm
I20260812 20:58:28.500375 28310 webserver.cc:460] Webserver started at http://127.26.234.254:42653/ using document root <none> and password file <none>
I20260812 20:58:28.500644 28310 fs_manager.cc:359] Metadata directory not provided
I20260812 20:58:28.500692 28310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 20:58:28.500798 28310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 20:58:28.501860 28310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/instance:
uuid: "ecf5a425957947578ab2c6036e8caf7e"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-bxbt"
I20260812 20:58:28.502206 28310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal/instance:
uuid: "ecf5a425957947578ab2c6036e8caf7e"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-bxbt"
W20260812 20:58:28.503758 28310 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/data (514547712 bytes available vs 518351011 bytes reserved) (error 28)
I20260812 20:58:28.503819 28310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260812 20:58:28.504858 28324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 20:58:28.505208 28310 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260812 20:58:28.505439 28310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data,/tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
uuid: "ecf5a425957947578ab2c6036e8caf7e"
format_stamp: "Formatted at 2026-08-12 20:58:28 on dist-test-slave-bxbt"
I20260812 20:58:28.505523 28310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 20:58:28.522933 28310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 20:58:28.523335 28310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 20:58:28.523526 28310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 20:58:28.528184 28310 rpc_server.cc:307] RPC server started. Bound to: 127.26.234.254:33261
I20260812 20:58:28.528234 28377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.26.234.254:33261 every 8 connection(s)
I20260812 20:58:28.528622 28310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/info.pb
W20260812 20:58:28.529362 28378 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/data/data (514543616 bytes available vs 518351011 bytes reserved) (error 28)
E20260812 20:58:28.529861 28378 master.cc:392] Unable to init master catalog manager: IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
I20260812 20:58:28.530164 28310 master.cc:537] Master@127.26.234.254:33261 shutting down...
I20260812 20:58:28.532794 27563 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskOJ_Lnv/build/release/bin/kudu as pid 28310
I20260812 20:58:28.532871 27563 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskOJ_Lnv/test-tmp/all_types-itest.3.AllTypesItest_5.TestTimestampPadding.1786568275982794-27563-0/minicluster-data/master-0/wal/instance
W20260812 20:58:28.538501 28307 connection.cc:535] client connection to 127.26.234.254:33261 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 20:58:28.550678 28310 master.cc:552] Master@127.26.234.254:33261 shutdown complete.
IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
F20260812 20:58:33.559253 27563 external_mini_cluster.cc:634] Check failed: leader_master() != nullptr Must have started at least 1 master before adding tablet servers
*** Check failure stack trace: ***
*** Aborted at 1786568313 (unix time) try "date -d @1786568313" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800006bab) received by PID 27563 (TID 0x7f92a28a9440) from PID 27563; stack trace: ***
@ 0x7f92a5a7fa46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
@ 0x7f92a7849980 (unknown) at ??:0
@ 0x7f92a3597e87 gsignal at ??:0
@ 0x7f92a35997f1 abort at ??:0
@ 0x7f92a5a719ad google::LogMessage::Fail() at ??:0
@ 0x7f92a5a7488a google::LogMessage::SendToLog() at ??:0
@ 0x7f92a5a714de google::LogMessage::Flush() at ??:0
@ 0x7f92a5a72a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f92ad226138 kudu::cluster::ExternalMiniCluster::AddTabletServer() at ??:0
@ 0x7f92ad22754d kudu::cluster::ExternalMiniCluster::Start() at ??:0
@ 0x491415 kudu::client::AllTypesItest<>::RunTest() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/all_types-itest.cc:407
@ 0x49205a kudu::client::AllTypesItest_TestTimestampPadding_Test<>::TestBody() at /opt/rh/devtoolset-8/root/usr/include/c++/8/bits/std_function.h:256
@ 0x7f92a6e8bbfe testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f92a6e805db testing::Test::Run() at ??:0
@ 0x7f92a6e80795 testing::TestInfo::Run() at ??:0
@ 0x7f92a6e80cdf testing::TestSuite::Run() at ??:0
@ 0x7f92a6e8129f testing::internal::UnitTestImpl::RunAllTests() at ??:0
@ 0x7f92a6e8c13e testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f92a6e8083d testing::UnitTest::Run() at ??:0
@ 0x42b4ba main at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:110
@ 0x7f92a357ac87 __libc_start_main at ??:0
@ 0x42b6f2 (unknown) at ??:?