Note: This is test shard 6 of 8.
[==========] Running 3 tests from 3 test suites.
[----------] Global test environment set-up.
[----------] 1 test from AllTypesItest/2, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)5> >
[ RUN ] AllTypesItest/2.TestTimestampPadding
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260810 04:07:41.691718 11761 test_util.cc:268] Using random seed: 2128710435
2026-08-10T04:07:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:07:41Z Disabled control of system clock
I20260810 04:07:41.707551 11761 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskPMk8pX/build/release/bin/kudu
/tmp/dist-test-taskPMk8pX/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.124.126:43605
--webserver_interface=127.11.124.126
--webserver_port=0
--builtin_ntp_servers=127.11.124.84:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.124.126:43605 with env {}
W20260810 04:07:41.792893 11770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:07:41.793138 11770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:07:41.793159 11770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:07:41.794485 11770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:07:41.794539 11770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:07:41.794553 11770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:07:41.794566 11770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:07:41.795957 11770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.124.84:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.124.126:43605
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.124.126:43605
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.124.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.11770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:07:41.796181 11770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:07:41.796454 11770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:07:41.802152 11777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:07:41.802163 11776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:07:41.802197 11770 server_base.cc:1034] running on GCE node
W20260810 04:07:41.802203 11779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:07:41.802663 11770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:07:41.802994 11770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:07:41.804153 11770 hybrid_clock.cc:648] HybridClock initialized: now 1786334861804143 us; error 91 us; skew 500 ppm
I20260810 04:07:41.808949 11770 webserver.cc:460] Webserver started at http://127.11.124.126:38587/ using document root <none> and password file <none>
I20260810 04:07:41.809255 11770 fs_manager.cc:359] Metadata directory not provided
I20260810 04:07:41.809312 11770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:07:41.809517 11770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:07:41.810639 11770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/instance:
uuid: "6c18e8f294324c9eb727c470c703941a"
format_stamp: "Formatted at 2026-08-10 04:07:41 on dist-test-slave-p3t5"
I20260810 04:07:41.811046 11770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal/instance:
uuid: "6c18e8f294324c9eb727c470c703941a"
format_stamp: "Formatted at 2026-08-10 04:07:41 on dist-test-slave-p3t5"
I20260810 04:07:41.812537 11770 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:07:41.813438 11787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:41.813685 11770 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:07:41.813804 11770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data,/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
uuid: "6c18e8f294324c9eb727c470c703941a"
format_stamp: "Formatted at 2026-08-10 04:07:41 on dist-test-slave-p3t5"
I20260810 04:07:41.813895 11770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:07:41.831015 11770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:07:41.831406 11770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:07:41.831580 11770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:07:41.835840 11770 rpc_server.cc:307] RPC server started. Bound to: 127.11.124.126:43605
I20260810 04:07:41.835886 11842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.124.126:43605 every 8 connection(s)
I20260810 04:07:41.836295 11770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/info.pb
I20260810 04:07:41.837113 11843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:41.839778 11843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a: Bootstrap starting.
I20260810 04:07:41.840349 11843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:41.840613 11843 log.cc:824] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a: Log is configured to *not* fsync() on all Append() calls
I20260810 04:07:41.841325 11843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a: No bootstrap required, opened a new log
I20260810 04:07:41.843057 11761 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskPMk8pX/build/release/bin/kudu as pid 11770
I20260810 04:07:41.842996 11843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c18e8f294324c9eb727c470c703941a" member_type: VOTER last_known_addr { host: "127.11.124.126" port: 43605 } }
I20260810 04:07:41.843155 11843 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:41.843196 11761 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal/instance
I20260810 04:07:41.843178 11843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c18e8f294324c9eb727c470c703941a, State: Initialized, Role: FOLLOWER
I20260810 04:07:41.843406 11843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c18e8f294324c9eb727c470c703941a" member_type: VOTER last_known_addr { host: "127.11.124.126" port: 43605 } }
I20260810 04:07:41.843502 11843 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 04:07:41.843525 11843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 04:07:41.843600 11843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:41.844161 11843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c18e8f294324c9eb727c470c703941a" member_type: VOTER last_known_addr { host: "127.11.124.126" port: 43605 } }
I20260810 04:07:41.844250 11843 leader_election.cc:302] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6c18e8f294324c9eb727c470c703941a; no voters:
I20260810 04:07:41.844468 11843 leader_election.cc:288] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 04:07:41.844506 11846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:07:41.844627 11846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [term 1 LEADER]: Becoming Leader. State: Replica: 6c18e8f294324c9eb727c470c703941a, State: Running, Role: LEADER
I20260810 04:07:41.844751 11843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 04:07:41.844774 11846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c18e8f294324c9eb727c470c703941a" member_type: VOTER last_known_addr { host: "127.11.124.126" port: 43605 } }
I20260810 04:07:41.845136 11846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6c18e8f294324c9eb727c470c703941a. Latest consensus state: current_term: 1 leader_uuid: "6c18e8f294324c9eb727c470c703941a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c18e8f294324c9eb727c470c703941a" member_type: VOTER last_known_addr { host: "127.11.124.126" port: 43605 } } }
I20260810 04:07:41.845150 11848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6c18e8f294324c9eb727c470c703941a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6c18e8f294324c9eb727c470c703941a" member_type: VOTER last_known_addr { host: "127.11.124.126" port: 43605 } } }
I20260810 04:07:41.845312 11846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [sys.catalog]: This master's current role is: LEADER
I20260810 04:07:41.845599 11848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a [sys.catalog]: This master's current role is: LEADER
I20260810 04:07:41.845839 11855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 04:07:41.846457 11855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 04:07:41.848168 11855 catalog_manager.cc:1347] Generated new cluster ID: 20b93359dffd4a9d9106831e200e1c2a
I20260810 04:07:41.848225 11855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 04:07:41.854252 11855 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 04:07:41.854936 11855 catalog_manager.cc:1504] Loading token signing keys...
I20260810 04:07:41.858476 11855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6c18e8f294324c9eb727c470c703941a: Generated new TSK 0
I20260810 04:07:41.858677 11855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 04:07:41.860327 11761 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskPMk8pX/build/release/bin/kudu
/tmp/dist-test-taskPMk8pX/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.124.65:0
--local_ip_for_outbound_sockets=127.11.124.65
--webserver_interface=127.11.124.65
--webserver_port=0
--tserver_master_addrs=127.11.124.126:43605
--builtin_ntp_servers=127.11.124.84:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
W20260810 04:07:41.956651 11869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:07:41.956909 11869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:07:41.956936 11869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:07:41.958397 11869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:07:41.958462 11869 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260810 04:07:41.958478 11869 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260810 04:07:41.958499 11869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.124.65
I20260810 04:07:41.960175 11869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.124.84:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.124.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.124.65
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.11.124.126:43605
--never_fsync=true
--heap_profile_path=/tmp/kudu.11869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.124.65
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:07:41.960480 11869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:07:41.960862 11869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:07:41.967190 11875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:07:41.967463 11869 server_base.cc:1034] running on GCE node
W20260810 04:07:41.967243 11876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:07:41.967204 11879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:07:41.967912 11869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:07:41.968209 11869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:07:41.969422 11869 hybrid_clock.cc:648] HybridClock initialized: now 1786334861969397 us; error 41 us; skew 500 ppm
I20260810 04:07:41.971060 11869 webserver.cc:460] Webserver started at http://127.11.124.65:37209/ using document root <none> and password file <none>
I20260810 04:07:41.971364 11869 fs_manager.cc:359] Metadata directory not provided
I20260810 04:07:41.971447 11869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:07:41.971628 11869 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:07:41.972769 11869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data/instance:
uuid: "e01b412b1a4e41fd82def561b7b77eb6"
format_stamp: "Formatted at 2026-08-10 04:07:41 on dist-test-slave-p3t5"
I20260810 04:07:41.973196 11869 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/wal/instance:
uuid: "e01b412b1a4e41fd82def561b7b77eb6"
format_stamp: "Formatted at 2026-08-10 04:07:41 on dist-test-slave-p3t5"
I20260810 04:07:41.974895 11869 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 04:07:41.975898 11886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:41.976089 11869 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:07:41.976214 11869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data,/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/wal
uuid: "e01b412b1a4e41fd82def561b7b77eb6"
format_stamp: "Formatted at 2026-08-10 04:07:41 on dist-test-slave-p3t5"
I20260810 04:07:41.976305 11869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:07:41.984737 11869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:07:41.985105 11869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:07:41.985283 11869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:07:41.985551 11869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:07:41.985973 11869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:07:41.986016 11869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:41.986042 11869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:07:41.986080 11869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:41.993304 11869 rpc_server.cc:307] RPC server started. Bound to: 127.11.124.65:36231
I20260810 04:07:41.993382 12010 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.124.65:36231 every 8 connection(s)
I20260810 04:07:41.993824 11869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data/info.pb
I20260810 04:07:41.999603 11761 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskPMk8pX/build/release/bin/kudu as pid 11869
I20260810 04:07:41.999708 11761 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/wal/instance
I20260810 04:07:42.000766 12011 heartbeater.cc:347] Connected to a master server at 127.11.124.126:43605
I20260810 04:07:42.000866 12011 heartbeater.cc:464] Registering TS with master...
I20260810 04:07:42.000993 11761 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskPMk8pX/build/release/bin/kudu
/tmp/dist-test-taskPMk8pX/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.124.66:0
--local_ip_for_outbound_sockets=127.11.124.66
--webserver_interface=127.11.124.66
--webserver_port=0
--tserver_master_addrs=127.11.124.126:43605
--builtin_ntp_servers=127.11.124.84:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
I20260810 04:07:42.001097 12011 heartbeater.cc:511] Master 127.11.124.126:43605 requested a full tablet report, sending...
I20260810 04:07:42.001698 11805 ts_manager.cc:194] Registered new tserver with Master: e01b412b1a4e41fd82def561b7b77eb6 (127.11.124.65:36231)
I20260810 04:07:42.002290 11805 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.124.65:59583
W20260810 04:07:42.085736 12015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:07:42.085986 12015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:07:42.086011 12015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:07:42.087172 12015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:07:42.087220 12015 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260810 04:07:42.087234 12015 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260810 04:07:42.087251 12015 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.124.66
I20260810 04:07:42.088594 12015 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.124.84:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.124.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.124.66
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.11.124.126:43605
--never_fsync=true
--heap_profile_path=/tmp/kudu.12015
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.124.66
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:07:42.088804 12015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:07:42.089094 12015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:07:42.094515 12021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:07:42.094522 12023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:07:42.094515 12025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:07:42.094904 12015 server_base.cc:1034] running on GCE node
I20260810 04:07:42.095141 12015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:07:42.095474 12015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:07:42.096704 12015 hybrid_clock.cc:648] HybridClock initialized: now 1786334862096680 us; error 38 us; skew 500 ppm
I20260810 04:07:42.098649 12015 webserver.cc:460] Webserver started at http://127.11.124.66:40497/ using document root <none> and password file <none>
I20260810 04:07:42.099022 12015 fs_manager.cc:359] Metadata directory not provided
I20260810 04:07:42.099114 12015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:07:42.099282 12015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:07:42.100463 12015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/instance:
uuid: "acddf9da1c35419fa41b33c4a970b016"
format_stamp: "Formatted at 2026-08-10 04:07:42 on dist-test-slave-p3t5"
I20260810 04:07:42.100903 12015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/wal/instance:
uuid: "acddf9da1c35419fa41b33c4a970b016"
format_stamp: "Formatted at 2026-08-10 04:07:42 on dist-test-slave-p3t5"
I20260810 04:07:42.102456 12015 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260810 04:07:42.103461 12032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:42.103696 12015 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:07:42.103798 12015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data,/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/wal
uuid: "acddf9da1c35419fa41b33c4a970b016"
format_stamp: "Formatted at 2026-08-10 04:07:42 on dist-test-slave-p3t5"
I20260810 04:07:42.103916 12015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:07:42.113554 12015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:07:42.113982 12015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:07:42.114151 12015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:07:42.114406 12015 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:07:42.114769 12015 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:07:42.114827 12015 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:42.114874 12015 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:07:42.114930 12015 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:42.121274 12015 rpc_server.cc:307] RPC server started. Bound to: 127.11.124.66:37619
I20260810 04:07:42.121364 12156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.124.66:37619 every 8 connection(s)
I20260810 04:07:42.121762 12015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/info.pb
I20260810 04:07:42.127221 11761 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskPMk8pX/build/release/bin/kudu as pid 12015
I20260810 04:07:42.127337 11761 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/wal/instance
I20260810 04:07:42.128271 12157 heartbeater.cc:347] Connected to a master server at 127.11.124.126:43605
I20260810 04:07:42.128373 12157 heartbeater.cc:464] Registering TS with master...
I20260810 04:07:42.128531 11761 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskPMk8pX/build/release/bin/kudu
/tmp/dist-test-taskPMk8pX/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.124.67:0
--local_ip_for_outbound_sockets=127.11.124.67
--webserver_interface=127.11.124.67
--webserver_port=0
--tserver_master_addrs=127.11.124.126:43605
--builtin_ntp_servers=127.11.124.84:41249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
I20260810 04:07:42.128568 12157 heartbeater.cc:511] Master 127.11.124.126:43605 requested a full tablet report, sending...
I20260810 04:07:42.128993 11804 ts_manager.cc:194] Registered new tserver with Master: acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619)
I20260810 04:07:42.129403 11804 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.124.66:33841
W20260810 04:07:42.214496 12160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:07:42.214733 12160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:07:42.214758 12160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:07:42.215922 12160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:07:42.215965 12160 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260810 04:07:42.215977 12160 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260810 04:07:42.215996 12160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.124.67
I20260810 04:07:42.217389 12160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.124.84:41249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.124.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.124.67
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.11.124.126:43605
--never_fsync=true
--heap_profile_path=/tmp/kudu.12160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.124.67
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:07:42.217685 12160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:07:42.218050 12160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:07:42.223222 12165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:07:42.223302 12167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:07:42.223372 12169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:07:42.223567 12160 server_base.cc:1034] running on GCE node
I20260810 04:07:42.223825 12160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:07:42.224099 12160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:07:42.225253 12160 hybrid_clock.cc:648] HybridClock initialized: now 1786334862225225 us; error 41 us; skew 500 ppm
I20260810 04:07:42.226653 12160 webserver.cc:460] Webserver started at http://127.11.124.67:36033/ using document root <none> and password file <none>
I20260810 04:07:42.226943 12160 fs_manager.cc:359] Metadata directory not provided
I20260810 04:07:42.227017 12160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:07:42.227175 12160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:07:42.228235 12160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data/instance:
uuid: "b35292870ed0423cb5c34ab9b41d2f1f"
format_stamp: "Formatted at 2026-08-10 04:07:42 on dist-test-slave-p3t5"
I20260810 04:07:42.228624 12160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/wal/instance:
uuid: "b35292870ed0423cb5c34ab9b41d2f1f"
format_stamp: "Formatted at 2026-08-10 04:07:42 on dist-test-slave-p3t5"
I20260810 04:07:42.230125 12160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 04:07:42.231066 12176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:42.231262 12160 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 04:07:42.231379 12160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data,/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/wal
uuid: "b35292870ed0423cb5c34ab9b41d2f1f"
format_stamp: "Formatted at 2026-08-10 04:07:42 on dist-test-slave-p3t5"
I20260810 04:07:42.231460 12160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:07:42.261492 12160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:07:42.261910 12160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:07:42.262085 12160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:07:42.262358 12160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 04:07:42.262742 12160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 04:07:42.262809 12160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:42.262847 12160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 04:07:42.262897 12160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:42.268998 12160 rpc_server.cc:307] RPC server started. Bound to: 127.11.124.67:40295
I20260810 04:07:42.269047 12303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.124.67:40295 every 8 connection(s)
I20260810 04:07:42.269431 12160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data/info.pb
I20260810 04:07:42.275434 11761 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskPMk8pX/build/release/bin/kudu as pid 12160
I20260810 04:07:42.275569 11761 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/wal/instance
I20260810 04:07:42.275821 12304 heartbeater.cc:347] Connected to a master server at 127.11.124.126:43605
I20260810 04:07:42.275933 12304 heartbeater.cc:464] Registering TS with master...
I20260810 04:07:42.276135 12304 heartbeater.cc:511] Master 127.11.124.126:43605 requested a full tablet report, sending...
I20260810 04:07:42.276558 11804 ts_manager.cc:194] Registered new tserver with Master: b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295)
I20260810 04:07:42.277050 11761 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 04:07:42.277114 11804 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.124.67:53917
I20260810 04:07:42.284474 11804 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36158:
name: "all-types-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int8_val"
type: INT8
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int16_val"
type: INT16
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int32_val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int64_val"
type: INT64
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "timestamp_val"
type: UNIXTIME_MICROS
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "date_val"
type: DATE
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "varchar_val"
type: VARCHAR
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
length: 65535
}
immutable: false
}
columns {
name: "bool_val"
type: BOOL
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "float_val"
type: FLOAT
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "double_val"
type: DOUBLE
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "binary_val"
type: BINARY
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "decimal32_val"
type: DECIMAL32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
precision: 9
scale: 0
}
immutable: false
}
columns {
name: "decimal64_val"
type: DECIMAL64
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
precision: 18
scale: 0
}
immutable: false
}
columns {
name: "decimal128_val"
type: DECIMAL128
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
type_attributes {
precision: 38
scale: 0
}
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000\000\000\252\252\252*\004\001\000\000\000TUUU"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 04:07:42.286329 11804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table all-types-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 04:07:42.293903 12085 tablet_service.cc:1467] Processing CreateTablet for tablet 86528d4204c64ac3904a4b2b2f4b2844 (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260810 04:07:42.294039 12230 tablet_service.cc:1467] Processing CreateTablet for tablet 86528d4204c64ac3904a4b2b2f4b2844 (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260810 04:07:42.294046 12228 tablet_service.cc:1467] Processing CreateTablet for tablet fb83c6ec33d54750883ece528a2c6c3e (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260810 04:07:42.294086 11939 tablet_service.cc:1467] Processing CreateTablet for tablet 86528d4204c64ac3904a4b2b2f4b2844 (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260810 04:07:42.294369 12085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86528d4204c64ac3904a4b2b2f4b2844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.294396 12230 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86528d4204c64ac3904a4b2b2f4b2844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.294438 11939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86528d4204c64ac3904a4b2b2f4b2844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.294544 12228 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb83c6ec33d54750883ece528a2c6c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.296696 12229 tablet_service.cc:1467] Processing CreateTablet for tablet 4c01dce2e7dc413c982d5177d71719a9 (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260810 04:07:42.296800 12229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c01dce2e7dc413c982d5177d71719a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.297736 12084 tablet_service.cc:1467] Processing CreateTablet for tablet 4c01dce2e7dc413c982d5177d71719a9 (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260810 04:07:42.297751 11938 tablet_service.cc:1467] Processing CreateTablet for tablet 4c01dce2e7dc413c982d5177d71719a9 (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260810 04:07:42.297842 12084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c01dce2e7dc413c982d5177d71719a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.297861 11938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4c01dce2e7dc413c982d5177d71719a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.298497 12320 tablet_bootstrap.cc:492] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6: Bootstrap starting.
I20260810 04:07:42.299036 12083 tablet_service.cc:1467] Processing CreateTablet for tablet fb83c6ec33d54750883ece528a2c6c3e (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260810 04:07:42.299114 11937 tablet_service.cc:1467] Processing CreateTablet for tablet fb83c6ec33d54750883ece528a2c6c3e (DEFAULT_TABLE table=all-types-table [id=3272a6bb1ed34634a1a2a4851363847d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260810 04:07:42.299180 12083 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb83c6ec33d54750883ece528a2c6c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.299207 11937 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb83c6ec33d54750883ece528a2c6c3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 04:07:42.299342 12319 tablet_bootstrap.cc:492] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f: Bootstrap starting.
I20260810 04:07:42.299960 12319 tablet_bootstrap.cc:654] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.300460 12321 tablet_bootstrap.cc:492] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016: Bootstrap starting.
I20260810 04:07:42.300539 12319 log.cc:824] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f: Log is configured to *not* fsync() on all Append() calls
I20260810 04:07:42.299216 12320 tablet_bootstrap.cc:654] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.301079 12321 tablet_bootstrap.cc:654] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.301344 12319 tablet_bootstrap.cc:492] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f: No bootstrap required, opened a new log
I20260810 04:07:42.301429 12319 ts_tablet_manager.cc:1397] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:07:42.301469 12320 log.cc:824] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6: Log is configured to *not* fsync() on all Append() calls
I20260810 04:07:42.301723 12321 log.cc:824] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016: Log is configured to *not* fsync() on all Append() calls
I20260810 04:07:42.302211 12320 tablet_bootstrap.cc:492] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6: No bootstrap required, opened a new log
I20260810 04:07:42.302294 12320 ts_tablet_manager.cc:1397] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260810 04:07:42.302472 12321 tablet_bootstrap.cc:492] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016: No bootstrap required, opened a new log
I20260810 04:07:42.302583 12321 ts_tablet_manager.cc:1397] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 04:07:42.303601 12319 raft_consensus.cc:348] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.303793 12319 raft_consensus.cc:374] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.303833 12319 raft_consensus.cc:729] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b35292870ed0423cb5c34ab9b41d2f1f, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.304020 12319 consensus_queue.cc:260] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.304155 12320 raft_consensus.cc:348] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.304316 12319 ts_tablet_manager.cc:1428] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:07:42.304337 12320 raft_consensus.cc:374] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.304420 12320 raft_consensus.cc:729] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01b412b1a4e41fd82def561b7b77eb6, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.304450 12304 heartbeater.cc:503] Master 127.11.124.126:43605 was elected leader, sending a full tablet report...
I20260810 04:07:42.304438 12319 tablet_bootstrap.cc:492] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f: Bootstrap starting.
I20260810 04:07:42.304590 12320 consensus_queue.cc:260] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.304709 12321 raft_consensus.cc:348] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.304872 12321 raft_consensus.cc:374] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.304869 12320 ts_tablet_manager.cc:1428] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 04:07:42.304912 12321 raft_consensus.cc:729] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acddf9da1c35419fa41b33c4a970b016, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.304962 12319 tablet_bootstrap.cc:654] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.305006 12011 heartbeater.cc:503] Master 127.11.124.126:43605 was elected leader, sending a full tablet report...
I20260810 04:07:42.305035 12320 tablet_bootstrap.cc:492] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6: Bootstrap starting.
I20260810 04:07:42.305037 12321 consensus_queue.cc:260] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.305323 12321 ts_tablet_manager.cc:1428] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 04:07:42.305440 12321 tablet_bootstrap.cc:492] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016: Bootstrap starting.
I20260810 04:07:42.305778 12157 heartbeater.cc:503] Master 127.11.124.126:43605 was elected leader, sending a full tablet report...
I20260810 04:07:42.305871 12321 tablet_bootstrap.cc:654] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.306010 12319 tablet_bootstrap.cc:492] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f: No bootstrap required, opened a new log
I20260810 04:07:42.306053 12319 ts_tablet_manager.cc:1397] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:07:42.306222 12319 raft_consensus.cc:348] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.306316 12319 raft_consensus.cc:374] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.306341 12319 raft_consensus.cc:729] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b35292870ed0423cb5c34ab9b41d2f1f, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.306391 12319 consensus_queue.cc:260] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.306492 12321 tablet_bootstrap.cc:492] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016: No bootstrap required, opened a new log
I20260810 04:07:42.306516 12319 ts_tablet_manager.cc:1428] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:07:42.306531 12321 ts_tablet_manager.cc:1397] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:07:42.306591 12319 tablet_bootstrap.cc:492] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f: Bootstrap starting.
I20260810 04:07:42.306704 12321 raft_consensus.cc:348] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.306805 12321 raft_consensus.cc:374] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.306830 12321 raft_consensus.cc:729] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acddf9da1c35419fa41b33c4a970b016, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.306875 12321 consensus_queue.cc:260] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.307039 12321 ts_tablet_manager.cc:1428] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:07:42.307066 12319 tablet_bootstrap.cc:654] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.307140 12320 tablet_bootstrap.cc:654] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.307279 12321 tablet_bootstrap.cc:492] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016: Bootstrap starting.
I20260810 04:07:42.307739 12321 tablet_bootstrap.cc:654] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.307788 12320 tablet_bootstrap.cc:492] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6: No bootstrap required, opened a new log
I20260810 04:07:42.307861 12320 ts_tablet_manager.cc:1397] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260810 04:07:42.308032 12320 raft_consensus.cc:348] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.308099 12320 raft_consensus.cc:374] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.308116 12320 raft_consensus.cc:729] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01b412b1a4e41fd82def561b7b77eb6, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.308157 12319 tablet_bootstrap.cc:492] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f: No bootstrap required, opened a new log
I20260810 04:07:42.308174 12320 consensus_queue.cc:260] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.308203 12319 ts_tablet_manager.cc:1397] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 04:07:42.308311 12320 ts_tablet_manager.cc:1428] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 04:07:42.308350 12319 raft_consensus.cc:348] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.308424 12319 raft_consensus.cc:374] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.308451 12319 raft_consensus.cc:729] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b35292870ed0423cb5c34ab9b41d2f1f, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.308497 12319 consensus_queue.cc:260] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.308590 12319 ts_tablet_manager.cc:1428] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 04:07:42.308714 12321 tablet_bootstrap.cc:492] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016: No bootstrap required, opened a new log
I20260810 04:07:42.308759 12321 ts_tablet_manager.cc:1397] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 04:07:42.308835 12320 tablet_bootstrap.cc:492] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6: Bootstrap starting.
I20260810 04:07:42.308887 12321 raft_consensus.cc:348] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.308944 12321 raft_consensus.cc:374] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.308957 12321 raft_consensus.cc:729] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acddf9da1c35419fa41b33c4a970b016, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.309022 12321 consensus_queue.cc:260] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.309109 12321 ts_tablet_manager.cc:1428] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:42.309238 12320 tablet_bootstrap.cc:654] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6: Neither blocks nor log segments found. Creating new log.
I20260810 04:07:42.310204 12320 tablet_bootstrap.cc:492] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6: No bootstrap required, opened a new log
I20260810 04:07:42.310251 12320 ts_tablet_manager.cc:1397] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 04:07:42.310387 12320 raft_consensus.cc:348] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.310464 12320 raft_consensus.cc:374] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 04:07:42.310487 12320 raft_consensus.cc:729] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01b412b1a4e41fd82def561b7b77eb6, State: Initialized, Role: FOLLOWER
I20260810 04:07:42.310529 12320 consensus_queue.cc:260] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.310616 12320 ts_tablet_manager.cc:1428] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:42.317698 12336 raft_consensus.cc:482] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:07:42.317857 12336 raft_consensus.cc:504] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.318230 12336 leader_election.cc:288] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619), b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295)
I20260810 04:07:42.321458 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c01dce2e7dc413c982d5177d71719a9" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acddf9da1c35419fa41b33c4a970b016" is_pre_election: true
I20260810 04:07:42.321502 12253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c01dce2e7dc413c982d5177d71719a9" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" is_pre_election: true
I20260810 04:07:42.321677 12108 raft_consensus.cc:2454] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 0.
I20260810 04:07:42.321722 12253 raft_consensus.cc:2454] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 0.
I20260810 04:07:42.321933 11890 leader_election.cc:302] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acddf9da1c35419fa41b33c4a970b016, e01b412b1a4e41fd82def561b7b77eb6; no voters:
I20260810 04:07:42.322153 12336 raft_consensus.cc:2781] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:07:42.322217 12336 raft_consensus.cc:482] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:07:42.322254 12336 raft_consensus.cc:3037] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.322992 12336 raft_consensus.cc:504] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.323140 12336 leader_election.cc:288] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 1 election: Requested vote from peers acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619), b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295)
I20260810 04:07:42.323267 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c01dce2e7dc413c982d5177d71719a9" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acddf9da1c35419fa41b33c4a970b016"
I20260810 04:07:42.323354 12253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c01dce2e7dc413c982d5177d71719a9" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b35292870ed0423cb5c34ab9b41d2f1f"
I20260810 04:07:42.323364 12108 raft_consensus.cc:3037] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.323441 12253 raft_consensus.cc:3037] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.324275 12108 raft_consensus.cc:2454] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 1.
I20260810 04:07:42.324275 12253 raft_consensus.cc:2454] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 1.
I20260810 04:07:42.324523 11887 leader_election.cc:302] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b35292870ed0423cb5c34ab9b41d2f1f, e01b412b1a4e41fd82def561b7b77eb6; no voters:
I20260810 04:07:42.324640 12336 raft_consensus.cc:2781] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:07:42.324723 12336 raft_consensus.cc:686] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 LEADER]: Becoming Leader. State: Replica: e01b412b1a4e41fd82def561b7b77eb6, State: Running, Role: LEADER
I20260810 04:07:42.324828 12336 consensus_queue.cc:237] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.325927 11805 catalog_manager.cc:5495] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e01b412b1a4e41fd82def561b7b77eb6 (127.11.124.65). New cstate: current_term: 1 leader_uuid: "e01b412b1a4e41fd82def561b7b77eb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
I20260810 04:07:42.361985 12329 raft_consensus.cc:482] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:07:42.362129 12329 raft_consensus.cc:504] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.362530 12329 leader_election.cc:288] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295), e01b412b1a4e41fd82def561b7b77eb6 (127.11.124.65:36231)
I20260810 04:07:42.366048 12253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" candidate_uuid: "acddf9da1c35419fa41b33c4a970b016" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" is_pre_election: true
I20260810 04:07:42.366125 11961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" candidate_uuid: "acddf9da1c35419fa41b33c4a970b016" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e01b412b1a4e41fd82def561b7b77eb6" is_pre_election: true
I20260810 04:07:42.366194 12253 raft_consensus.cc:2454] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acddf9da1c35419fa41b33c4a970b016 in term 0.
I20260810 04:07:42.366250 11961 raft_consensus.cc:2454] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate acddf9da1c35419fa41b33c4a970b016 in term 0.
I20260810 04:07:42.366475 12036 leader_election.cc:302] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acddf9da1c35419fa41b33c4a970b016, e01b412b1a4e41fd82def561b7b77eb6; no voters:
I20260810 04:07:42.366631 12329 raft_consensus.cc:2781] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:07:42.366679 12329 raft_consensus.cc:482] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:07:42.366701 12329 raft_consensus.cc:3037] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.367406 12329 raft_consensus.cc:504] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.367566 12329 leader_election.cc:288] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [CANDIDATE]: Term 1 election: Requested vote from peers b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295), e01b412b1a4e41fd82def561b7b77eb6 (127.11.124.65:36231)
I20260810 04:07:42.367760 11961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" candidate_uuid: "acddf9da1c35419fa41b33c4a970b016" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e01b412b1a4e41fd82def561b7b77eb6"
I20260810 04:07:42.367832 11961 raft_consensus.cc:3037] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.367756 12253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" candidate_uuid: "acddf9da1c35419fa41b33c4a970b016" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b35292870ed0423cb5c34ab9b41d2f1f"
I20260810 04:07:42.367892 12253 raft_consensus.cc:3037] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.368482 11961 raft_consensus.cc:2454] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acddf9da1c35419fa41b33c4a970b016 in term 1.
I20260810 04:07:42.368495 12253 raft_consensus.cc:2454] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate acddf9da1c35419fa41b33c4a970b016 in term 1.
I20260810 04:07:42.368665 12036 leader_election.cc:302] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acddf9da1c35419fa41b33c4a970b016, e01b412b1a4e41fd82def561b7b77eb6; no voters:
I20260810 04:07:42.368772 12329 raft_consensus.cc:2781] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:07:42.368836 12329 raft_consensus.cc:686] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [term 1 LEADER]: Becoming Leader. State: Replica: acddf9da1c35419fa41b33c4a970b016, State: Running, Role: LEADER
I20260810 04:07:42.368927 12329 consensus_queue.cc:237] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:42.369856 11805 catalog_manager.cc:5495] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 reported cstate change: term changed from 0 to 1, leader changed from <none> to acddf9da1c35419fa41b33c4a970b016 (127.11.124.66). New cstate: current_term: 1 leader_uuid: "acddf9da1c35419fa41b33c4a970b016" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } health_report { overall_health: UNKNOWN } } }
W20260810 04:07:42.372332 12158 tablet.cc:2369] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:07:42.445668 12336 raft_consensus.cc:482] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 04:07:42.445789 12336 raft_consensus.cc:504] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.446009 12336 leader_election.cc:288] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619), b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295)
I20260810 04:07:42.446345 12253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb83c6ec33d54750883ece528a2c6c3e" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" is_pre_election: true
I20260810 04:07:42.446328 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb83c6ec33d54750883ece528a2c6c3e" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acddf9da1c35419fa41b33c4a970b016" is_pre_election: true
I20260810 04:07:42.446463 12253 raft_consensus.cc:2454] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 0.
I20260810 04:07:42.446496 12108 raft_consensus.cc:2454] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 0.
I20260810 04:07:42.446669 11887 leader_election.cc:302] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b35292870ed0423cb5c34ab9b41d2f1f, e01b412b1a4e41fd82def561b7b77eb6; no voters:
I20260810 04:07:42.446808 12336 raft_consensus.cc:2781] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 04:07:42.446878 12336 raft_consensus.cc:482] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 04:07:42.446911 12336 raft_consensus.cc:3037] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.447579 12336 raft_consensus.cc:504] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.447728 12336 leader_election.cc:288] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 1 election: Requested vote from peers acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619), b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295)
I20260810 04:07:42.447925 12253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb83c6ec33d54750883ece528a2c6c3e" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b35292870ed0423cb5c34ab9b41d2f1f"
I20260810 04:07:42.447948 12108 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb83c6ec33d54750883ece528a2c6c3e" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "acddf9da1c35419fa41b33c4a970b016"
I20260810 04:07:42.448012 12253 raft_consensus.cc:3037] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.448012 12108 raft_consensus.cc:3037] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016 [term 0 FOLLOWER]: Advancing to term 1
I20260810 04:07:42.448776 12108 raft_consensus.cc:2454] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 1.
I20260810 04:07:42.448833 12253 raft_consensus.cc:2454] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 1.
I20260810 04:07:42.448988 11890 leader_election.cc:302] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: acddf9da1c35419fa41b33c4a970b016, e01b412b1a4e41fd82def561b7b77eb6; no voters:
I20260810 04:07:42.449139 12336 raft_consensus.cc:2781] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 04:07:42.449195 12336 raft_consensus.cc:686] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [term 1 LEADER]: Becoming Leader. State: Replica: e01b412b1a4e41fd82def561b7b77eb6, State: Running, Role: LEADER
I20260810 04:07:42.449262 12336 consensus_queue.cc:237] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } }
I20260810 04:07:42.449991 11805 catalog_manager.cc:5495] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 reported cstate change: term changed from 0 to 1, leader changed from <none> to e01b412b1a4e41fd82def561b7b77eb6 (127.11.124.65). New cstate: current_term: 1 leader_uuid: "e01b412b1a4e41fd82def561b7b77eb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } health_report { overall_health: UNKNOWN } } }
W20260810 04:07:42.494673 12013 tablet.cc:2369] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 04:07:42.520170 12305 tablet.cc:2369] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 04:07:42.615687 12108 raft_consensus.cc:1261] T fb83c6ec33d54750883ece528a2c6c3e P acddf9da1c35419fa41b33c4a970b016 [term 1 FOLLOWER]: Refusing update from remote peer e01b412b1a4e41fd82def561b7b77eb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:07:42.615687 12253 raft_consensus.cc:1261] T fb83c6ec33d54750883ece528a2c6c3e P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Refusing update from remote peer e01b412b1a4e41fd82def561b7b77eb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:07:42.616066 12336 consensus_queue.cc:1035] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:07:42.616226 12328 consensus_queue.cc:1035] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:07:42.634853 12352 mvcc.cc:205] Tried to move back new op lower bound from 7316827597258862592 to 7316827596592435200. Current Snapshot: MvccSnapshot[applied={T|T < 7316827597258862592}]
I20260810 04:07:42.637526 11961 raft_consensus.cc:1261] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Refusing update from remote peer acddf9da1c35419fa41b33c4a970b016: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:07:42.638020 12329 consensus_queue.cc:1035] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:07:42.642627 12355 mvcc.cc:205] Tried to move back new op lower bound from 7316827597258862592 to 7316827596592435200. Current Snapshot: MvccSnapshot[applied={T|T < 7316827597258862592}]
I20260810 04:07:42.651182 12350 mvcc.cc:205] Tried to move back new op lower bound from 7316827597258862592 to 7316827596592435200. Current Snapshot: MvccSnapshot[applied={T|T < 7316827597258862592}]
I20260810 04:07:42.654031 12253 raft_consensus.cc:1261] T 4c01dce2e7dc413c982d5177d71719a9 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Refusing update from remote peer e01b412b1a4e41fd82def561b7b77eb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:07:42.654026 12108 raft_consensus.cc:1261] T 4c01dce2e7dc413c982d5177d71719a9 P acddf9da1c35419fa41b33c4a970b016 [term 1 FOLLOWER]: Refusing update from remote peer e01b412b1a4e41fd82def561b7b77eb6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:07:42.654321 12336 consensus_queue.cc:1035] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:07:42.654477 12357 consensus_queue.cc:1035] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:07:42.660557 12252 raft_consensus.cc:1261] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Refusing update from remote peer acddf9da1c35419fa41b33c4a970b016: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 04:07:42.665973 12329 consensus_queue.cc:1035] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 04:07:42.745288 12013 maintenance_manager.cc:419] P e01b412b1a4e41fd82def561b7b77eb6: Scheduling FlushMRSOp(4c01dce2e7dc413c982d5177d71719a9): perf score=1.937278
I20260810 04:07:42.770807 12305 maintenance_manager.cc:419] P b35292870ed0423cb5c34ab9b41d2f1f: Scheduling FlushMRSOp(4c01dce2e7dc413c982d5177d71719a9): perf score=1.937278
I20260810 04:07:42.774946 12230 tablet_service.cc:1429] Tablet server has 0 leaders and 0 scanners
I20260810 04:07:42.775614 12085 tablet_service.cc:1429] Tablet server has 1 leaders and 0 scanners
I20260810 04:07:42.795454 11939 tablet_service.cc:1429] Tablet server has 2 leaders and 0 scanners
Master Summary
UUID | Address | Status
----------------------------------+----------------------+---------
6c18e8f294324c9eb727c470c703941a | 127.11.124.126:43605 | HEALTHY
Unusual flags for Master:
Flag | Value | Tags | Master
----------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------------+-----------------+-------------------------
ipki_ca_key_size | 768 | experimental | all 1 server(s) checked
ipki_server_key_size | 768 | experimental | all 1 server(s) checked
never_fsync | true | unsafe,advanced | all 1 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 1 server(s) checked
rpc_reuseport | true | experimental | all 1 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 1 server(s) checked
server_dump_info_format | pb | hidden | all 1 server(s) checked
server_dump_info_path | /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/info.pb | hidden | all 1 server(s) checked
tsk_num_rsa_bits | 512 | experimental | all 1 server(s) checked
Flags of checked categories for Master:
Flag | Value | Master
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.11.124.84:41249 | all 1 server(s) checked
time_source | builtin | all 1 server(s) checked
Tablet Server Summary
UUID | Address | Status | Location | Tablet Leaders | Active Scanners
----------------------------------+---------------------+---------+----------+----------------+-----------------
acddf9da1c35419fa41b33c4a970b016 | 127.11.124.66:37619 | HEALTHY | <none> | 1 | 0
b35292870ed0423cb5c34ab9b41d2f1f | 127.11.124.67:40295 | HEALTHY | <none> | 0 | 0
e01b412b1a4e41fd82def561b7b77eb6 | 127.11.124.65:36231 | HEALTHY | <none> | 2 | 0
Tablet Server Location Summary
Location | Count
----------+---------
<none> | 3
Unusual flags for Tablet Server:
Flag | Value | Tags | Tablet Server
--------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------------+----------------------+-------------------------
flush_threshold_mb | 1 | runtime,experimental | all 3 server(s) checked
ipki_server_key_size | 768 | experimental | all 3 server(s) checked
local_ip_for_outbound_sockets | 127.11.124.65 | experimental | 127.11.124.65:36231
local_ip_for_outbound_sockets | 127.11.124.66 | experimental | 127.11.124.66:37619
local_ip_for_outbound_sockets | 127.11.124.67 | experimental | 127.11.124.67:40295
never_fsync | true | unsafe,advanced | all 3 server(s) checked
openssl_security_level_override | 0 | unsafe,hidden | all 3 server(s) checked
rpc_server_allow_ephemeral_ports | true | unsafe | all 3 server(s) checked
server_dump_info_format | pb | hidden | all 3 server(s) checked
server_dump_info_path | /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-0/data/info.pb | hidden | 127.11.124.65:36231
server_dump_info_path | /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/info.pb | hidden | 127.11.124.66:37619
server_dump_info_path | /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-2/data/info.pb | hidden | 127.11.124.67:40295
tablet_delta_store_major_compact_min_ratio | 0.001 | experimental | all 3 server(s) checked
Flags of checked categories for Tablet Server:
Flag | Value | Tablet Server
---------------------+---------------------+-------------------------
builtin_ntp_servers | 127.11.124.84:41249 | all 3 server(s) checked
time_source | builtin | all 3 server(s) checked
Version Summary
Version | Servers
-----------------+-------------------------
1.18.0-SNAPSHOT | all 4 server(s) checked
Tablet Summary
The cluster doesn't have any matching system tables
Summary by table
Name | RF | Status | Total Tablets | Healthy | Recovering | Under-replicated | Unavailable
-----------------+----+---------+---------------+---------+------------+------------------+-------------
all-types-table | 3 | HEALTHY | 3 | 3 | 0 | 0 | 0
Tablet Replica Count Summary
Statistic | Replica Count
----------------+---------------
Minimum | 3
First Quartile | 3
Median | 3
Third Quartile | 3
Maximum | 3
Total Count Summary
| Total Count
----------------+-------------
Masters | 1
Tablet Servers | 3
Tables | 1
Tablets | 3
Replicas | 9
==================
Warnings:
==================
Some masters have unsafe, experimental, or hidden flags set
Some tablet servers have unsafe, experimental, or hidden flags set
OK
I20260810 04:07:42.805279 11761 log_verifier.cc:126] Checking tablet 4c01dce2e7dc413c982d5177d71719a9
I20260810 04:07:42.855352 11891 maintenance_manager.cc:643] P e01b412b1a4e41fd82def561b7b77eb6: FlushMRSOp(4c01dce2e7dc413c982d5177d71719a9) complete. Timing: real 0.110s user 0.047s sys 0.033s Metrics: {"bytes_written":472622,"cfile_init":1,"compiler_manager_pool.queue_time_us":5799,"drs_written":1,"lbm_read_time_us":23,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1568,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000,"thread_start_us":195,"threads_started":2}
I20260810 04:07:42.855909 12013 maintenance_manager.cc:419] P e01b412b1a4e41fd82def561b7b77eb6: Scheduling UndoDeltaBlockGCOp(4c01dce2e7dc413c982d5177d71719a9): 62921 bytes on disk
I20260810 04:07:42.856256 11891 maintenance_manager.cc:643] P e01b412b1a4e41fd82def561b7b77eb6: UndoDeltaBlockGCOp(4c01dce2e7dc413c982d5177d71719a9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":28,"lbm_reads_lt_1ms":4}
I20260810 04:07:42.856500 12013 maintenance_manager.cc:419] P e01b412b1a4e41fd82def561b7b77eb6: Scheduling FlushMRSOp(86528d4204c64ac3904a4b2b2f4b2844): perf score=1.937278
I20260810 04:07:42.861303 11761 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 4c01dce2e7dc413c982d5177d71719a9
I20260810 04:07:42.861420 11761 log_verifier.cc:126] Checking tablet 86528d4204c64ac3904a4b2b2f4b2844
I20260810 04:07:42.873037 12158 maintenance_manager.cc:419] P acddf9da1c35419fa41b33c4a970b016: Scheduling FlushMRSOp(4c01dce2e7dc413c982d5177d71719a9): perf score=1.937278
I20260810 04:07:42.895323 11891 maintenance_manager.cc:643] P e01b412b1a4e41fd82def561b7b77eb6: FlushMRSOp(86528d4204c64ac3904a4b2b2f4b2844) complete. Timing: real 0.039s user 0.034s sys 0.003s Metrics: {"bytes_written":436486,"cfile_init":1,"dirs.queue_time_us":41,"dirs.run_cpu_time_us":176,"dirs.run_wall_time_us":1364,"drs_written":1,"lbm_read_time_us":19,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1449,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000}
I20260810 04:07:42.895661 12013 maintenance_manager.cc:419] P e01b412b1a4e41fd82def561b7b77eb6: Scheduling FlushMRSOp(fb83c6ec33d54750883ece528a2c6c3e): perf score=1.937278
I20260810 04:07:42.934237 11891 maintenance_manager.cc:643] P e01b412b1a4e41fd82def561b7b77eb6: FlushMRSOp(fb83c6ec33d54750883ece528a2c6c3e) complete. Timing: real 0.038s user 0.037s sys 0.000s Metrics: {"bytes_written":473407,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":147,"dirs.run_wall_time_us":1368,"drs_written":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1405,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000}
I20260810 04:07:42.934639 12013 maintenance_manager.cc:419] P e01b412b1a4e41fd82def561b7b77eb6: Scheduling UndoDeltaBlockGCOp(fb83c6ec33d54750883ece528a2c6c3e): 63426 bytes on disk
I20260810 04:07:42.934877 11891 maintenance_manager.cc:643] P e01b412b1a4e41fd82def561b7b77eb6: UndoDeltaBlockGCOp(fb83c6ec33d54750883ece528a2c6c3e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":27,"lbm_reads_lt_1ms":4}
I20260810 04:07:42.935040 12013 maintenance_manager.cc:419] P e01b412b1a4e41fd82def561b7b77eb6: Scheduling UndoDeltaBlockGCOp(86528d4204c64ac3904a4b2b2f4b2844): 62921 bytes on disk
I20260810 04:07:42.935205 11891 maintenance_manager.cc:643] P e01b412b1a4e41fd82def561b7b77eb6: UndoDeltaBlockGCOp(86528d4204c64ac3904a4b2b2f4b2844) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":24,"lbm_reads_lt_1ms":4}
I20260810 04:07:42.943269 11761 log_verifier.cc:177] Verified matching terms for 2 ops in tablet 86528d4204c64ac3904a4b2b2f4b2844
I20260810 04:07:42.943364 11761 log_verifier.cc:126] Checking tablet fb83c6ec33d54750883ece528a2c6c3e
I20260810 04:07:42.971727 12182 maintenance_manager.cc:643] P b35292870ed0423cb5c34ab9b41d2f1f: FlushMRSOp(4c01dce2e7dc413c982d5177d71719a9) complete. Timing: real 0.201s user 0.041s sys 0.048s Metrics: {"bytes_written":472622,"cfile_init":1,"compiler_manager_pool.queue_time_us":1216,"dirs.queue_time_us":6553,"drs_written":1,"lbm_read_time_us":29,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1859,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000,"thread_start_us":205,"threads_started":2}
I20260810 04:07:42.972333 12305 maintenance_manager.cc:419] P b35292870ed0423cb5c34ab9b41d2f1f: Scheduling UndoDeltaBlockGCOp(4c01dce2e7dc413c982d5177d71719a9): 62921 bytes on disk
I20260810 04:07:42.972710 12182 maintenance_manager.cc:643] P b35292870ed0423cb5c34ab9b41d2f1f: UndoDeltaBlockGCOp(4c01dce2e7dc413c982d5177d71719a9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":34,"lbm_reads_lt_1ms":4}
I20260810 04:07:42.972942 12305 maintenance_manager.cc:419] P b35292870ed0423cb5c34ab9b41d2f1f: Scheduling FlushMRSOp(86528d4204c64ac3904a4b2b2f4b2844): perf score=1.937278
W20260810 04:07:43.035674 12037 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/data (505552896 bytes available vs 518351011 bytes reserved) (error 28)
W20260810 04:07:43.043167 12037 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/ts-1/data/data (471994368 bytes available vs 518351011 bytes reserved) (error 28)
I20260810 04:07:43.051590 11761 log_verifier.cc:177] Verified matching terms for 3 ops in tablet fb83c6ec33d54750883ece528a2c6c3e
I20260810 04:07:43.051972 11761 test_util.cc:268] Using random seed: 2130070722
I20260810 04:07:43.061055 12182 maintenance_manager.cc:643] P b35292870ed0423cb5c34ab9b41d2f1f: FlushMRSOp(86528d4204c64ac3904a4b2b2f4b2844) complete. Timing: real 0.088s user 0.041s sys 0.000s Metrics: {"bytes_written":436486,"cfile_init":1,"dirs.queue_time_us":35,"dirs.run_cpu_time_us":202,"dirs.run_wall_time_us":1283,"drs_written":1,"lbm_read_time_us":16,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1450,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000}
I20260810 04:07:43.061581 12305 maintenance_manager.cc:419] P b35292870ed0423cb5c34ab9b41d2f1f: Scheduling UndoDeltaBlockGCOp(86528d4204c64ac3904a4b2b2f4b2844): 62921 bytes on disk
I20260810 04:07:43.062671 12182 maintenance_manager.cc:643] P b35292870ed0423cb5c34ab9b41d2f1f: UndoDeltaBlockGCOp(86528d4204c64ac3904a4b2b2f4b2844) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":29,"lbm_reads_lt_1ms":4}
I20260810 04:07:43.062853 12305 maintenance_manager.cc:419] P b35292870ed0423cb5c34ab9b41d2f1f: Scheduling FlushMRSOp(fb83c6ec33d54750883ece528a2c6c3e): perf score=1.937278
I20260810 04:07:43.117166 12182 maintenance_manager.cc:643] P b35292870ed0423cb5c34ab9b41d2f1f: FlushMRSOp(fb83c6ec33d54750883ece528a2c6c3e) complete. Timing: real 0.054s user 0.038s sys 0.000s Metrics: {"bytes_written":473407,"cfile_init":1,"dirs.queue_time_us":37,"dirs.run_cpu_time_us":157,"dirs.run_wall_time_us":1320,"drs_written":1,"lbm_read_time_us":20,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1538,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000}
I20260810 04:07:43.117465 12305 maintenance_manager.cc:419] P b35292870ed0423cb5c34ab9b41d2f1f: Scheduling UndoDeltaBlockGCOp(fb83c6ec33d54750883ece528a2c6c3e): 63426 bytes on disk
I20260810 04:07:43.117712 12182 maintenance_manager.cc:643] P b35292870ed0423cb5c34ab9b41d2f1f: UndoDeltaBlockGCOp(fb83c6ec33d54750883ece528a2c6c3e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4}
I20260810 04:07:43.120013 12037 maintenance_manager.cc:643] P acddf9da1c35419fa41b33c4a970b016: FlushMRSOp(4c01dce2e7dc413c982d5177d71719a9) complete. Timing: real 0.247s user 0.037s sys 0.086s Metrics: {"bytes_written":472622,"cfile_init":1,"compiler_manager_pool.queue_time_us":5062,"dirs.queue_time_us":5468,"dirs.run_cpu_time_us":149,"dirs.run_wall_time_us":634,"drs_written":1,"lbm_read_time_us":29,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1789,"lbm_writes_lt_1ms":86,"peak_mem_usage":0,"rows_written":10000,"thread_start_us":142,"threads_started":2}
I20260810 04:07:43.120360 12158 maintenance_manager.cc:419] P acddf9da1c35419fa41b33c4a970b016: Scheduling UndoDeltaBlockGCOp(4c01dce2e7dc413c982d5177d71719a9): 62921 bytes on disk
I20260810 04:07:43.120584 12037 maintenance_manager.cc:643] P acddf9da1c35419fa41b33c4a970b016: UndoDeltaBlockGCOp(4c01dce2e7dc413c982d5177d71719a9) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":25,"lbm_reads_lt_1ms":4}
I20260810 04:07:43.120702 12158 maintenance_manager.cc:419] P acddf9da1c35419fa41b33c4a970b016: Scheduling FlushMRSOp(86528d4204c64ac3904a4b2b2f4b2844): perf score=1.937278
W20260810 04:07:43.120923 12037 tablet_replica_mm_ops.cc:214] T 86528d4204c64ac3904a4b2b2f4b2844 P acddf9da1c35419fa41b33c4a970b016: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet 86528d4204c64ac3904a4b2b2f4b2844: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 86528d4204c64ac3904a4b2b2f4b2844's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260810 04:07:43.120990 12037 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet 86528d4204c64ac3904a4b2b2f4b2844: unable to open output file for column key INT32 NOT NULL: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in 86528d4204c64ac3904a4b2b2f4b2844's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
@ 0x7fc7d1a0a9ad google::LogMessage::Fail() at ??:0
@ 0x7fc7d1a0d88a google::LogMessage::SendToLog() at ??:0
@ 0x7fc7d1a0a4de google::LogMessage::Flush() at ??:0
@ 0x7fc7d1a0ba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fc7d8b6f04f kudu::tablet::FlushMRSOp::Perform() at ??:0
@ 0x7fc7d386d7c2 kudu::MaintenanceManager::LaunchOp() at ??:0
@ 0x7fc7d38d80d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fc7d38cd954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fc7d47316db start_thread at ??:0
@ 0x7fc7d050861f clone at ??:0
W20260810 04:07:43.325367 11890 connection.cc:535] client connection to 127.11.124.66:37619 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 04:07:43.325551 11890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 04:07:43.326272 11890 consensus_peers.cc:487] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 -> Peer acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619): Couldn't send request to peer acddf9da1c35419fa41b33c4a970b016. Status: Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 04:07:43.326344 11890 consensus_peers.cc:487] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 -> Peer acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619): Couldn't send request to peer acddf9da1c35419fa41b33c4a970b016. Status: Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 04:07:44.062708 12207 tablet_service.cc:2970] error setting up scanner 55b069272df54111bfda20674ba3d999 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786334863062411 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786334862719229 usec, L: 0 Physical time difference: 0.343s: new_scan_request { tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "key" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7316827597608587264 stop_primary_key: "<redacted>""\252\252\252\252" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { upper: "<redacted>""\252\252\252*" } } row_format_flags: 1 authz_token { token_data: "\010\272\237\345\323\006\"3\n\005slave\022*\n 3272a6bb1ed34634a1a2a4851363847d\020\001\030\001 \001(\001" signature: "<redacted>""d\031\272\326\263\343:\352[\244\362\034<\331|\316\275\316M\361\033\022\306\236P\254\037\004\322qc2)\237\220\005\336p\321\277::?&:\027\024\010x\t\277\346\0354\273b\252F\253\213x\236\254\333" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "35ea4c5555ec462788af62b15724a680"
I20260810 04:07:44.063077 12207 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:52912 (request call id 0) took 1001 ms. Trace:
I20260810 04:07:44.063124 12207 rpcz_store.cc:276] 0810 04:07:43.061776 (+ 0us) service_pool.cc:170] Inserting onto call queue
0810 04:07:43.061800 (+ 24us) service_pool.cc:227] Handling call
0810 04:07:43.061981 (+ 181us) tablet_service.cc:2780] Created scanner 55b069272df54111bfda20674ba3d999 for tablet 86528d4204c64ac3904a4b2b2f4b2844, query id is 35ea4c5555ec462788af62b15724a680
0810 04:07:43.062440 (+ 459us) tablet_service.cc:2920] Creating iterator
0810 04:07:43.062458 (+ 18us) tablet_service.cc:3297] Waiting safe time to advance
0810 04:07:44.062681 (+1000223us) tablet_service.cc:2945] Iterator created
0810 04:07:44.062683 (+ 2us) tablet_service.cc:2967] Iterator init: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: Timed out waiting for ts: P: 1786334863062411 usec, L: 0 to be safe (mode: NON-LEADER). Current safe time: P: 1786334862719229 usec, L: 0 Physical time difference: 0.343s
0810 04:07:44.063073 (+ 390us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260810 04:07:44.079463 12207 tablet_service.cc:2970] error setting up scanner 3b5bd022c1874f4380723b8f0967148a with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.359s (maximum allowed 0.750s): new_scan_request { tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "key" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7316827597608587264 stop_primary_key: "<redacted>""\252\252\252\252" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { upper: "<redacted>""\252\252\252*" } } row_format_flags: 1 authz_token { token_data: "\010\272\237\345\323\006\"3\n\005slave\022*\n 3272a6bb1ed34634a1a2a4851363847d\020\001\030\001 \001(\001" signature: "<redacted>""d\031\272\326\263\343:\352[\244\362\034<\331|\316\275\316M\361\033\022\306\236P\254\037\004\322qc2)\237\220\005\336p\321\277::?&:\027\024\010x\t\277\346\0354\273b\252F\253\213x\236\254\333" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "35ea4c5555ec462788af62b15724a680"
W20260810 04:07:44.118661 12207 tablet_service.cc:2970] error setting up scanner 0847e136a8884c93a31b043c7d16393b with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.399s (maximum allowed 0.750s): new_scan_request { tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "key" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7316827597608587264 stop_primary_key: "<redacted>""\252\252\252\252" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { upper: "<redacted>""\252\252\252*" } } row_format_flags: 1 authz_token { token_data: "\010\272\237\345\323\006\"3\n\005slave\022*\n 3272a6bb1ed34634a1a2a4851363847d\020\001\030\001 \001(\001" signature: "<redacted>""d\031\272\326\263\343:\352[\244\362\034<\331|\316\275\316M\361\033\022\306\236P\254\037\004\322qc2)\237\220\005\336p\321\277::?&:\027\024\010x\t\277\346\0354\273b\252F\253\213x\236\254\333" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "35ea4c5555ec462788af62b15724a680"
W20260810 04:07:44.188054 12207 tablet_service.cc:2970] error setting up scanner 490125f0bf7142ae886bd25e42f43378 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.468s (maximum allowed 0.750s): new_scan_request { tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "key" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7316827597608587264 stop_primary_key: "<redacted>""\252\252\252\252" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { upper: "<redacted>""\252\252\252*" } } row_format_flags: 1 authz_token { token_data: "\010\272\237\345\323\006\"3\n\005slave\022*\n 3272a6bb1ed34634a1a2a4851363847d\020\001\030\001 \001(\001" signature: "<redacted>""d\031\272\326\263\343:\352[\244\362\034<\331|\316\275\316M\361\033\022\306\236P\254\037\004\322qc2)\237\220\005\336p\321\277::?&:\027\024\010x\t\277\346\0354\273b\252F\253\213x\236\254\333" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "35ea4c5555ec462788af62b15724a680"
I20260810 04:07:44.221211 12417 raft_consensus.cc:482] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acddf9da1c35419fa41b33c4a970b016)
I20260810 04:07:44.221324 12417 raft_consensus.cc:504] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:44.221787 12417 leader_election.cc:288] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619), e01b412b1a4e41fd82def561b7b77eb6 (127.11.124.65:36231)
W20260810 04:07:44.222292 12181 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111)
W20260810 04:07:44.222986 12181 leader_election.cc:334] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619): Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111)
I20260810 04:07:44.225477 11961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" candidate_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e01b412b1a4e41fd82def561b7b77eb6" is_pre_election: true
I20260810 04:07:44.225819 12181 leader_election.cc:302] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b35292870ed0423cb5c34ab9b41d2f1f; no voters: acddf9da1c35419fa41b33c4a970b016, e01b412b1a4e41fd82def561b7b77eb6
I20260810 04:07:44.225970 12417 raft_consensus.cc:2726] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260810 04:07:44.317554 12207 tablet_service.cc:2970] error setting up scanner e2bbeccbe8ad42f88c552f8c7884af8d with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.597s (maximum allowed 0.750s): new_scan_request { tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "key" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7316827597608587264 stop_primary_key: "<redacted>""\252\252\252\252" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { upper: "<redacted>""\252\252\252*" } } row_format_flags: 1 authz_token { token_data: "\010\272\237\345\323\006\"3\n\005slave\022*\n 3272a6bb1ed34634a1a2a4851363847d\020\001\030\001 \001(\001" signature: "<redacted>""d\031\272\326\263\343:\352[\244\362\034<\331|\316\275\316M\361\033\022\306\236P\254\037\004\322qc2)\237\220\005\336p\321\277::?&:\027\024\010x\t\277\346\0354\273b\252F\253\213x\236\254\333" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "35ea4c5555ec462788af62b15724a680"
W20260810 04:07:44.559123 12207 tablet_service.cc:2970] error setting up scanner f291f0b8987d44da88f25923f54cc928 with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 1.839s (maximum allowed 0.750s): new_scan_request { tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "key" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7316827597608587264 stop_primary_key: "<redacted>""\252\252\252\252" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { upper: "<redacted>""\252\252\252*" } } row_format_flags: 1 authz_token { token_data: "\010\272\237\345\323\006\"3\n\005slave\022*\n 3272a6bb1ed34634a1a2a4851363847d\020\001\030\001 \001(\001" signature: "<redacted>""d\031\272\326\263\343:\352[\244\362\034<\331|\316\275\316M\361\033\022\306\236P\254\037\004\322qc2)\237\220\005\336p\321\277::?&:\027\024\010x\t\277\346\0354\273b\252F\253\213x\236\254\333" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "35ea4c5555ec462788af62b15724a680"
I20260810 04:07:44.633245 12357 raft_consensus.cc:482] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader acddf9da1c35419fa41b33c4a970b016)
I20260810 04:07:44.633383 12357 raft_consensus.cc:504] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:44.633649 12357 leader_election.cc:288] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619), b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295)
I20260810 04:07:44.633960 12252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" is_pre_election: true
I20260810 04:07:44.634107 12252 raft_consensus.cc:2454] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 1.
I20260810 04:07:44.634301 11887 leader_election.cc:302] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b35292870ed0423cb5c34ab9b41d2f1f, e01b412b1a4e41fd82def561b7b77eb6; no voters:
W20260810 04:07:44.634411 11890 leader_election.cc:334] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619): Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111)
I20260810 04:07:44.634430 12357 raft_consensus.cc:2781] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 04:07:44.634493 12357 raft_consensus.cc:482] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader acddf9da1c35419fa41b33c4a970b016)
I20260810 04:07:44.634523 12357 raft_consensus.cc:3037] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 1 FOLLOWER]: Advancing to term 2
I20260810 04:07:44.635303 12357 raft_consensus.cc:504] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:44.635470 12357 leader_election.cc:288] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 2 election: Requested vote from peers acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619), b35292870ed0423cb5c34ab9b41d2f1f (127.11.124.67:40295)
I20260810 04:07:44.635640 12252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" candidate_uuid: "e01b412b1a4e41fd82def561b7b77eb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b35292870ed0423cb5c34ab9b41d2f1f"
I20260810 04:07:44.635733 12252 raft_consensus.cc:3037] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 1 FOLLOWER]: Advancing to term 2
W20260810 04:07:44.636003 11890 leader_election.cc:334] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619): Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111)
I20260810 04:07:44.636509 12252 raft_consensus.cc:2454] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01b412b1a4e41fd82def561b7b77eb6 in term 2.
I20260810 04:07:44.636716 11887 leader_election.cc:302] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b35292870ed0423cb5c34ab9b41d2f1f, e01b412b1a4e41fd82def561b7b77eb6; no voters: acddf9da1c35419fa41b33c4a970b016
I20260810 04:07:44.636814 12357 raft_consensus.cc:2781] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 04:07:44.636924 12357 raft_consensus.cc:686] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [term 2 LEADER]: Becoming Leader. State: Replica: e01b412b1a4e41fd82def561b7b77eb6, State: Running, Role: LEADER
I20260810 04:07:44.636986 12357 consensus_queue.cc:237] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } }
I20260810 04:07:44.637542 11796 catalog_manager.cc:5495] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 reported cstate change: term changed from 1 to 2, leader changed from acddf9da1c35419fa41b33c4a970b016 (127.11.124.66) to e01b412b1a4e41fd82def561b7b77eb6 (127.11.124.65). New cstate: current_term: 2 leader_uuid: "e01b412b1a4e41fd82def561b7b77eb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "acddf9da1c35419fa41b33c4a970b016" member_type: VOTER last_known_addr { host: "127.11.124.66" port: 37619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e01b412b1a4e41fd82def561b7b77eb6" member_type: VOTER last_known_addr { host: "127.11.124.65" port: 36231 } health_report { overall_health: HEALTHY } } }
W20260810 04:07:45.072486 12207 tablet_service.cc:2970] error setting up scanner 7010c9161e8f4176b31e3ce2c72b19de with request: Service unavailable: Timed out: could not wait for desired snapshot timestamp to be consistent: tablet hasn't heard from leader or there hasn't been a stable leader for 2.352s (maximum allowed 0.750s): new_scan_request { tablet_id: "86528d4204c64ac3904a4b2b2f4b2844" projected_columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: true type_attributes { precision: 9 scale: 0 } immutable: false } projected_columns { name: "binary_val" type: BINARY is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: true type_attributes { precision: 38 scale: 0 } immutable: false } projected_columns { name: "double_val" type: DOUBLE is_key: false is_nullable: true immutable: false } projected_columns { name: "key" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "int8_val" type: INT8 is_key: false is_nullable: true immutable: false } projected_columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: true type_attributes { precision: 18 scale: 0 } immutable: false } projected_columns { name: "date_val" type: DATE is_key: false is_nullable: true immutable: false } projected_columns { name: "timestamp_val" type: UNIXTIME_MICROS is_key: false is_nullable: true immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "float_val" type: FLOAT is_key: false is_nullable: true immutable: false } projected_columns { name: "int16_val" type: INT16 is_key: false is_nullable: true immutable: false } projected_columns { name: "varchar_val" type: VARCHAR is_key: false is_nullable: true type_attributes { length: 65535 } immutable: false } projected_columns { name: "int64_val" type: INT64 is_key: false is_nullable: true immutable: false } projected_columns { name: "bool_val" type: BOOL is_key: false is_nullable: true immutable: false } projected_columns { name: "int32_val" type: INT32 is_key: false is_nullable: true immutable: false } read_mode: READ_AT_SNAPSHOT propagated_timestamp: 7316827597608587264 stop_primary_key: "<redacted>""\252\252\252\252" cache_blocks: true order_mode: ORDERED column_predicates { column: "key" range { upper: "<redacted>""\252\252\252*" } } row_format_flags: 1 authz_token { token_data: "\010\272\237\345\323\006\"3\n\005slave\022*\n 3272a6bb1ed34634a1a2a4851363847d\020\001\030\001 \001(\001" signature: "<redacted>""d\031\272\326\263\343:\352[\244\362\034<\331|\316\275\316M\361\033\022\306\236P\254\037\004\322qc2)\237\220\005\336p\321\277::?&:\027\024\010x\t\277\346\0354\273b\252F\253\213x\236\254\333" signing_key_seq_num: 0 } } call_seq_id: 0 batch_size_bytes: 8388608 query_id: "35ea4c5555ec462788af62b15724a680"
I20260810 04:07:45.136970 12252 raft_consensus.cc:1261] T 86528d4204c64ac3904a4b2b2f4b2844 P b35292870ed0423cb5c34ab9b41d2f1f [term 2 FOLLOWER]: Refusing update from remote peer e01b412b1a4e41fd82def561b7b77eb6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260810 04:07:45.137344 12357 consensus_queue.cc:1035] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b35292870ed0423cb5c34ab9b41d2f1f" member_type: VOTER last_known_addr { host: "127.11.124.67" port: 40295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260810 04:07:45.139106 11890 consensus_peers.cc:487] T 86528d4204c64ac3904a4b2b2f4b2844 P e01b412b1a4e41fd82def561b7b77eb6 -> Peer acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619): Couldn't send request to peer acddf9da1c35419fa41b33c4a970b016. Status: Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260810 04:07:45.664171 11890 consensus_peers.cc:487] T fb83c6ec33d54750883ece528a2c6c3e P e01b412b1a4e41fd82def561b7b77eb6 -> Peer acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619): Couldn't send request to peer acddf9da1c35419fa41b33c4a970b016. Status: Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260810 04:07:45.956087 11890 consensus_peers.cc:487] T 4c01dce2e7dc413c982d5177d71719a9 P e01b412b1a4e41fd82def561b7b77eb6 -> Peer acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619): Couldn't send request to peer acddf9da1c35419fa41b33c4a970b016. Status: Network error: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260810 04:07:46.213263 11761 scanner-internal.cc:458] Time spent opening tablet: real 3.161s user 0.004s sys 0.001s
I20260810 04:07:46.213413 11761 all_types-itest.cc:600] Scanning tablet: [, int32 key=715827882)
I20260810 04:07:46.321842 11761 test_util.cc:268] Using random seed: 2133340588
I20260810 04:07:46.322701 11761 meta_cache.cc:1510] marking tablet server acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619) as failed
W20260810 04:07:46.322832 11761 meta_cache.cc:302] tablet fb83c6ec33d54750883ece528a2c6c3e: replica acddf9da1c35419fa41b33c4a970b016 (127.11.124.66:37619) has failed: Network error: TS failed: Client connection negotiation failed: client connection to 127.11.124.66:37619: connect: Connection refused (error 111)
I20260810 04:07:46.332965 11761 all_types-itest.cc:600] Scanning tablet: [int32 key=715827882, int32 key=1431655764)
I20260810 04:07:46.441929 11761 test_util.cc:268] Using random seed: 2133460674
I20260810 04:07:46.449957 11761 all_types-itest.cc:600] Scanning tablet: [int32 key=1431655764, )
E20260810 04:07:46.519910 11761 external_mini_cluster.cc:943] Process with UUID acddf9da1c35419fa41b33c4a970b016 has crashed
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/external_mini_cluster.cc:947: Failure
Expected equality of these values:
0
num_crashes
Which is: 1
At least one process crashed
I20260810 04:07:46.520254 11761 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskPMk8pX/build/release/bin/kudu with pid 11869
I20260810 04:07:46.529945 11761 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskPMk8pX/build/release/bin/kudu with pid 12160
I20260810 04:07:46.540096 11761 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskPMk8pX/build/release/bin/kudu with pid 11770
2026-08-10T04:07:46Z chronyd exiting
I20260810 04:07:46.559000 11761 test_util.cc:175] -----------------------------------------------
I20260810 04:07:46.559072 11761 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_2.TestTimestampPadding.1786334861679682-11761-0
[ FAILED ] AllTypesItest/2.TestTimestampPadding, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)5> > (4868 ms)
[----------] 1 test from AllTypesItest/2 (4869 ms total)
[----------] 1 test from AllTypesItest/6, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)17> >
[ RUN ] AllTypesItest/6.TestTimestampPadding
I20260810 04:07:46.561205 11761 test_util.cc:268] Using random seed: 2133579951
2026-08-10T04:07:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T04:07:46Z Disabled control of system clock
I20260810 04:07:46.573486 11761 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskPMk8pX/build/release/bin/kudu
/tmp/dist-test-taskPMk8pX/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.124.126:40967
--webserver_interface=127.11.124.126
--webserver_port=0
--builtin_ntp_servers=127.11.124.84:34609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.124.126:40967 with env {}
W20260810 04:07:46.659096 12441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 04:07:46.659346 12441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 04:07:46.659368 12441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 04:07:46.660660 12441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 04:07:46.660714 12441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 04:07:46.660728 12441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 04:07:46.660740 12441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 04:07:46.662225 12441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.124.84:34609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.124.126:40967
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.124.126:40967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.124.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.12441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 02:52:58 UTC on ccycloud.quasar-fnqwcq.root.comops.site
build id 4576984
I20260810 04:07:46.662492 12441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 04:07:46.662806 12441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 04:07:46.668092 12448 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 04:07:46.668104 12447 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:07:46.668141 12441 server_base.cc:1034] running on GCE node
W20260810 04:07:46.668108 12450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 04:07:46.668650 12441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 04:07:46.669045 12441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 04:07:46.670202 12441 hybrid_clock.cc:648] HybridClock initialized: now 1786334866670177 us; error 39 us; skew 500 ppm
I20260810 04:07:46.671576 12441 webserver.cc:460] Webserver started at http://127.11.124.126:43243/ using document root <none> and password file <none>
I20260810 04:07:46.671847 12441 fs_manager.cc:359] Metadata directory not provided
I20260810 04:07:46.671928 12441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 04:07:46.672097 12441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 04:07:46.673125 12441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/instance:
uuid: "e9f04c5ad2a74fedbd26867d6db213c9"
format_stamp: "Formatted at 2026-08-10 04:07:46 on dist-test-slave-p3t5"
I20260810 04:07:46.673527 12441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal/instance:
uuid: "e9f04c5ad2a74fedbd26867d6db213c9"
format_stamp: "Formatted at 2026-08-10 04:07:46 on dist-test-slave-p3t5"
W20260810 04:07:46.675124 12441 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/data (471801856 bytes available vs 518351011 bytes reserved) (error 28)
I20260810 04:07:46.675203 12441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:07:46.676054 12456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 04:07:46.676242 12441 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 04:07:46.676348 12441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data,/tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
uuid: "e9f04c5ad2a74fedbd26867d6db213c9"
format_stamp: "Formatted at 2026-08-10 04:07:46 on dist-test-slave-p3t5"
I20260810 04:07:46.676436 12441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 04:07:46.685420 12441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 04:07:46.685822 12441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 04:07:46.685989 12441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 04:07:46.690194 12441 rpc_server.cc:307] RPC server started. Bound to: 127.11.124.126:40967
I20260810 04:07:46.690246 12512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.124.126:40967 every 8 connection(s)
I20260810 04:07:46.690631 12441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/info.pb
W20260810 04:07:46.691334 12513 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/data/data (471797760 bytes available vs 518351011 bytes reserved) (error 28)
E20260810 04:07:46.691772 12513 master.cc:392] Unable to init master catalog manager: IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
I20260810 04:07:46.691885 12441 master.cc:537] Master@127.11.124.126:40967 shutting down...
I20260810 04:07:46.699236 11761 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskPMk8pX/build/release/bin/kudu as pid 12441
I20260810 04:07:46.699316 11761 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskPMk8pX/test-tmp/all_types-itest.5.AllTypesItest_6.TestTimestampPadding.1786334861679682-11761-0/minicluster-data/master-0/wal/instance
I20260810 04:07:46.706187 12441 master.cc:552] Master@127.11.124.126:40967 shutdown complete.
IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
F20260810 04:07:51.700291 11761 external_mini_cluster.cc:634] Check failed: leader_master() != nullptr Must have started at least 1 master before adding tablet servers
*** Check failure stack trace: ***
*** Aborted at 1786334871 (unix time) try "date -d @1786334871" if you are using GNU date ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800002df1) received by PID 11761 (TID 0x7f276a7f1440) from PID 11761; stack trace: ***
@ 0x7f276d9c7a46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
@ 0x7f276f791980 (unknown) at ??:0
@ 0x7f276b4dfe87 gsignal at ??:0
@ 0x7f276b4e17f1 abort at ??:0
@ 0x7f276d9b99ad google::LogMessage::Fail() at ??:0
@ 0x7f276d9bc88a google::LogMessage::SendToLog() at ??:0
@ 0x7f276d9b94de google::LogMessage::Flush() at ??:0
@ 0x7f276d9baa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2775172138 kudu::cluster::ExternalMiniCluster::AddTabletServer() at ??:0
@ 0x7f277517354d kudu::cluster::ExternalMiniCluster::Start() at ??:0
@ 0x492455 kudu::client::AllTypesItest<>::RunTest() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/all_types-itest.cc:407
@ 0x49309a kudu::client::AllTypesItest_TestTimestampPadding_Test<>::TestBody() at /opt/rh/devtoolset-8/root/usr/include/c++/8/bits/std_function.h:256
@ 0x7f276edd3bfe testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f276edc85db testing::Test::Run() at ??:0
@ 0x7f276edc8795 testing::TestInfo::Run() at ??:0
@ 0x7f276edc8cdf testing::TestSuite::Run() at ??:0
@ 0x7f276edc929f testing::internal::UnitTestImpl::RunAllTests() at ??:0
@ 0x7f276edd413e testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
@ 0x7f276edc883d testing::UnitTest::Run() at ??:0
@ 0x42b4ba main at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:110
@ 0x7f276b4c2c87 __libc_start_main at ??:0
@ 0x42b6f2 (unknown) at ??:?