Diagnosed failure

AllTypesItest/3.TestAllKeyTypes: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/all_types-itest.cc:618: Failure
Failed
Bad status: IO error: failed to flush data: error details are available via KuduSession::GetPendingErrors()
E20260811 12:35:52.299049 22650 external_mini_cluster.cc:943] Process with UUID f8349020f94f4a10864ec6f6c76abb4b has crashed
E20260811 12:35:52.299204 22650 external_mini_cluster.cc:943] Process with UUID ee3478f02cbe49e68d0a56ff0d738b9b has crashed
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/external_mini_cluster.cc:947: Failure
Expected equality of these values:
  0
  num_crashes
    Which is: 2
At least one process crashed
I20260811 12:35:52.299817 22650 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu pid 22787
I20260811 12:35:52.308462 22957 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:35:52.457037 23529 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee3478f02cbe49e68d0a56ff0d738b9b)
I20260811 12:35:52.457376 23529 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:52.458146 23529 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:52.459970 22812 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:52.460157 22813 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:52.460286 22813 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:52.460294 22650 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu with pid 22787
W20260811 12:35:52.519424 22687 connection.cc:535] server connection from 127.22.30.129:58473 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 12:35:52.519743 22650 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu pid 22660
I20260811 12:35:52.520990 22741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:35:52.637712 22650 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu with pid 22660
2026-08-11T12:35:52Z chronyd exiting
I20260811 12:35:52.692862 22650 test_util.cc:175] -----------------------------------------------
I20260811 12:35:52.692955 22650 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0

AllTypesItest/7.TestAllKeyTypes: Unrecognized error type. Please see the error log for more information.

Full log

Note: This is test shard 7 of 8.
[==========] Running 2 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 1 test from AllTypesItest/3, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)7> >
[ RUN      ] AllTypesItest/3.TestAllKeyTypes
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260811 12:35:27.082675 22650 test_util.cc:268] Using random seed: -1264982909
2026-08-11T12:35:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:35:27Z Disabled control of system clock
I20260811 12:35:27.135349 22650 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
/tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.30.190:39211
--webserver_interface=127.22.30.190
--webserver_port=0
--builtin_ntp_servers=127.22.30.148:37683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.30.190:39211 with env {}
W20260811 12:35:27.502175 22660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:35:27.502501 22660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:35:27.502583 22660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:35:27.510082 22660 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:35:27.510210 22660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:35:27.510253 22660 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:35:27.510311 22660 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:35:27.519791 22660 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.30.148:37683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.30.190:39211
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.30.190:39211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.30.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:35:27.521234 22660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:35:27.523211 22660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:35:27.543779 22668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:27.543845 22666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:27.543756 22670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:35:27.547262 22660 server_base.cc:1034] running on GCE node
I20260811 12:35:27.548377 22660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:35:27.550330 22660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:35:27.551613 22660 hybrid_clock.cc:648] HybridClock initialized: now 1786451727551542 us; error 105 us; skew 500 ppm
I20260811 12:35:27.552052 22660 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:35:27.561579 22660 webserver.cc:460] Webserver started at http://127.22.30.190:33829/ using document root <none> and password file <none>
I20260811 12:35:27.562539 22660 fs_manager.cc:359] Metadata directory not provided
I20260811 12:35:27.562719 22660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:35:27.563087 22660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:35:27.566525 22660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/instance:
uuid: "4969e144e056462f8192fddbcae0710d"
format_stamp: "Formatted at 2026-08-11 12:35:27 on dist-test-slave-bw88"
I20260811 12:35:27.567438 22660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal/instance:
uuid: "4969e144e056462f8192fddbcae0710d"
format_stamp: "Formatted at 2026-08-11 12:35:27 on dist-test-slave-bw88"
I20260811 12:35:27.574052 22660 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
I20260811 12:35:27.578542 22680 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:27.580277 22660 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260811 12:35:27.580536 22660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data,/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
uuid: "4969e144e056462f8192fddbcae0710d"
format_stamp: "Formatted at 2026-08-11 12:35:27 on dist-test-slave-bw88"
I20260811 12:35:27.580756 22660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:35:27.607857 22660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 12:35:27.608889 22660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:35:27.609305 22660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:35:27.630990 22660 rpc_server.cc:307] RPC server started. Bound to: 127.22.30.190:39211
I20260811 12:35:27.631022 22747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.30.190:39211 every 8 connection(s)
I20260811 12:35:27.632750 22660 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/info.pb
I20260811 12:35:27.637478 22751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:27.640347 22650 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu as pid 22660
I20260811 12:35:27.640703 22650 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal/instance
I20260811 12:35:27.651714 22751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d: Bootstrap starting.
I20260811 12:35:27.655249 22751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:27.656436 22751 log.cc:824] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d: Log is configured to *not* fsync() on all Append() calls
I20260811 12:35:27.659602 22751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d: No bootstrap required, opened a new log
I20260811 12:35:27.671067 22751 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4969e144e056462f8192fddbcae0710d" member_type: VOTER last_known_addr { host: "127.22.30.190" port: 39211 } }
I20260811 12:35:27.671694 22751 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:27.671847 22751 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4969e144e056462f8192fddbcae0710d, State: Initialized, Role: FOLLOWER
I20260811 12:35:27.672797 22751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4969e144e056462f8192fddbcae0710d" member_type: VOTER last_known_addr { host: "127.22.30.190" port: 39211 } }
I20260811 12:35:27.673161 22751 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 12:35:27.673426 22751 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 12:35:27.673655 22751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:27.677253 22751 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4969e144e056462f8192fddbcae0710d" member_type: VOTER last_known_addr { host: "127.22.30.190" port: 39211 } }
I20260811 12:35:27.678052 22751 leader_election.cc:302] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4969e144e056462f8192fddbcae0710d; no voters: 
I20260811 12:35:27.678934 22751 leader_election.cc:288] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260811 12:35:27.679087 22756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:35:27.680727 22756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [term 1 LEADER]: Becoming Leader. State: Replica: 4969e144e056462f8192fddbcae0710d, State: Running, Role: LEADER
I20260811 12:35:27.681303 22756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4969e144e056462f8192fddbcae0710d" member_type: VOTER last_known_addr { host: "127.22.30.190" port: 39211 } }
I20260811 12:35:27.681758 22751 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 12:35:27.685197 22759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4969e144e056462f8192fddbcae0710d. Latest consensus state: current_term: 1 leader_uuid: "4969e144e056462f8192fddbcae0710d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4969e144e056462f8192fddbcae0710d" member_type: VOTER last_known_addr { host: "127.22.30.190" port: 39211 } } }
I20260811 12:35:27.685658 22757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4969e144e056462f8192fddbcae0710d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4969e144e056462f8192fddbcae0710d" member_type: VOTER last_known_addr { host: "127.22.30.190" port: 39211 } } }
I20260811 12:35:27.686182 22759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [sys.catalog]: This master's current role is: LEADER
I20260811 12:35:27.686214 22757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d [sys.catalog]: This master's current role is: LEADER
W20260811 12:35:27.695801 22781 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 12:35:27.695992 22781 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 12:35:27.696154 22771 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 12:35:27.698242 22771 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 12:35:27.708400 22771 catalog_manager.cc:1347] Generated new cluster ID: f4d65e76c70e4eac9ef40ba661464345
I20260811 12:35:27.708555 22771 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 12:35:27.732004 22771 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 12:35:27.734318 22771 catalog_manager.cc:1504] Loading token signing keys...
I20260811 12:35:27.752897 22771 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4969e144e056462f8192fddbcae0710d: Generated new TSK 0
I20260811 12:35:27.754210 22771 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 12:35:27.765074 22650 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
/tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.30.129:0
--local_ip_for_outbound_sockets=127.22.30.129
--webserver_interface=127.22.30.129
--webserver_port=0
--tserver_master_addrs=127.22.30.190:39211
--builtin_ntp_servers=127.22.30.148:37683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
W20260811 12:35:28.147931 22787 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:35:28.148312 22787 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:35:28.148488 22787 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:35:28.156116 22787 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:35:28.156360 22787 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260811 12:35:28.156454 22787 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260811 12:35:28.156629 22787 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.30.129
I20260811 12:35:28.167254 22787 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.30.148:37683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.30.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.30.129
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.22.30.190:39211
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.30.129
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:35:28.168655 22787 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:35:28.170771 22787 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:35:28.185395 22793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:28.185959 22794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:28.186100 22798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:35:28.187085 22787 server_base.cc:1034] running on GCE node
I20260811 12:35:28.187842 22787 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:35:28.188974 22787 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:35:28.190256 22787 hybrid_clock.cc:648] HybridClock initialized: now 1786451728190149 us; error 80 us; skew 500 ppm
I20260811 12:35:28.190588 22787 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:35:28.193111 22787 webserver.cc:460] Webserver started at http://127.22.30.129:45667/ using document root <none> and password file <none>
I20260811 12:35:28.193923 22787 fs_manager.cc:359] Metadata directory not provided
I20260811 12:35:28.194036 22787 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:35:28.194324 22787 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:35:28.197235 22787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/data/instance:
uuid: "7ee723c1aeb54214976e38ac26a5f641"
format_stamp: "Formatted at 2026-08-11 12:35:28 on dist-test-slave-bw88"
I20260811 12:35:28.198172 22787 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/wal/instance:
uuid: "7ee723c1aeb54214976e38ac26a5f641"
format_stamp: "Formatted at 2026-08-11 12:35:28 on dist-test-slave-bw88"
I20260811 12:35:28.203928 22787 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260811 12:35:28.207780 22807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:28.209476 22787 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260811 12:35:28.209668 22787 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/wal
uuid: "7ee723c1aeb54214976e38ac26a5f641"
format_stamp: "Formatted at 2026-08-11 12:35:28 on dist-test-slave-bw88"
I20260811 12:35:28.209928 22787 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:35:28.229539 22787 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 12:35:28.230666 22787 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:35:28.231019 22787 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:35:28.232241 22787 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:35:28.234114 22787 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:35:28.234193 22787 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:28.234380 22787 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:35:28.234453 22787 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:28.276350 22787 rpc_server.cc:307] RPC server started. Bound to: 127.22.30.129:35353
I20260811 12:35:28.276386 22962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.30.129:35353 every 8 connection(s)
I20260811 12:35:28.277930 22787 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/data/info.pb
I20260811 12:35:28.281786 22650 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu as pid 22787
I20260811 12:35:28.282004 22650 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-0/wal/instance
I20260811 12:35:28.286206 22650 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
/tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.30.130:0
--local_ip_for_outbound_sockets=127.22.30.130
--webserver_interface=127.22.30.130
--webserver_port=0
--tserver_master_addrs=127.22.30.190:39211
--builtin_ntp_servers=127.22.30.148:37683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
I20260811 12:35:28.296125 22963 heartbeater.cc:347] Connected to a master server at 127.22.30.190:39211
I20260811 12:35:28.296593 22963 heartbeater.cc:464] Registering TS with master...
I20260811 12:35:28.297899 22963 heartbeater.cc:511] Master 127.22.30.190:39211 requested a full tablet report, sending...
I20260811 12:35:28.300658 22704 ts_manager.cc:194] Registered new tserver with Master: 7ee723c1aeb54214976e38ac26a5f641 (127.22.30.129:35353)
I20260811 12:35:28.302335 22704 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.30.129:58473
W20260811 12:35:28.665815 22968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:35:28.666132 22968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:35:28.666290 22968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:35:28.673895 22968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:35:28.674063 22968 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260811 12:35:28.674165 22968 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260811 12:35:28.674332 22968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.30.130
I20260811 12:35:28.684937 22968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.30.148:37683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.30.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.30.130
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.22.30.190:39211
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.30.130
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:35:28.686555 22968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:35:28.688575 22968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:35:28.704758 22978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:28.704843 22974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:28.704820 22975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:35:28.711202 22968 server_base.cc:1034] running on GCE node
I20260811 12:35:28.711947 22968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:35:28.713076 22968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:35:28.714347 22968 hybrid_clock.cc:648] HybridClock initialized: now 1786451728714253 us; error 86 us; skew 500 ppm
I20260811 12:35:28.714699 22968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:35:28.717227 22968 webserver.cc:460] Webserver started at http://127.22.30.130:34007/ using document root <none> and password file <none>
I20260811 12:35:28.718057 22968 fs_manager.cc:359] Metadata directory not provided
I20260811 12:35:28.718220 22968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:35:28.718580 22968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:35:28.721499 22968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data/instance:
uuid: "f8349020f94f4a10864ec6f6c76abb4b"
format_stamp: "Formatted at 2026-08-11 12:35:28 on dist-test-slave-bw88"
I20260811 12:35:28.722370 22968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/wal/instance:
uuid: "f8349020f94f4a10864ec6f6c76abb4b"
format_stamp: "Formatted at 2026-08-11 12:35:28 on dist-test-slave-bw88"
I20260811 12:35:28.728220 22968 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260811 12:35:28.732746 22990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:28.734293 22968 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260811 12:35:28.734513 22968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/wal
uuid: "f8349020f94f4a10864ec6f6c76abb4b"
format_stamp: "Formatted at 2026-08-11 12:35:28 on dist-test-slave-bw88"
I20260811 12:35:28.734740 22968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:35:28.759042 22968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 12:35:28.760412 22968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:35:28.760952 22968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:35:28.762339 22968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:35:28.764602 22968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:35:28.764782 22968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:28.765106 22968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:35:28.765290 22968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:28.805462 22968 rpc_server.cc:307] RPC server started. Bound to: 127.22.30.130:46867
I20260811 12:35:28.805553 23138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.30.130:46867 every 8 connection(s)
I20260811 12:35:28.806819 22968 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data/info.pb
I20260811 12:35:28.815323 22650 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu as pid 22968
I20260811 12:35:28.815533 22650 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/wal/instance
I20260811 12:35:28.819415 22650 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
/tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.30.131:0
--local_ip_for_outbound_sockets=127.22.30.131
--webserver_interface=127.22.30.131
--webserver_port=0
--tserver_master_addrs=127.22.30.190:39211
--builtin_ntp_servers=127.22.30.148:37683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--flush_threshold_mb=1
--tablet_delta_store_major_compact_min_ratio=0.001
--consensus_max_batch_size_bytes=2097152 with env {}
I20260811 12:35:28.823050 23139 heartbeater.cc:347] Connected to a master server at 127.22.30.190:39211
I20260811 12:35:28.823411 23139 heartbeater.cc:464] Registering TS with master...
I20260811 12:35:28.824265 23139 heartbeater.cc:511] Master 127.22.30.190:39211 requested a full tablet report, sending...
I20260811 12:35:28.825881 22704 ts_manager.cc:194] Registered new tserver with Master: f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867)
I20260811 12:35:28.826681 22704 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.30.130:34889
W20260811 12:35:29.191811 23145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:35:29.192142 23145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:35:29.192245 23145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:35:29.199905 23145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:35:29.200079 23145 flags.cc:425] Enabled experimental flag: --tablet_delta_store_major_compact_min_ratio=0.001
W20260811 12:35:29.200136 23145 flags.cc:425] Enabled experimental flag: --flush_threshold_mb=1
W20260811 12:35:29.200237 23145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.30.131
I20260811 12:35:29.210009 23145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.30.148:37683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--consensus_max_batch_size_bytes=2097152
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.30.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.30.131
--webserver_port=0
--tablet_delta_store_major_compact_min_ratio=0.001
--flush_threshold_mb=1
--tserver_master_addrs=127.22.30.190:39211
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.30.131
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true

Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:35:29.211498 23145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:35:29.213577 23145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:35:29.228168 23153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:29.228171 23155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:29.228238 23152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:35:29.229162 23145 server_base.cc:1034] running on GCE node
I20260811 12:35:29.229862 23145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:35:29.230798 23145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:35:29.232050 23145 hybrid_clock.cc:648] HybridClock initialized: now 1786451729231968 us; error 37 us; skew 500 ppm
I20260811 12:35:29.232414 23145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:35:29.235045 23145 webserver.cc:460] Webserver started at http://127.22.30.131:44867/ using document root <none> and password file <none>
I20260811 12:35:29.235837 23145 fs_manager.cc:359] Metadata directory not provided
I20260811 12:35:29.235952 23145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:35:29.236353 23145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:35:29.239562 23145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data/instance:
uuid: "ee3478f02cbe49e68d0a56ff0d738b9b"
format_stamp: "Formatted at 2026-08-11 12:35:29 on dist-test-slave-bw88"
I20260811 12:35:29.240571 23145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/wal/instance:
uuid: "ee3478f02cbe49e68d0a56ff0d738b9b"
format_stamp: "Formatted at 2026-08-11 12:35:29 on dist-test-slave-bw88"
I20260811 12:35:29.246377 23145 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
I20260811 12:35:29.250237 23166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:29.251703 23145 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260811 12:35:29.251881 23145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/wal
uuid: "ee3478f02cbe49e68d0a56ff0d738b9b"
format_stamp: "Formatted at 2026-08-11 12:35:29 on dist-test-slave-bw88"
I20260811 12:35:29.252081 23145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:35:29.269694 23145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 12:35:29.270658 23145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:35:29.270987 23145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:35:29.272118 23145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 12:35:29.273887 23145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 12:35:29.273972 23145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:29.274159 23145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 12:35:29.274216 23145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:29.306664 22963 heartbeater.cc:503] Master 127.22.30.190:39211 was elected leader, sending a full tablet report...
I20260811 12:35:29.313315 23145 rpc_server.cc:307] RPC server started. Bound to: 127.22.30.131:40863
I20260811 12:35:29.313504 23321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.30.131:40863 every 8 connection(s)
I20260811 12:35:29.314913 23145 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data/info.pb
I20260811 12:35:29.315768 22650 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu as pid 23145
I20260811 12:35:29.315966 22650 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/wal/instance
I20260811 12:35:29.330344 23322 heartbeater.cc:347] Connected to a master server at 127.22.30.190:39211
I20260811 12:35:29.330691 23322 heartbeater.cc:464] Registering TS with master...
I20260811 12:35:29.331655 23322 heartbeater.cc:511] Master 127.22.30.190:39211 requested a full tablet report, sending...
I20260811 12:35:29.333498 22704 ts_manager.cc:194] Registered new tserver with Master: ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
I20260811 12:35:29.334295 22704 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.30.131:42919
I20260811 12:35:29.346160 22650 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 12:35:29.387645 22704 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51034:
name: "all-types-table"
schema {
  columns {
    name: "key"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int8_val"
    type: INT8
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int16_val"
    type: INT16
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int32_val"
    type: INT32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int64_val"
    type: INT64
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "timestamp_val"
    type: UNIXTIME_MICROS
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "date_val"
    type: DATE
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "varchar_val"
    type: VARCHAR
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    type_attributes {
      length: 65535
    }
    immutable: false
  }
  columns {
    name: "bool_val"
    type: BOOL
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "float_val"
    type: FLOAT
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "double_val"
    type: DOUBLE
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "binary_val"
    type: BINARY
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "decimal32_val"
    type: DECIMAL32
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    type_attributes {
      precision: 9
      scale: 0
    }
    immutable: false
  }
  columns {
    name: "decimal64_val"
    type: DECIMAL64
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    type_attributes {
      precision: 18
      scale: 0
    }
    immutable: false
  }
  columns {
    name: "decimal128_val"
    type: DECIMAL128
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    type_attributes {
      precision: 38
      scale: 0
    }
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\004\001\000\000\000\252\252\252*\000\000\000\000\004\001\000\000\000TUUU\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260811 12:35:29.404371 22704 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table all-types-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 12:35:29.477555 23233 tablet_service.cc:1467] Processing CreateTablet for tablet 8527534c1571455eb7dba3236aa6ab12 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260811 12:35:29.479578 23231 tablet_service.cc:1467] Processing CreateTablet for tablet f8902a051ec041459c228d8483a7a9f6 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260811 12:35:29.480676 23234 tablet_service.cc:1467] Processing CreateTablet for tablet e3d11edbc9bc4d4896d4b81761e35a45 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260811 12:35:29.481436 23233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8527534c1571455eb7dba3236aa6ab12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.482668 23231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8902a051ec041459c228d8483a7a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.484157 23234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d11edbc9bc4d4896d4b81761e35a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.483260 23049 tablet_service.cc:1467] Processing CreateTablet for tablet 8527534c1571455eb7dba3236aa6ab12 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260811 12:35:29.483633 22874 tablet_service.cc:1467] Processing CreateTablet for tablet 8527534c1571455eb7dba3236aa6ab12 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764
I20260811 12:35:29.486197 23049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8527534c1571455eb7dba3236aa6ab12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.486193 22872 tablet_service.cc:1467] Processing CreateTablet for tablet f8902a051ec041459c228d8483a7a9f6 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260811 12:35:29.486557 22874 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8527534c1571455eb7dba3236aa6ab12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.487293 22872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8902a051ec041459c228d8483a7a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.489976 22875 tablet_service.cc:1467] Processing CreateTablet for tablet e3d11edbc9bc4d4896d4b81761e35a45 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260811 12:35:29.490825 23050 tablet_service.cc:1467] Processing CreateTablet for tablet e3d11edbc9bc4d4896d4b81761e35a45 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION VALUES < 715827882
I20260811 12:35:29.491681 23050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d11edbc9bc4d4896d4b81761e35a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.493485 22875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e3d11edbc9bc4d4896d4b81761e35a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.477548 23048 tablet_service.cc:1467] Processing CreateTablet for tablet f8902a051ec041459c228d8483a7a9f6 (DEFAULT_TABLE table=all-types-table [id=78cbfdcb66f544c3ab8abbb1e2848837]), partition=RANGE (key) PARTITION 1431655764 <= VALUES
I20260811 12:35:29.495884 23048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8902a051ec041459c228d8483a7a9f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 12:35:29.523788 23349 tablet_bootstrap.cc:492] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b: Bootstrap starting.
I20260811 12:35:29.529579 23350 tablet_bootstrap.cc:492] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b: Bootstrap starting.
I20260811 12:35:29.531672 23349 tablet_bootstrap.cc:654] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.534520 23349 log.cc:824] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b: Log is configured to *not* fsync() on all Append() calls
I20260811 12:35:29.537149 23350 tablet_bootstrap.cc:654] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.539317 23350 log.cc:824] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b: Log is configured to *not* fsync() on all Append() calls
I20260811 12:35:29.541916 23351 tablet_bootstrap.cc:492] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641: Bootstrap starting.
I20260811 12:35:29.551172 23349 tablet_bootstrap.cc:492] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b: No bootstrap required, opened a new log
I20260811 12:35:29.551712 23349 ts_tablet_manager.cc:1397] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.016s
I20260811 12:35:29.551781 23351 tablet_bootstrap.cc:654] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.554620 23350 tablet_bootstrap.cc:492] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b: No bootstrap required, opened a new log
I20260811 12:35:29.555191 23350 ts_tablet_manager.cc:1397] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260811 12:35:29.555960 23351 log.cc:824] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641: Log is configured to *not* fsync() on all Append() calls
I20260811 12:35:29.563720 23351 tablet_bootstrap.cc:492] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641: No bootstrap required, opened a new log
I20260811 12:35:29.564404 23351 ts_tablet_manager.cc:1397] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.012s
I20260811 12:35:29.572237 23349 raft_consensus.cc:348] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.573407 23349 raft_consensus.cc:374] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.573639 23349 raft_consensus.cc:729] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8349020f94f4a10864ec6f6c76abb4b, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.575256 23349 consensus_queue.cc:260] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.578343 23139 heartbeater.cc:503] Master 127.22.30.190:39211 was elected leader, sending a full tablet report...
I20260811 12:35:29.579988 23349 ts_tablet_manager.cc:1428] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b: Time spent starting tablet: real 0.028s	user 0.014s	sys 0.012s
I20260811 12:35:29.580981 23349 tablet_bootstrap.cc:492] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b: Bootstrap starting.
I20260811 12:35:29.577739 23350 raft_consensus.cc:348] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.583644 23350 raft_consensus.cc:374] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.583881 23350 raft_consensus.cc:729] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3478f02cbe49e68d0a56ff0d738b9b, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.584908 23349 tablet_bootstrap.cc:654] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.585697 23350 consensus_queue.cc:260] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.590022 23351 raft_consensus.cc:348] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.591073 23351 raft_consensus.cc:374] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.591253 23351 raft_consensus.cc:729] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee723c1aeb54214976e38ac26a5f641, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.592444 23351 consensus_queue.cc:260] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.594182 23349 tablet_bootstrap.cc:492] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b: No bootstrap required, opened a new log
I20260811 12:35:29.594429 23322 heartbeater.cc:503] Master 127.22.30.190:39211 was elected leader, sending a full tablet report...
I20260811 12:35:29.594604 23349 ts_tablet_manager.cc:1397] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260811 12:35:29.596577 23349 raft_consensus.cc:348] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.597002 23349 raft_consensus.cc:374] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.597186 23349 raft_consensus.cc:729] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8349020f94f4a10864ec6f6c76abb4b, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.597697 23349 consensus_queue.cc:260] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.601889 23349 ts_tablet_manager.cc:1428] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260811 12:35:29.602707 23349 tablet_bootstrap.cc:492] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b: Bootstrap starting.
I20260811 12:35:29.606695 23349 tablet_bootstrap.cc:654] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.611713 23350 ts_tablet_manager.cc:1428] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b: Time spent starting tablet: real 0.056s	user 0.026s	sys 0.008s
I20260811 12:35:29.612902 23350 tablet_bootstrap.cc:492] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b: Bootstrap starting.
I20260811 12:35:29.617128 23349 tablet_bootstrap.cc:492] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b: No bootstrap required, opened a new log
I20260811 12:35:29.617192 23350 tablet_bootstrap.cc:654] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.617514 23349 ts_tablet_manager.cc:1397] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260811 12:35:29.619374 23349 raft_consensus.cc:348] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.620085 23349 raft_consensus.cc:374] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.620276 23349 raft_consensus.cc:729] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8349020f94f4a10864ec6f6c76abb4b, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.620950 23349 consensus_queue.cc:260] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.624275 23351 ts_tablet_manager.cc:1428] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641: Time spent starting tablet: real 0.060s	user 0.043s	sys 0.010s
I20260811 12:35:29.624998 23351 tablet_bootstrap.cc:492] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641: Bootstrap starting.
I20260811 12:35:29.628235 23349 ts_tablet_manager.cc:1428] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260811 12:35:29.629236 23351 tablet_bootstrap.cc:654] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.637519 23350 tablet_bootstrap.cc:492] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b: No bootstrap required, opened a new log
I20260811 12:35:29.637890 23350 ts_tablet_manager.cc:1397] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260811 12:35:29.640163 23350 raft_consensus.cc:348] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.640697 23350 raft_consensus.cc:374] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.640897 23350 raft_consensus.cc:729] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3478f02cbe49e68d0a56ff0d738b9b, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.641189 23351 tablet_bootstrap.cc:492] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641: No bootstrap required, opened a new log
I20260811 12:35:29.641583 23351 ts_tablet_manager.cc:1397] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260811 12:35:29.641640 23350 consensus_queue.cc:260] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.642793 23350 ts_tablet_manager.cc:1428] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260811 12:35:29.643528 23351 raft_consensus.cc:348] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.644050 23351 raft_consensus.cc:374] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.644297 23351 raft_consensus.cc:729] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee723c1aeb54214976e38ac26a5f641, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.644974 23351 consensus_queue.cc:260] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.646173 23351 ts_tablet_manager.cc:1428] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260811 12:35:29.646718 23351 tablet_bootstrap.cc:492] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641: Bootstrap starting.
I20260811 12:35:29.648121 23356 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:35:29.648897 23356 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.650034 23350 tablet_bootstrap.cc:492] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b: Bootstrap starting.
I20260811 12:35:29.650686 23351 tablet_bootstrap.cc:654] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.660029 23350 tablet_bootstrap.cc:654] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b: Neither blocks nor log segments found. Creating new log.
I20260811 12:35:29.662024 23351 tablet_bootstrap.cc:492] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641: No bootstrap required, opened a new log
I20260811 12:35:29.662358 23351 ts_tablet_manager.cc:1397] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260811 12:35:29.664160 23351 raft_consensus.cc:348] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.664732 23351 raft_consensus.cc:374] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.664897 23351 raft_consensus.cc:729] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ee723c1aeb54214976e38ac26a5f641, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.665463 23351 consensus_queue.cc:260] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.666999 23351 ts_tablet_manager.cc:1428] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260811 12:35:29.667568 23356 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee723c1aeb54214976e38ac26a5f641 (127.22.30.129:35353), f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867)
I20260811 12:35:29.671011 23359 raft_consensus.cc:482] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:35:29.671645 23359 raft_consensus.cc:504] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.673231 23350 tablet_bootstrap.cc:492] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b: No bootstrap required, opened a new log
I20260811 12:35:29.673697 23350 ts_tablet_manager.cc:1397] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.010s
I20260811 12:35:29.675196 23350 raft_consensus.cc:348] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.675730 23350 raft_consensus.cc:374] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 12:35:29.675915 23350 raft_consensus.cc:729] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3478f02cbe49e68d0a56ff0d738b9b, State: Initialized, Role: FOLLOWER
I20260811 12:35:29.676630 23350 consensus_queue.cc:260] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.678135 23350 ts_tablet_manager.cc:1428] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.002s
I20260811 12:35:29.679353 23359 leader_election.cc:288] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
I20260811 12:35:29.693660 23355 raft_consensus.cc:482] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:35:29.694271 23355 raft_consensus.cc:504] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.698136 23079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8527534c1571455eb7dba3236aa6ab12" candidate_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8349020f94f4a10864ec6f6c76abb4b" is_pre_election: true
I20260811 12:35:29.699407 23079 raft_consensus.cc:2454] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3478f02cbe49e68d0a56ff0d738b9b in term 0.
I20260811 12:35:29.704540 23355 leader_election.cc:288] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ee723c1aeb54214976e38ac26a5f641 (127.22.30.129:35353), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
I20260811 12:35:29.706552 22902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8527534c1571455eb7dba3236aa6ab12" candidate_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee723c1aeb54214976e38ac26a5f641" is_pre_election: true
I20260811 12:35:29.707571 22902 raft_consensus.cc:2454] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee3478f02cbe49e68d0a56ff0d738b9b in term 0.
I20260811 12:35:29.708165 23169 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b; no voters: 
I20260811 12:35:29.709004 23356 raft_consensus.cc:2781] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:35:29.709398 23356 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:35:29.709672 23356 raft_consensus.cc:3037] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:29.717856 23356 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.720481 22902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8527534c1571455eb7dba3236aa6ab12" candidate_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee723c1aeb54214976e38ac26a5f641"
I20260811 12:35:29.721027 22902 raft_consensus.cc:3037] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:29.727517 23263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8902a051ec041459c228d8483a7a9f6" candidate_uuid: "f8349020f94f4a10864ec6f6c76abb4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" is_pre_election: true
I20260811 12:35:29.728837 23263 raft_consensus.cc:2454] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8349020f94f4a10864ec6f6c76abb4b in term 0.
I20260811 12:35:29.729597 23355 raft_consensus.cc:482] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 12:35:29.730182 23079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d11edbc9bc4d4896d4b81761e35a45" candidate_uuid: "7ee723c1aeb54214976e38ac26a5f641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8349020f94f4a10864ec6f6c76abb4b" is_pre_election: true
I20260811 12:35:29.730093 23355 raft_consensus.cc:504] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.731413 23262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d11edbc9bc4d4896d4b81761e35a45" candidate_uuid: "7ee723c1aeb54214976e38ac26a5f641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" is_pre_election: true
I20260811 12:35:29.731781 23355 leader_election.cc:288] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863), 7ee723c1aeb54214976e38ac26a5f641 (127.22.30.129:35353)
I20260811 12:35:29.732095 23262 raft_consensus.cc:2454] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee723c1aeb54214976e38ac26a5f641 in term 0.
I20260811 12:35:29.732323 23079 raft_consensus.cc:2454] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ee723c1aeb54214976e38ac26a5f641 in term 0.
I20260811 12:35:29.735095 22813 leader_election.cc:302] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641, ee3478f02cbe49e68d0a56ff0d738b9b; no voters: 
I20260811 12:35:29.736765 22902 raft_consensus.cc:2454] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3478f02cbe49e68d0a56ff0d738b9b in term 1.
I20260811 12:35:29.737496 23359 raft_consensus.cc:2781] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:35:29.737798 23356 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [CANDIDATE]: Term 1 election: Requested vote from peers 7ee723c1aeb54214976e38ac26a5f641 (127.22.30.129:35353), f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867)
I20260811 12:35:29.737872 23359 raft_consensus.cc:482] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:35:29.738181 23359 raft_consensus.cc:3037] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:29.738457 22994 leader_election.cc:302] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b; no voters: 
I20260811 12:35:29.739668 23355 raft_consensus.cc:2781] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:35:29.740031 23355 raft_consensus.cc:482] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:35:29.740463 23355 raft_consensus.cc:3037] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:29.740438 23263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d11edbc9bc4d4896d4b81761e35a45" candidate_uuid: "f8349020f94f4a10864ec6f6c76abb4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" is_pre_election: true
I20260811 12:35:29.741003 23263 raft_consensus.cc:2454] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8349020f94f4a10864ec6f6c76abb4b in term 0.
I20260811 12:35:29.742018 23079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8527534c1571455eb7dba3236aa6ab12" candidate_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8349020f94f4a10864ec6f6c76abb4b"
I20260811 12:35:29.742432 23079 raft_consensus.cc:3037] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:29.742955 22994 leader_election.cc:302] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b; no voters: 
I20260811 12:35:29.744837 22901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d11edbc9bc4d4896d4b81761e35a45" candidate_uuid: "f8349020f94f4a10864ec6f6c76abb4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee723c1aeb54214976e38ac26a5f641" is_pre_election: true
I20260811 12:35:29.745232 23167 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641, ee3478f02cbe49e68d0a56ff0d738b9b; no voters: 
I20260811 12:35:29.746138 23356 raft_consensus.cc:2781] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:35:29.750198 23079 raft_consensus.cc:2454] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee3478f02cbe49e68d0a56ff0d738b9b in term 1.
I20260811 12:35:29.751128 23355 raft_consensus.cc:504] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.753191 22902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8902a051ec041459c228d8483a7a9f6" candidate_uuid: "f8349020f94f4a10864ec6f6c76abb4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee723c1aeb54214976e38ac26a5f641" is_pre_election: true
I20260811 12:35:29.749424 23359 raft_consensus.cc:504] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.754558 22900 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8902a051ec041459c228d8483a7a9f6" candidate_uuid: "f8349020f94f4a10864ec6f6c76abb4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee723c1aeb54214976e38ac26a5f641"
I20260811 12:35:29.755630 22902 raft_consensus.cc:2454] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8349020f94f4a10864ec6f6c76abb4b in term 0.
I20260811 12:35:29.756145 22901 raft_consensus.cc:2379] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8349020f94f4a10864ec6f6c76abb4b in current term 1: Already voted for candidate 7ee723c1aeb54214976e38ac26a5f641 in this term.
I20260811 12:35:29.758010 23377 raft_consensus.cc:2781] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 12:35:29.758261 23377 raft_consensus.cc:482] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 12:35:29.758533 23377 raft_consensus.cc:3037] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:29.760111 23355 leader_election.cc:288] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [CANDIDATE]: Term 1 election: Requested vote from peers 7ee723c1aeb54214976e38ac26a5f641 (127.22.30.129:35353), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
I20260811 12:35:29.760228 23079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d11edbc9bc4d4896d4b81761e35a45" candidate_uuid: "7ee723c1aeb54214976e38ac26a5f641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8349020f94f4a10864ec6f6c76abb4b"
I20260811 12:35:29.761559 23359 leader_election.cc:288] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 1 election: Requested vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
I20260811 12:35:29.762209 23263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8902a051ec041459c228d8483a7a9f6" candidate_uuid: "f8349020f94f4a10864ec6f6c76abb4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b"
I20260811 12:35:29.762635 23263 raft_consensus.cc:3037] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:29.762514 23262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d11edbc9bc4d4896d4b81761e35a45" candidate_uuid: "7ee723c1aeb54214976e38ac26a5f641" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b"
I20260811 12:35:29.763111 23262 raft_consensus.cc:3037] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:29.764822 23377 raft_consensus.cc:504] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.766441 23377 leader_election.cc:288] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [CANDIDATE]: Term 1 election: Requested vote from peers ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863), 7ee723c1aeb54214976e38ac26a5f641 (127.22.30.129:35353)
I20260811 12:35:29.767422 22901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d11edbc9bc4d4896d4b81761e35a45" candidate_uuid: "f8349020f94f4a10864ec6f6c76abb4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ee723c1aeb54214976e38ac26a5f641"
I20260811 12:35:29.767899 22901 raft_consensus.cc:2379] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8349020f94f4a10864ec6f6c76abb4b in current term 1: Already voted for candidate 7ee723c1aeb54214976e38ac26a5f641 in this term.
I20260811 12:35:29.769783 23263 raft_consensus.cc:2454] T f8902a051ec041459c228d8483a7a9f6 P ee3478f02cbe49e68d0a56ff0d738b9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8349020f94f4a10864ec6f6c76abb4b in term 1.
I20260811 12:35:29.769899 23261 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e3d11edbc9bc4d4896d4b81761e35a45" candidate_uuid: "f8349020f94f4a10864ec6f6c76abb4b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b"
I20260811 12:35:29.770857 22994 leader_election.cc:302] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b; no voters: 7ee723c1aeb54214976e38ac26a5f641
I20260811 12:35:29.770953 23262 raft_consensus.cc:2454] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ee723c1aeb54214976e38ac26a5f641 in term 1.
I20260811 12:35:29.771785 23079 raft_consensus.cc:2379] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ee723c1aeb54214976e38ac26a5f641 in current term 1: Already voted for candidate f8349020f94f4a10864ec6f6c76abb4b in this term.
I20260811 12:35:29.771864 22813 leader_election.cc:302] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641, ee3478f02cbe49e68d0a56ff0d738b9b; no voters: 
I20260811 12:35:29.771802 22994 leader_election.cc:302] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8349020f94f4a10864ec6f6c76abb4b; no voters: 7ee723c1aeb54214976e38ac26a5f641, ee3478f02cbe49e68d0a56ff0d738b9b
I20260811 12:35:29.772431 23356 raft_consensus.cc:686] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [term 1 LEADER]: Becoming Leader. State: Replica: ee3478f02cbe49e68d0a56ff0d738b9b, State: Running, Role: LEADER
I20260811 12:35:29.772528 23377 raft_consensus.cc:2781] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:35:29.772964 23359 raft_consensus.cc:2781] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 12:35:29.773442 23355 raft_consensus.cc:2726] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 12:35:29.773677 23356 consensus_queue.cc:237] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:29.776173 23359 raft_consensus.cc:686] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 LEADER]: Becoming Leader. State: Replica: 7ee723c1aeb54214976e38ac26a5f641, State: Running, Role: LEADER
I20260811 12:35:29.777202 23359 consensus_queue.cc:237] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } }
I20260811 12:35:29.777787 23377 raft_consensus.cc:686] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [term 1 LEADER]: Becoming Leader. State: Replica: f8349020f94f4a10864ec6f6c76abb4b, State: Running, Role: LEADER
I20260811 12:35:29.778756 23377 consensus_queue.cc:237] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
W20260811 12:35:29.784927 22964 tablet.cc:2369] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:35:29.785271 22702 catalog_manager.cc:5495] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b reported cstate change: term changed from 0 to 1, leader changed from <none> to ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131). New cstate: current_term: 1 leader_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } health_report { overall_health: HEALTHY } } }
I20260811 12:35:29.789687 22703 catalog_manager.cc:5495] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ee723c1aeb54214976e38ac26a5f641 (127.22.30.129). New cstate: current_term: 1 leader_uuid: "7ee723c1aeb54214976e38ac26a5f641" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } health_report { overall_health: HEALTHY } } }
I20260811 12:35:29.798151 22703 catalog_manager.cc:5495] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b reported cstate change: term changed from 0 to 1, leader changed from <none> to f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130). New cstate: current_term: 1 leader_uuid: "f8349020f94f4a10864ec6f6c76abb4b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } health_report { overall_health: UNKNOWN } } }
W20260811 12:35:29.809463 23140 tablet.cc:2369] T 8527534c1571455eb7dba3236aa6ab12 P f8349020f94f4a10864ec6f6c76abb4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 12:35:29.817847 23323 tablet.cc:2369] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 12:35:30.168027 23356 consensus_queue.cc:1035] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:35:30.181061 23378 consensus_queue.cc:1035] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 12:35:30.192967 23356 consensus_queue.cc:1035] T 8527534c1571455eb7dba3236aa6ab12 P ee3478f02cbe49e68d0a56ff0d738b9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:35:30.196493 23359 consensus_queue.cc:1035] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 12:35:30.279820 22901 raft_consensus.cc:3037] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 0 FOLLOWER]: Advancing to term 1
I20260811 12:35:30.288208 23377 consensus_queue.cc:1035] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 12:35:30.302309 23377 consensus_queue.cc:1035] T f8902a051ec041459c228d8483a7a9f6 P f8349020f94f4a10864ec6f6c76abb4b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260811 12:35:31.541714 22964 maintenance_manager.cc:419] P 7ee723c1aeb54214976e38ac26a5f641: Scheduling FlushMRSOp(e3d11edbc9bc4d4896d4b81761e35a45): perf score=1.000000
I20260811 12:35:31.816401 23140 maintenance_manager.cc:419] P f8349020f94f4a10864ec6f6c76abb4b: Scheduling FlushMRSOp(e3d11edbc9bc4d4896d4b81761e35a45): perf score=1.000000
I20260811 12:35:31.823426 23323 maintenance_manager.cc:419] P ee3478f02cbe49e68d0a56ff0d738b9b: Scheduling FlushMRSOp(e3d11edbc9bc4d4896d4b81761e35a45): perf score=1.000000
W20260811 12:35:32.018427 23325 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.22.30.129:35353, user_credentials={real_user=slave}} blocked reactor thread for 235537us
W20260811 12:35:32.170809 22995 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-1/data/data (507858944 bytes available vs 518351011 bytes reserved) (error 28)
W20260811 12:35:32.181071 23171 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/ts-2/data/data (507858944 bytes available vs 518351011 bytes reserved) (error 28)
W20260811 12:35:32.208951 22995 tablet_replica_mm_ops.cc:214] T e3d11edbc9bc4d4896d4b81761e35a45 P f8349020f94f4a10864ec6f6c76abb4b: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet e3d11edbc9bc4d4896d4b81761e35a45: unable to open output file for column decimal32_val DECIMAL(9, 0) NULLABLE: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in e3d11edbc9bc4d4896d4b81761e35a45's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260811 12:35:32.209260 22995 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet e3d11edbc9bc4d4896d4b81761e35a45: unable to open output file for column decimal32_val DECIMAL(9, 0) NULLABLE: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in e3d11edbc9bc4d4896d4b81761e35a45's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
    @     0x7f6f2941b9ad  google::LogMessage::Fail() at ??:0
    @     0x7f6f2941e88a  google::LogMessage::SendToLog() at ??:0
    @     0x7f6f2941b4de  google::LogMessage::Flush() at ??:0
W20260811 12:35:32.226817 23171 tablet_replica_mm_ops.cc:214] T e3d11edbc9bc4d4896d4b81761e35a45 P ee3478f02cbe49e68d0a56ff0d738b9b: failed to flush MRS: IO error: Failed to open DiskRowSet for flush: tablet e3d11edbc9bc4d4896d4b81761e35a45: unable to open output file for column decimal64_val DECIMAL(18, 0) NULLABLE: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in e3d11edbc9bc4d4896d4b81761e35a45's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
F20260811 12:35:32.226999 23171 tablet_replica_mm_ops.cc:215] Check failed: tablet->HasBeenStopped() Unrecoverable flush failure caused by error: IO error: Failed to open DiskRowSet for flush: tablet e3d11edbc9bc4d4896d4b81761e35a45: unable to open output file for column decimal64_val DECIMAL(18, 0) NULLABLE: No directories could be added (1 dirs total, 0 failed, 1 full): IO error: No directories available in e3d11edbc9bc4d4896d4b81761e35a45's directory group (1 dirs total, 0 failed, 1 full) (error 28) (error 19)
*** Check failure stack trace: ***
    @     0x7f6f2941ca19  google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7fce50a639ad  google::LogMessage::Fail() at ??:0
    @     0x7fce50a6688a  google::LogMessage::SendToLog() at ??:0
    @     0x7f6f387f4e7d  kudu::tablet::FlushMRSOp::Perform() at ??:0
    @     0x7fce50a634de  google::LogMessage::Flush() at ??:0
    @     0x7fce50a64a19  google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7f6f2bf09090  kudu::MaintenanceManager::LaunchOp() at ??:0
    @     0x7f6f2bf0be53  kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
    @     0x7f6f2bf0bce9  std::_Function_handler<>::_M_invoke() at ??:0
    @     0x7fce5fe3ce7d  kudu::tablet::FlushMRSOp::Perform() at ??:0
    @           0x9edb7d  std::function<>::operator()() at ??:?
    @     0x7fce53551090  kudu::MaintenanceManager::LaunchOp() at ??:0
    @     0x7fce53553e53  kudu::MaintenanceManager::RunSchedulerThread()::$_3::operator()() at ??:0
    @     0x7fce53553ce9  std::_Function_handler<>::_M_invoke() at ??:0
    @           0x9edb7d  std::function<>::operator()() at ??:?
    @     0x7fce536af345  kudu::ThreadPool::DispatchThread() at ??:0
    @     0x7f6f2c067345  kudu::ThreadPool::DispatchThread() at ??:0
    @     0x7fce536b291c  kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
    @     0x7fce536b2799  std::_Function_handler<>::_M_invoke() at ??:0
    @           0x9edb7d  std::function<>::operator()() at ??:?
    @     0x7f6f2c06a91c  kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
    @     0x7f6f2c06a799  std::_Function_handler<>::_M_invoke() at ??:0
    @           0x9edb7d  std::function<>::operator()() at ??:?
    @     0x7fce5368deaf  kudu::Thread::SuperviseThread() at ??:0
    @     0x7f6f2c045eaf  kudu::Thread::SuperviseThread() at ??:0
    @     0x7f6f2f31f6db  start_thread at ??:0
    @     0x7fce569676db  start_thread at ??:0
    @     0x7f6f282b561f  clone at ??:0
    @     0x7fce4f8fd61f  clone at ??:0
W20260811 12:35:32.371417 22812 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.30.130:46867, user_credentials={real_user=slave}} blocked reactor thread for 52523.5us
W20260811 12:35:32.778800 22812 connection.cc:535] client connection to 127.22.30.130:46867 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 12:35:32.779142 22812 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 12:35:32.799535 23329 connection.cc:535] client connection to 127.22.30.131:40863 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 12:35:32.799644 22812 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Couldn't send request to peer f8349020f94f4a10864ec6f6c76abb4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 12:35:32.799985 23329 meta_cache.cc:302] tablet 8527534c1571455eb7dba3236aa6ab12: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 12:35:32.813793 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:32.864035 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:32.905071 22813 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Couldn't send request to peer ee3478f02cbe49e68d0a56ff0d738b9b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260811 12:35:32.913257 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:32.963585 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.026875 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.104547 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.185501 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.277899 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.375576 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
I20260811 12:35:33.456139 23505 raft_consensus.cc:482] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8349020f94f4a10864ec6f6c76abb4b)
I20260811 12:35:33.456466 23505 raft_consensus.cc:504] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:33.457363 23505 leader_election.cc:288] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:33.460024 22812 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:33.460333 22813 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:33.460536 22813 leader_election.cc:302] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:33.460870 23505 raft_consensus.cc:2726] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:33.495923 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.500702 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.513520 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.546404 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.555456 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.574715 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
I20260811 12:35:33.584070 23505 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee3478f02cbe49e68d0a56ff0d738b9b)
I20260811 12:35:33.584390 23505 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:33.585587 23505 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:33.587272 22813 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:33.587594 22812 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
I20260811 12:35:33.587764 22812 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:33.588029 23505 raft_consensus.cc:2726] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 12:35:33.590493 22814 maintenance_manager.cc:643] P 7ee723c1aeb54214976e38ac26a5f641: FlushMRSOp(e3d11edbc9bc4d4896d4b81761e35a45) complete. Timing: real 2.048s	user 1.137s	sys 0.213s Metrics: {"bytes_written":437013,"cfile_init":1,"compiler_manager_pool.queue_time_us":19275,"compiler_manager_pool.run_cpu_time_us":979211,"compiler_manager_pool.run_wall_time_us":1484834,"dirs.queue_time_us":439,"dirs.run_cpu_time_us":252,"dirs.run_wall_time_us":955,"drs_written":1,"lbm_read_time_us":72,"lbm_reads_lt_1ms":4,"lbm_write_time_us":16233,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":85,"peak_mem_usage":0,"rows_written":10000,"spinlock_wait_cycles":280320,"thread_start_us":24318,"threads_started":3,"wal-append.queue_time_us":636}
I20260811 12:35:33.592492 22964 maintenance_manager.cc:419] P 7ee723c1aeb54214976e38ac26a5f641: Scheduling UndoDeltaBlockGCOp(e3d11edbc9bc4d4896d4b81761e35a45): 62921 bytes on disk
I20260811 12:35:33.593317 22814 maintenance_manager.cc:643] P 7ee723c1aeb54214976e38ac26a5f641: UndoDeltaBlockGCOp(e3d11edbc9bc4d4896d4b81761e35a45) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":86,"lbm_reads_lt_1ms":4}
W20260811 12:35:33.620246 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.627090 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.654735 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.691825 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.734530 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.779915 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.804112 23329 meta_cache.cc:302] tablet 8527534c1571455eb7dba3236aa6ab12: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:33.827819 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.881289 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.957974 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:33.975279 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.041227 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.113686 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.188774 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.201169 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.307461 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.346696 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.351548 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.432329 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.524792 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.570660 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.666249 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.760826 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.818179 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:34.820730 23328 meta_cache.cc:302] tablet 8527534c1571455eb7dba3236aa6ab12: replica f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:34.927517 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:35.010890 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:35.071489 22812 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Couldn't send request to peer f8349020f94f4a10864ec6f6c76abb4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 12:35:35.096185 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:35.211050 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:35.257026 22813 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Couldn't send request to peer ee3478f02cbe49e68d0a56ff0d738b9b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260811 12:35:35.271535 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
I20260811 12:35:35.354959 23505 raft_consensus.cc:482] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8349020f94f4a10864ec6f6c76abb4b)
I20260811 12:35:35.355161 23505 raft_consensus.cc:504] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:35.355861 23505 leader_election.cc:288] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:35.357645 22812 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:35.357841 22813 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:35.357990 22813 leader_election.cc:302] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:35.358239 23505 raft_consensus.cc:2726] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:35.399494 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:35.488270 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
I20260811 12:35:35.540985 23505 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee3478f02cbe49e68d0a56ff0d738b9b)
I20260811 12:35:35.541249 23505 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:35.542028 23505 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:35.543824 22812 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:35.544018 22813 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:35.544153 22813 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:35.544409 23505 raft_consensus.cc:2726] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:35.591063 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:35.704607 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:35.791972 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:35.851975 23329 meta_cache.cc:302] tablet 8527534c1571455eb7dba3236aa6ab12: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:35.931092 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.002226 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.145000 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.246219 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.365101 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.499325 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.596616 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.758945 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.841612 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:36.919453 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:37.013592 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:37.037253 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:37.224220 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
I20260811 12:35:37.338541 23505 raft_consensus.cc:482] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8349020f94f4a10864ec6f6c76abb4b)
I20260811 12:35:37.338781 23505 raft_consensus.cc:504] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:37.339442 23505 leader_election.cc:288] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:37.341477 22812 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:37.341686 22813 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:37.341809 22813 leader_election.cc:302] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:37.342007 23505 raft_consensus.cc:2726] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:37.357698 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:37.506971 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:37.538619 22812 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Couldn't send request to peer f8349020f94f4a10864ec6f6c76abb4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 12:35:37.568627 22813 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Couldn't send request to peer ee3478f02cbe49e68d0a56ff0d738b9b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260811 12:35:37.630077 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
I20260811 12:35:37.753314 23505 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee3478f02cbe49e68d0a56ff0d738b9b)
I20260811 12:35:37.753616 23505 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:37.754230 23505 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:37.756306 22813 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:37.756484 22812 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
I20260811 12:35:37.756624 22812 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:37.756835 23505 raft_consensus.cc:2726] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:37.805222 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:37.910486 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:37.965977 22812 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111) [suppressed 33 similar messages]
W20260811 12:35:37.983240 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:38.104417 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:38.114010 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:38.320948 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:38.496850 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:38.636706 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:38.800722 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:38.962635 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:38.996744 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:39.112040 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:39.301014 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:39.428805 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
I20260811 12:35:39.610599 23513 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee3478f02cbe49e68d0a56ff0d738b9b)
I20260811 12:35:39.610841 23513 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:39.611644 23513 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:39.613418 22812 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:39.613744 22813 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:39.613857 22813 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:39.614173 23513 raft_consensus.cc:2726] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:39.642977 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:39.755769 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:39.986709 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:39.995569 22812 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Couldn't send request to peer f8349020f94f4a10864ec6f6c76abb4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 12:35:40.097134 23328 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:40.114284 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:40.149847 22813 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Couldn't send request to peer ee3478f02cbe49e68d0a56ff0d738b9b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260811 12:35:40.335882 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:40.480167 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:40.693024 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:40.852211 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:41.055819 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:41.108286 23329 meta_cache.cc:302] tablet 8527534c1571455eb7dba3236aa6ab12: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:41.240696 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:41.431483 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:41.631383 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:41.818573 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.027076 23329 batcher.cc:441] Timed out: Failed to write batch of 8730 ops to tablet 8527534c1571455eb7dba3236aa6ab12 after 128 attempt(s): Failed to write to server: (no server available): Write(tablet: 8527534c1571455eb7dba3236aa6ab12, num_ops: 8730, num_attempts: 128) passed its deadline: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 12:35:42.062217 23513 raft_consensus.cc:482] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8349020f94f4a10864ec6f6c76abb4b)
I20260811 12:35:42.062476 23513 raft_consensus.cc:504] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:42.063299 23513 leader_election.cc:288] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:42.065609 22812 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:42.067500 22813 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:42.067662 22813 leader_election.cc:302] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:42.068099 23513 raft_consensus.cc:2726] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:42.179864 23328 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:42.187054 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.211673 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.216719 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.229501 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.263689 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.315358 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.395221 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.463167 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.538859 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.613329 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.619068 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.626353 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.679647 22812 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Couldn't send request to peer f8349020f94f4a10864ec6f6c76abb4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 12:35:42.694257 22813 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Couldn't send request to peer ee3478f02cbe49e68d0a56ff0d738b9b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260811 12:35:42.722788 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.795673 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:42.905856 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:43.024748 22844 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:43.025398 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:43.111670 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:43.147377 22813 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111) [suppressed 23 similar messages]
W20260811 12:35:43.199790 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:43.293678 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:43.439888 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:43.441766 23329 batcher.cc:441] Timed out: Failed to write batch of 1100 ops to tablet 8527534c1571455eb7dba3236aa6ab12 after 136 attempt(s): Failed to write to server: (no server available): Write(tablet: 8527534c1571455eb7dba3236aa6ab12, num_ops: 1100, num_attempts: 136) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:43.595045 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:43.758445 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:43.932317 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:44.116593 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:44.246659 23328 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:44.314051 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:44.517800 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:44.724437 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:44.949733 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:45.032478 22813 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Couldn't send request to peer ee3478f02cbe49e68d0a56ff0d738b9b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260811 12:35:45.082443 23519 raft_consensus.cc:482] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f8349020f94f4a10864ec6f6c76abb4b)
I20260811 12:35:45.082716 23519 raft_consensus.cc:504] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:45.083451 23519 leader_election.cc:288] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:45.085165 22812 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:45.085637 22813 leader_election.cc:334] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:45.085772 22813 leader_election.cc:302] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:45.086092 23519 raft_consensus.cc:2726] T f8902a051ec041459c228d8483a7a9f6 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:45.129858 22812 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Couldn't send request to peer f8349020f94f4a10864ec6f6c76abb4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260811 12:35:45.178903 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:45.255852 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:45.417929 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:45.668493 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
I20260811 12:35:45.784544 23519 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee3478f02cbe49e68d0a56ff0d738b9b)
I20260811 12:35:45.784785 23519 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:45.785630 23519 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:45.787345 22813 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:45.787565 22812 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
I20260811 12:35:45.791533 22812 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:45.791869 23519 raft_consensus.cc:2726] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 12:35:45.924774 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:46.191313 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:46.280156 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:46.464295 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:46.745152 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:47.033438 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:47.335736 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:47.417728 22813 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Couldn't send request to peer ee3478f02cbe49e68d0a56ff0d738b9b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 12:35:47.437227 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:47.642975 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:47.928647 22812 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Couldn't send request to peer f8349020f94f4a10864ec6f6c76abb4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260811 12:35:47.957516 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:48.284992 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:48.371907 22812 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111) [suppressed 24 similar messages]
W20260811 12:35:48.506458 23328 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:48.619741 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:48.965962 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:49.323453 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:49.565856 23328 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:49.689229 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:50.060072 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:50.179569 22813 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Couldn't send request to peer ee3478f02cbe49e68d0a56ff0d738b9b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 12:35:50.264824 22812 consensus_peers.cc:487] T e3d11edbc9bc4d4896d4b81761e35a45 P 7ee723c1aeb54214976e38ac26a5f641 -> Peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Couldn't send request to peer f8349020f94f4a10864ec6f6c76abb4b. Status: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260811 12:35:50.444882 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:50.572829 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:50.834803 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:51.233121 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:51.642549 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:51.778178 23329 meta_cache.cc:302] tablet f8902a051ec041459c228d8483a7a9f6: replica ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863) has failed: Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
W20260811 12:35:52.055940 22842 tablet_service.cc:695] failed op from {username='slave'} at 127.0.0.1:54958: Illegal state: replica 7ee723c1aeb54214976e38ac26a5f641 is not leader of this config: current role FOLLOWER
W20260811 12:35:52.196396 23325 batcher.cc:441] Timed out: Failed to write batch of 1429 ops to tablet f8902a051ec041459c228d8483a7a9f6 after 137 attempt(s): Failed to write to server: (no server available): Write(tablet: f8902a051ec041459c228d8483a7a9f6, num_ops: 1429, num_attempts: 137) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/all_types-itest.cc:618: Failure
Failed
Bad status: IO error: failed to flush data: error details are available via KuduSession::GetPendingErrors()
E20260811 12:35:52.299049 22650 external_mini_cluster.cc:943] Process with UUID f8349020f94f4a10864ec6f6c76abb4b has crashed
E20260811 12:35:52.299204 22650 external_mini_cluster.cc:943] Process with UUID ee3478f02cbe49e68d0a56ff0d738b9b has crashed
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/external_mini_cluster.cc:947: Failure
Expected equality of these values:
  0
  num_crashes
    Which is: 2
At least one process crashed
I20260811 12:35:52.299817 22650 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu pid 22787
I20260811 12:35:52.308462 22957 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:35:52.457037 23529 raft_consensus.cc:482] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ee3478f02cbe49e68d0a56ff0d738b9b)
I20260811 12:35:52.457376 23529 raft_consensus.cc:504] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ee723c1aeb54214976e38ac26a5f641" member_type: VOTER last_known_addr { host: "127.22.30.129" port: 35353 } } peers { permanent_uuid: "f8349020f94f4a10864ec6f6c76abb4b" member_type: VOTER last_known_addr { host: "127.22.30.130" port: 46867 } } peers { permanent_uuid: "ee3478f02cbe49e68d0a56ff0d738b9b" member_type: VOTER last_known_addr { host: "127.22.30.131" port: 40863 } }
I20260811 12:35:52.458146 23529 leader_election.cc:288] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867), ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863)
W20260811 12:35:52.459970 22812 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f8349020f94f4a10864ec6f6c76abb4b (127.22.30.130:46867): Network error: Client connection negotiation failed: client connection to 127.22.30.130:46867: connect: Connection refused (error 111)
W20260811 12:35:52.460157 22813 leader_election.cc:334] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ee3478f02cbe49e68d0a56ff0d738b9b (127.22.30.131:40863): Network error: Client connection negotiation failed: client connection to 127.22.30.131:40863: connect: Connection refused (error 111)
I20260811 12:35:52.460286 22813 leader_election.cc:302] T 8527534c1571455eb7dba3236aa6ab12 P 7ee723c1aeb54214976e38ac26a5f641 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ee723c1aeb54214976e38ac26a5f641; no voters: ee3478f02cbe49e68d0a56ff0d738b9b, f8349020f94f4a10864ec6f6c76abb4b
I20260811 12:35:52.460294 22650 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu with pid 22787
W20260811 12:35:52.519424 22687 connection.cc:535] server connection from 127.22.30.129:58473 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 12:35:52.519743 22650 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu pid 22660
I20260811 12:35:52.520990 22741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260811 12:35:52.637712 22650 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu with pid 22660
2026-08-11T12:35:52Z chronyd exiting
I20260811 12:35:52.692862 22650 test_util.cc:175] -----------------------------------------------
I20260811 12:35:52.692955 22650 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_3.TestAllKeyTypes.1786451727002381-22650-0
[  FAILED  ] AllTypesItest/3.TestAllKeyTypes, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)7> > (25613 ms)
[----------] 1 test from AllTypesItest/3 (25614 ms total)

[----------] 1 test from AllTypesItest/7, where TypeParam = kudu::client::IntKeysTestSetup<kudu::client::KeyTypeWrapper<(kudu::DataType)13> >
[ RUN      ] AllTypesItest/7.TestAllKeyTypes
I20260811 12:35:52.694967 22650 test_util.cc:268] Using random seed: -1239370615
2026-08-11T12:35:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T12:35:52Z Disabled control of system clock
I20260811 12:35:52.792174 22650 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
/tmp/dist-test-tasksT_fLC/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.30.190:37359
--webserver_interface=127.22.30.190
--webserver_port=0
--builtin_ntp_servers=127.22.30.148:37329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.30.190:37359 with env {}
W20260811 12:35:53.201820 23552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 12:35:53.202126 23552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 12:35:53.202204 23552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 12:35:53.209563 23552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 12:35:53.209663 23552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 12:35:53.209714 23552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 12:35:53.209785 23552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 12:35:53.219029 23552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.30.148:37329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.30.190:37359
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.30.190:37359
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.30.190
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true

Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 11 Aug 2026 11:11:46 UTC on ccycloud.quasar-zjjjhb.root.comops.site
build id 4580142
ASAN enabled
I20260811 12:35:53.220531 23552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 12:35:53.222426 23552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 12:35:53.234674 23560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:53.234642 23564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 12:35:53.234617 23561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 12:35:53.235545 23552 server_base.cc:1034] running on GCE node
I20260811 12:35:53.236359 23552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 12:35:53.237839 23552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 12:35:53.239097 23552 hybrid_clock.cc:648] HybridClock initialized: now 1786451753239025 us; error 42 us; skew 500 ppm
I20260811 12:35:53.239743 23552 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260811 12:35:53.242378 23552 webserver.cc:460] Webserver started at http://127.22.30.190:40051/ using document root <none> and password file <none>
I20260811 12:35:53.243125 23552 fs_manager.cc:359] Metadata directory not provided
I20260811 12:35:53.243278 23552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 12:35:53.243618 23552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 12:35:53.246546 23552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/instance:
uuid: "821738ecae0d41acb121e6604ae7235a"
format_stamp: "Formatted at 2026-08-11 12:35:53 on dist-test-slave-bw88"
I20260811 12:35:53.247432 23552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal/instance:
uuid: "821738ecae0d41acb121e6604ae7235a"
format_stamp: "Formatted at 2026-08-11 12:35:53 on dist-test-slave-bw88"
W20260811 12:35:53.252893 23552 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/data (507514880 bytes available vs 518351011 bytes reserved) (error 28)
I20260811 12:35:53.253082 23552 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260811 12:35:53.256714 23574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260811 12:35:53.258230 23552 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260811 12:35:53.258448 23552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data,/tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
uuid: "821738ecae0d41acb121e6604ae7235a"
format_stamp: "Formatted at 2026-08-11 12:35:53 on dist-test-slave-bw88"
I20260811 12:35:53.258713 23552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 12:35:53.286687 23552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260811 12:35:53.287700 23552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 12:35:53.288033 23552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 12:35:53.308324 23552 rpc_server.cc:307] RPC server started. Bound to: 127.22.30.190:37359
I20260811 12:35:53.308357 23638 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.30.190:37359 every 8 connection(s)
I20260811 12:35:53.309832 23552 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/info.pb
I20260811 12:35:53.311617 22650 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasksT_fLC/build/asan/bin/kudu as pid 23552
I20260811 12:35:53.311830 22650 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/wal/instance
W20260811 12:35:53.314191 23640 dir_manager.cc:174] Insufficient disk space under path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/data: will retry after 10 seconds: IO error: Insufficient disk space to allocate 0 bytes under path /tmp/dist-test-tasksT_fLC/test-tmp/all_types-itest.6.AllTypesItest_7.TestAllKeyTypes.1786451727002381-22650-0/minicluster-data/master-0/data/data (507510784 bytes available vs 518351011 bytes reserved) (error 28)
E20260811 12:35:53.314702 23640 master.cc:392] Unable to init master catalog manager: IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
I20260811 12:35:53.314944 23552 master.cc:537] Master@127.22.30.190:37359 shutting down...
W20260811 12:35:53.330763 23576 connection.cc:441] server connection from 127.0.0.1:52250 torn down before Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:52250 (request call id 0) could send its response
I20260811 12:35:53.344250 23552 master.cc:552] Master@127.22.30.190:37359 shutdown complete.
IO error: Unable to initialize catalog manager: Failed to initialize sys tables async: Failed to create TabletMetadata: All healthy data directories are full (error 28)
F20260811 12:35:58.318356 22650 external_mini_cluster.cc:634] Check failed: leader_master() != nullptr Must have started at least 1 master before adding tablet servers
*** Check failure stack trace: ***
*** Aborted at 1786451758 (unix time) try "date -d @1786451758" if you are using GNU date ***
PC: @                0x0 (unknown)
*** SIGABRT (@0x3e80000587a) received by PID 22650 (TID 0x7f247f56ed40) from PID 22650; stack trace: ***
    @     0x7f2482f30a46 google::(anonymous namespace)::FailureSignalHandler() at ??:0
    @     0x7f2487072980 (unknown) at ??:0
    @     0x7f248025ee87 gsignal at ??:0
    @     0x7f24802607f1 abort at ??:0
    @     0x7f2482f229ad google::LogMessage::Fail() at ??:0
    @     0x7f2482f2588a google::LogMessage::SendToLog() at ??:0
    @     0x7f2482f224de google::LogMessage::Flush() at ??:0
    @     0x7f2482f23a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
    @     0x7f24987e0bc5 kudu::cluster::ExternalMiniCluster::AddTabletServer() at ??:0
    @     0x7f24987da3f0 kudu::cluster::ExternalMiniCluster::Start() at ??:0
    @           0x4c579a kudu::client::AllTypesItest<>::CreateCluster() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/all_types-itest.cc:407
    @           0x4c436f kudu::client::AllTypesItest<>::RunTest() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/all_types-itest.cc:?
    @           0x4c33ad kudu::client::AllTypesItest_TestAllKeyTypes_Test<>::TestBody() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/all_types-itest.cc:676
    @     0x7f2484d41bfe testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
    @     0x7f2484d365db testing::Test::Run() at ??:0
    @     0x7f2484d36795 testing::TestInfo::Run() at ??:0
    @     0x7f2484d36cdf testing::TestSuite::Run() at ??:0
    @     0x7f2484d3729f testing::internal::UnitTestImpl::RunAllTests() at ??:0
    @     0x7f2484d4213e testing::internal::HandleExceptionsInMethodIfSupported<>() at ??:0
    @     0x7f2484d3683d testing::UnitTest::Run() at ??:0
    @           0x539482 RUN_ALL_TESTS() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/uninstrumented/include/gtest/gtest.h:2293
    @           0x537992 main at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109
    @     0x7f2480241c87 __libc_start_main at ??:0
    @           0x362aa9 (unknown) at ??:?