[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from ReplaceTabletITest
[ RUN ] ReplaceTabletITest.ReplaceTabletsWhileWriting
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251026 21:05:07.382376 9700 test_util.cc:276] Using random seed: 590404674
2025-10-26T21:05:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-26T21:05:07Z Disabled control of system clock
I20251026 21:05:07.415019 9700 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu
/tmp/dist-test-taskFuHAzD/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.121.62:35275
--webserver_interface=127.9.121.62
--webserver_port=0
--builtin_ntp_servers=127.9.121.20:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.121.62:35275 with env {}
W20251026 21:05:07.722469 9708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251026 21:05:07.722833 9708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251026 21:05:07.722914 9708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251026 21:05:07.730832 9708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251026 21:05:07.730916 9708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251026 21:05:07.730968 9708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251026 21:05:07.731027 9708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251026 21:05:07.740515 9708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.121.20:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.121.62:35275
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.121.62:35275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.121.62
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type FASTDEBUG
built by None at 26 Oct 2025 20:43:18 UTC on 5fd53c4cbb9d
build id 8732
ASAN enabled
I20251026 21:05:07.742084 9708 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251026 21:05:07.743824 9708 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251026 21:05:07.751740 9714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251026 21:05:07.752035 9716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251026 21:05:07.751896 9713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251026 21:05:07.752516 9708 server_base.cc:1047] running on GCE node
I20251026 21:05:07.753232 9708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251026 21:05:07.754479 9708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251026 21:05:07.755673 9708 hybrid_clock.cc:648] HybridClock initialized: now 1761512707755612 us; error 51 us; skew 500 ppm
I20251026 21:05:07.755962 9708 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251026 21:05:07.757903 9708 webserver.cc:492] Webserver started at http://127.9.121.62:43443/ using document root <none> and password file <none>
I20251026 21:05:07.758606 9708 fs_manager.cc:362] Metadata directory not provided
I20251026 21:05:07.758734 9708 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251026 21:05:07.759078 9708 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251026 21:05:07.761160 9708 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/data/instance:
uuid: "ad72f82bb77a4d2cac109eb4cffc0050"
format_stamp: "Formatted at 2025-10-26 21:05:07 on dist-test-slave-5s4r"
I20251026 21:05:07.761811 9708 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/wal/instance:
uuid: "ad72f82bb77a4d2cac109eb4cffc0050"
format_stamp: "Formatted at 2025-10-26 21:05:07 on dist-test-slave-5s4r"
I20251026 21:05:07.766516 9708 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.007s
I20251026 21:05:07.769670 9722 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:07.770963 9708 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20251026 21:05:07.771099 9708 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/data,/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/wal
uuid: "ad72f82bb77a4d2cac109eb4cffc0050"
format_stamp: "Formatted at 2025-10-26 21:05:07 on dist-test-slave-5s4r"
I20251026 21:05:07.771261 9708 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251026 21:05:07.802320 9708 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251026 21:05:07.803227 9708 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251026 21:05:07.803431 9708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251026 21:05:07.822767 9708 rpc_server.cc:307] RPC server started. Bound to: 127.9.121.62:35275
I20251026 21:05:07.822822 9773 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.121.62:35275 every 8 connection(s)
I20251026 21:05:07.824220 9708 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/data/info.pb
I20251026 21:05:07.828372 9774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:07.830438 9700 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu as pid 9708
I20251026 21:05:07.830693 9700 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/master-0/wal/instance
I20251026 21:05:07.838379 9774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050: Bootstrap starting.
I20251026 21:05:07.841424 9774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:07.842396 9774 log.cc:826] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050: Log is configured to *not* fsync() on all Append() calls
I20251026 21:05:07.844988 9774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050: No bootstrap required, opened a new log
I20251026 21:05:07.850236 9774 raft_consensus.cc:359] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad72f82bb77a4d2cac109eb4cffc0050" member_type: VOTER last_known_addr { host: "127.9.121.62" port: 35275 } }
I20251026 21:05:07.850576 9774 raft_consensus.cc:385] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:07.850688 9774 raft_consensus.cc:740] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad72f82bb77a4d2cac109eb4cffc0050, State: Initialized, Role: FOLLOWER
I20251026 21:05:07.851447 9774 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad72f82bb77a4d2cac109eb4cffc0050" member_type: VOTER last_known_addr { host: "127.9.121.62" port: 35275 } }
I20251026 21:05:07.851670 9774 raft_consensus.cc:399] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251026 21:05:07.851811 9774 raft_consensus.cc:493] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251026 21:05:07.851974 9774 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:07.854640 9774 raft_consensus.cc:515] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad72f82bb77a4d2cac109eb4cffc0050" member_type: VOTER last_known_addr { host: "127.9.121.62" port: 35275 } }
I20251026 21:05:07.855130 9774 leader_election.cc:304] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad72f82bb77a4d2cac109eb4cffc0050; no voters:
I20251026 21:05:07.855707 9774 leader_election.cc:290] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [CANDIDATE]: Term 1 election: Requested vote from peers
I20251026 21:05:07.855845 9779 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 1 FOLLOWER]: Leader election won for term 1
I20251026 21:05:07.856482 9779 raft_consensus.cc:697] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [term 1 LEADER]: Becoming Leader. State: Replica: ad72f82bb77a4d2cac109eb4cffc0050, State: Running, Role: LEADER
I20251026 21:05:07.857033 9779 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad72f82bb77a4d2cac109eb4cffc0050" member_type: VOTER last_known_addr { host: "127.9.121.62" port: 35275 } }
I20251026 21:05:07.858855 9774 sys_catalog.cc:565] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [sys.catalog]: configured and running, proceeding with master startup.
I20251026 21:05:07.860020 9780 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad72f82bb77a4d2cac109eb4cffc0050. Latest consensus state: current_term: 1 leader_uuid: "ad72f82bb77a4d2cac109eb4cffc0050" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad72f82bb77a4d2cac109eb4cffc0050" member_type: VOTER last_known_addr { host: "127.9.121.62" port: 35275 } } }
I20251026 21:05:07.859941 9781 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad72f82bb77a4d2cac109eb4cffc0050" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad72f82bb77a4d2cac109eb4cffc0050" member_type: VOTER last_known_addr { host: "127.9.121.62" port: 35275 } } }
I20251026 21:05:07.860335 9780 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [sys.catalog]: This master's current role is: LEADER
I20251026 21:05:07.860366 9781 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050 [sys.catalog]: This master's current role is: LEADER
I20251026 21:05:07.861682 9784 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251026 21:05:07.867296 9784 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251026 21:05:07.878214 9784 catalog_manager.cc:1357] Generated new cluster ID: 84cbf406e15440968b28f488c08112b0
I20251026 21:05:07.878332 9784 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251026 21:05:07.909060 9784 catalog_manager.cc:1380] Generated new certificate authority record
I20251026 21:05:07.910952 9784 catalog_manager.cc:1514] Loading token signing keys...
I20251026 21:05:07.924098 9784 catalog_manager.cc:6022] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050: Generated new TSK 0
I20251026 21:05:07.925228 9784 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251026 21:05:07.940585 9700 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu
/tmp/dist-test-taskFuHAzD/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.121.1:0
--local_ip_for_outbound_sockets=127.9.121.1
--webserver_interface=127.9.121.1
--webserver_port=0
--tserver_master_addrs=127.9.121.62:35275
--builtin_ntp_servers=127.9.121.20:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20251026 21:05:08.249620 9798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251026 21:05:08.249970 9798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251026 21:05:08.250097 9798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251026 21:05:08.258572 9798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251026 21:05:08.258826 9798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.121.1
I20251026 21:05:08.268491 9798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.121.20:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.121.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.121.1
--webserver_port=0
--tserver_master_addrs=127.9.121.62:35275
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.121.1
--log_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type FASTDEBUG
built by None at 26 Oct 2025 20:43:18 UTC on 5fd53c4cbb9d
build id 8732
ASAN enabled
I20251026 21:05:08.270183 9798 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251026 21:05:08.272011 9798 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251026 21:05:08.280943 9804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251026 21:05:08.280944 9803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251026 21:05:08.281986 9806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251026 21:05:08.282347 9798 server_base.cc:1047] running on GCE node
I20251026 21:05:08.282927 9798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251026 21:05:08.283751 9798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251026 21:05:08.284958 9798 hybrid_clock.cc:648] HybridClock initialized: now 1761512708284904 us; error 41 us; skew 500 ppm
I20251026 21:05:08.285235 9798 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251026 21:05:08.287241 9798 webserver.cc:492] Webserver started at http://127.9.121.1:43011/ using document root <none> and password file <none>
I20251026 21:05:08.287956 9798 fs_manager.cc:362] Metadata directory not provided
I20251026 21:05:08.288065 9798 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251026 21:05:08.288388 9798 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251026 21:05:08.290617 9798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/data/instance:
uuid: "e11e0a781c964fbab4e3d6e7fe89182c"
format_stamp: "Formatted at 2025-10-26 21:05:08 on dist-test-slave-5s4r"
I20251026 21:05:08.291440 9798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/wal/instance:
uuid: "e11e0a781c964fbab4e3d6e7fe89182c"
format_stamp: "Formatted at 2025-10-26 21:05:08 on dist-test-slave-5s4r"
I20251026 21:05:08.296476 9798 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20251026 21:05:08.299678 9812 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:08.300966 9798 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20251026 21:05:08.301147 9798 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/data,/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/wal
uuid: "e11e0a781c964fbab4e3d6e7fe89182c"
format_stamp: "Formatted at 2025-10-26 21:05:08 on dist-test-slave-5s4r"
I20251026 21:05:08.301332 9798 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251026 21:05:08.322613 9798 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251026 21:05:08.323453 9798 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251026 21:05:08.323720 9798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251026 21:05:08.324632 9798 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251026 21:05:08.326141 9798 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251026 21:05:08.326237 9798 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:08.326349 9798 ts_tablet_manager.cc:616] Registered 0 tablets
I20251026 21:05:08.326417 9798 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:08.366384 9798 rpc_server.cc:307] RPC server started. Bound to: 127.9.121.1:37253
I20251026 21:05:08.366429 9924 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.121.1:37253 every 8 connection(s)
I20251026 21:05:08.367760 9798 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/data/info.pb
I20251026 21:05:08.368326 9700 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu as pid 9798
I20251026 21:05:08.368513 9700 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/wal/instance
I20251026 21:05:08.372449 9700 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu
/tmp/dist-test-taskFuHAzD/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.121.2:0
--local_ip_for_outbound_sockets=127.9.121.2
--webserver_interface=127.9.121.2
--webserver_port=0
--tserver_master_addrs=127.9.121.62:35275
--builtin_ntp_servers=127.9.121.20:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251026 21:05:08.380824 9925 heartbeater.cc:344] Connected to a master server at 127.9.121.62:35275
I20251026 21:05:08.381124 9925 heartbeater.cc:461] Registering TS with master...
I20251026 21:05:08.381924 9925 heartbeater.cc:507] Master 127.9.121.62:35275 requested a full tablet report, sending...
I20251026 21:05:08.383929 9739 ts_manager.cc:194] Registered new tserver with Master: e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253)
I20251026 21:05:08.385317 9739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.121.1:45883
W20251026 21:05:08.682569 9929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251026 21:05:08.682853 9929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251026 21:05:08.682971 9929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251026 21:05:08.690809 9929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251026 21:05:08.691020 9929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.121.2
I20251026 21:05:08.700577 9929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.121.20:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.121.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.121.2
--webserver_port=0
--tserver_master_addrs=127.9.121.62:35275
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.121.2
--log_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type FASTDEBUG
built by None at 26 Oct 2025 20:43:18 UTC on 5fd53c4cbb9d
build id 8732
ASAN enabled
I20251026 21:05:08.702229 9929 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251026 21:05:08.704007 9929 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251026 21:05:08.712975 9935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251026 21:05:08.712997 9934 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251026 21:05:08.714951 9929 server_base.cc:1047] running on GCE node
W20251026 21:05:08.715719 9937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251026 21:05:08.716256 9929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251026 21:05:08.717110 9929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251026 21:05:08.718297 9929 hybrid_clock.cc:648] HybridClock initialized: now 1761512708718259 us; error 29 us; skew 500 ppm
I20251026 21:05:08.718575 9929 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251026 21:05:08.720583 9929 webserver.cc:492] Webserver started at http://127.9.121.2:41309/ using document root <none> and password file <none>
I20251026 21:05:08.721271 9929 fs_manager.cc:362] Metadata directory not provided
I20251026 21:05:08.721365 9929 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251026 21:05:08.721691 9929 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251026 21:05:08.723930 9929 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/data/instance:
uuid: "ef7dd9d5893148e8a25ce01222bfd1aa"
format_stamp: "Formatted at 2025-10-26 21:05:08 on dist-test-slave-5s4r"
I20251026 21:05:08.724658 9929 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/wal/instance:
uuid: "ef7dd9d5893148e8a25ce01222bfd1aa"
format_stamp: "Formatted at 2025-10-26 21:05:08 on dist-test-slave-5s4r"
I20251026 21:05:08.729593 9929 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20251026 21:05:08.732649 9943 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:08.733843 9929 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251026 21:05:08.733980 9929 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/data,/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/wal
uuid: "ef7dd9d5893148e8a25ce01222bfd1aa"
format_stamp: "Formatted at 2025-10-26 21:05:08 on dist-test-slave-5s4r"
I20251026 21:05:08.734169 9929 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251026 21:05:08.753685 9929 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251026 21:05:08.754441 9929 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251026 21:05:08.754721 9929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251026 21:05:08.755579 9929 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251026 21:05:08.757062 9929 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251026 21:05:08.757145 9929 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:08.757266 9929 ts_tablet_manager.cc:616] Registered 0 tablets
I20251026 21:05:08.757337 9929 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:08.788863 9929 rpc_server.cc:307] RPC server started. Bound to: 127.9.121.2:39969
I20251026 21:05:08.788901 10055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.121.2:39969 every 8 connection(s)
I20251026 21:05:08.790225 9929 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/data/info.pb
I20251026 21:05:08.798111 9700 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu as pid 9929
I20251026 21:05:08.798316 9700 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/wal/instance
I20251026 21:05:08.801427 9700 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu
/tmp/dist-test-taskFuHAzD/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.121.3:0
--local_ip_for_outbound_sockets=127.9.121.3
--webserver_interface=127.9.121.3
--webserver_port=0
--tserver_master_addrs=127.9.121.62:35275
--builtin_ntp_servers=127.9.121.20:40049
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251026 21:05:08.808208 10056 heartbeater.cc:344] Connected to a master server at 127.9.121.62:35275
I20251026 21:05:08.808627 10056 heartbeater.cc:461] Registering TS with master...
I20251026 21:05:08.809720 10056 heartbeater.cc:507] Master 127.9.121.62:35275 requested a full tablet report, sending...
I20251026 21:05:08.811403 9739 ts_manager.cc:194] Registered new tserver with Master: ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969)
I20251026 21:05:08.812213 9739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.121.2:44527
W20251026 21:05:09.113797 10059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251026 21:05:09.114065 10059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251026 21:05:09.114140 10059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251026 21:05:09.121815 10059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251026 21:05:09.121989 10059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.121.3
I20251026 21:05:09.131266 10059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.121.20:40049
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.121.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.121.3
--webserver_port=0
--tserver_master_addrs=127.9.121.62:35275
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.121.3
--log_dir=/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type FASTDEBUG
built by None at 26 Oct 2025 20:43:18 UTC on 5fd53c4cbb9d
build id 8732
ASAN enabled
I20251026 21:05:09.132851 10059 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251026 21:05:09.134492 10059 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251026 21:05:09.143285 10065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251026 21:05:09.143370 10064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251026 21:05:09.143805 10067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251026 21:05:09.144410 10059 server_base.cc:1047] running on GCE node
I20251026 21:05:09.144933 10059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251026 21:05:09.145752 10059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251026 21:05:09.146961 10059 hybrid_clock.cc:648] HybridClock initialized: now 1761512709146912 us; error 43 us; skew 500 ppm
I20251026 21:05:09.147253 10059 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251026 21:05:09.149326 10059 webserver.cc:492] Webserver started at http://127.9.121.3:46773/ using document root <none> and password file <none>
I20251026 21:05:09.150056 10059 fs_manager.cc:362] Metadata directory not provided
I20251026 21:05:09.150154 10059 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251026 21:05:09.150501 10059 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251026 21:05:09.152745 10059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/data/instance:
uuid: "4473ec849b894f7b9407b5d1aa4e671b"
format_stamp: "Formatted at 2025-10-26 21:05:09 on dist-test-slave-5s4r"
I20251026 21:05:09.153455 10059 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/wal/instance:
uuid: "4473ec849b894f7b9407b5d1aa4e671b"
format_stamp: "Formatted at 2025-10-26 21:05:09 on dist-test-slave-5s4r"
I20251026 21:05:09.158280 10059 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20251026 21:05:09.161404 10073 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:09.162595 10059 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251026 21:05:09.162761 10059 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/data,/tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/wal
uuid: "4473ec849b894f7b9407b5d1aa4e671b"
format_stamp: "Formatted at 2025-10-26 21:05:09 on dist-test-slave-5s4r"
I20251026 21:05:09.162935 10059 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251026 21:05:09.176409 10059 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251026 21:05:09.177188 10059 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251026 21:05:09.177429 10059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251026 21:05:09.178288 10059 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251026 21:05:09.179806 10059 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251026 21:05:09.179903 10059 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:09.180011 10059 ts_tablet_manager.cc:616] Registered 0 tablets
I20251026 21:05:09.180092 10059 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251026 21:05:09.209846 10059 rpc_server.cc:307] RPC server started. Bound to: 127.9.121.3:37293
I20251026 21:05:09.209883 10185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.121.3:37293 every 8 connection(s)
I20251026 21:05:09.211221 10059 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/data/info.pb
I20251026 21:05:09.219707 9700 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu as pid 10059
I20251026 21:05:09.219861 9700 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/wal/instance
I20251026 21:05:09.223944 10186 heartbeater.cc:344] Connected to a master server at 127.9.121.62:35275
I20251026 21:05:09.224339 10186 heartbeater.cc:461] Registering TS with master...
I20251026 21:05:09.225088 10186 heartbeater.cc:507] Master 127.9.121.62:35275 requested a full tablet report, sending...
I20251026 21:05:09.226387 9739 ts_manager.cc:194] Registered new tserver with Master: 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293)
I20251026 21:05:09.227128 9739 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.9.121.3:33023
I20251026 21:05:09.236464 9700 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251026 21:05:09.263329 9700 test_util.cc:276] Using random seed: 592285645
I20251026 21:05:09.282578 9739 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36194:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251026 21:05:09.284370 9739 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251026 21:05:09.328056 9991 tablet_service.cc:1505] Processing CreateTablet for tablet e1fbb7e92c0349bf879c8c9c4d4c1912 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251026 21:05:09.328477 10119 tablet_service.cc:1505] Processing CreateTablet for tablet 1f7f814d7bc644e5befcbbdcb5f07ce0 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251026 21:05:09.328630 10118 tablet_service.cc:1505] Processing CreateTablet for tablet 1c8a1258ed064cddaf9ce5901ebc14c9 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251026 21:05:09.328068 9990 tablet_service.cc:1505] Processing CreateTablet for tablet 255a20e2532944eb8c49530b1d38f10e (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251026 21:05:09.330209 9991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1fbb7e92c0349bf879c8c9c4d4c1912. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.330363 10118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8a1258ed064cddaf9ce5901ebc14c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.331004 9990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255a20e2532944eb8c49530b1d38f10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.333523 10121 tablet_service.cc:1505] Processing CreateTablet for tablet e1fbb7e92c0349bf879c8c9c4d4c1912 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251026 21:05:09.334084 10121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1fbb7e92c0349bf879c8c9c4d4c1912. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.333230 9857 tablet_service.cc:1505] Processing CreateTablet for tablet 1c8a1258ed064cddaf9ce5901ebc14c9 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251026 21:05:09.335402 9858 tablet_service.cc:1505] Processing CreateTablet for tablet 1f7f814d7bc644e5befcbbdcb5f07ce0 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251026 21:05:09.336251 9859 tablet_service.cc:1505] Processing CreateTablet for tablet 255a20e2532944eb8c49530b1d38f10e (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251026 21:05:09.337137 9857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8a1258ed064cddaf9ce5901ebc14c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.338244 9989 tablet_service.cc:1505] Processing CreateTablet for tablet 1f7f814d7bc644e5befcbbdcb5f07ce0 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251026 21:05:09.338861 9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7f814d7bc644e5befcbbdcb5f07ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.338896 9859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255a20e2532944eb8c49530b1d38f10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.342186 9858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7f814d7bc644e5befcbbdcb5f07ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.342607 10119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7f814d7bc644e5befcbbdcb5f07ce0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.347252 9860 tablet_service.cc:1505] Processing CreateTablet for tablet e1fbb7e92c0349bf879c8c9c4d4c1912 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251026 21:05:09.347646 9988 tablet_service.cc:1505] Processing CreateTablet for tablet 1c8a1258ed064cddaf9ce5901ebc14c9 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251026 21:05:09.348070 9860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1fbb7e92c0349bf879c8c9c4d4c1912. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.348230 9988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c8a1258ed064cddaf9ce5901ebc14c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.329069 10120 tablet_service.cc:1505] Processing CreateTablet for tablet 255a20e2532944eb8c49530b1d38f10e (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251026 21:05:09.355104 10120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255a20e2532944eb8c49530b1d38f10e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:09.371675 10215 tablet_bootstrap.cc:492] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa: Bootstrap starting.
I20251026 21:05:09.371812 10216 tablet_bootstrap.cc:492] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c: Bootstrap starting.
I20251026 21:05:09.375262 10214 tablet_bootstrap.cc:492] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b: Bootstrap starting.
I20251026 21:05:09.376173 10215 tablet_bootstrap.cc:654] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.376179 10216 tablet_bootstrap.cc:654] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.377526 10216 log.cc:826] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c: Log is configured to *not* fsync() on all Append() calls
I20251026 21:05:09.377929 10215 log.cc:826] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa: Log is configured to *not* fsync() on all Append() calls
I20251026 21:05:09.379232 10214 tablet_bootstrap.cc:654] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.380604 10214 log.cc:826] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b: Log is configured to *not* fsync() on all Append() calls
I20251026 21:05:09.384716 10215 tablet_bootstrap.cc:492] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa: No bootstrap required, opened a new log
I20251026 21:05:09.385125 10215 ts_tablet_manager.cc:1403] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.010s
I20251026 21:05:09.388136 9925 heartbeater.cc:499] Master 127.9.121.62:35275 was elected leader, sending a full tablet report...
I20251026 21:05:09.394096 10216 tablet_bootstrap.cc:492] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c: No bootstrap required, opened a new log
I20251026 21:05:09.394415 10216 ts_tablet_manager.cc:1403] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.013s
I20251026 21:05:09.395215 10214 tablet_bootstrap.cc:492] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b: No bootstrap required, opened a new log
I20251026 21:05:09.395474 10214 ts_tablet_manager.cc:1403] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b: Time spent bootstrapping tablet: real 0.021s user 0.006s sys 0.011s
I20251026 21:05:09.395366 10215 raft_consensus.cc:359] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.395763 10215 raft_consensus.cc:385] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.395879 10215 raft_consensus.cc:740] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7dd9d5893148e8a25ce01222bfd1aa, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.396780 10215 consensus_queue.cc:260] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.397120 10220 raft_consensus.cc:493] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251026 21:05:09.397377 10220 raft_consensus.cc:515] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.403764 10216 raft_consensus.cc:359] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.403761 10214 raft_consensus.cc:359] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.404243 10214 raft_consensus.cc:385] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.404371 10214 raft_consensus.cc:740] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4473ec849b894f7b9407b5d1aa4e671b, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.404388 10216 raft_consensus.cc:385] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.404603 10216 raft_consensus.cc:740] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11e0a781c964fbab4e3d6e7fe89182c, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.405156 10214 consensus_queue.cc:260] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.405850 10216 consensus_queue.cc:260] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.407763 10220 leader_election.cc:290] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253), 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293)
I20251026 21:05:09.408846 10056 heartbeater.cc:499] Master 127.9.121.62:35275 was elected leader, sending a full tablet report...
I20251026 21:05:09.423933 10215 ts_tablet_manager.cc:1434] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent starting tablet: real 0.039s user 0.012s sys 0.023s
I20251026 21:05:09.424387 9880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "255a20e2532944eb8c49530b1d38f10e" candidate_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" is_pre_election: true
I20251026 21:05:09.425436 10186 heartbeater.cc:499] Master 127.9.121.62:35275 was elected leader, sending a full tablet report...
W20251026 21:05:09.425971 9944 leader_election.cc:343] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253): Illegal state: must be running to vote when last-logged opid is not known
I20251026 21:05:09.426465 10214 ts_tablet_manager.cc:1434] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b: Time spent starting tablet: real 0.031s user 0.005s sys 0.012s
I20251026 21:05:09.426939 10214 tablet_bootstrap.cc:492] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b: Bootstrap starting.
I20251026 21:05:09.427167 10215 tablet_bootstrap.cc:492] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa: Bootstrap starting.
I20251026 21:05:09.427994 10223 raft_consensus.cc:493] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251026 21:05:09.428252 10223 raft_consensus.cc:515] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.429087 10214 tablet_bootstrap.cc:654] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.429093 10215 tablet_bootstrap.cc:654] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.430269 10141 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "255a20e2532944eb8c49530b1d38f10e" candidate_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4473ec849b894f7b9407b5d1aa4e671b" is_pre_election: true
I20251026 21:05:09.433153 10216 ts_tablet_manager.cc:1434] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c: Time spent starting tablet: real 0.039s user 0.026s sys 0.002s
W20251026 21:05:09.434309 9947 leader_election.cc:343] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293): Illegal state: must be running to vote when last-logged opid is not known
I20251026 21:05:09.434481 9947 leader_election.cc:304] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef7dd9d5893148e8a25ce01222bfd1aa; no voters: 4473ec849b894f7b9407b5d1aa4e671b, e11e0a781c964fbab4e3d6e7fe89182c
I20251026 21:05:09.445346 10221 raft_consensus.cc:2749] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251026 21:05:09.446238 10216 tablet_bootstrap.cc:492] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c: Bootstrap starting.
I20251026 21:05:09.445230 10223 leader_election.cc:290] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969), e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253)
I20251026 21:05:09.448727 10216 tablet_bootstrap.cc:654] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.450317 10011 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1fbb7e92c0349bf879c8c9c4d4c1912" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" is_pre_election: true
W20251026 21:05:09.451607 10074 leader_election.cc:343] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969): Illegal state: must be running to vote when last-logged opid is not known
I20251026 21:05:09.451823 10216 tablet_bootstrap.cc:492] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c: No bootstrap required, opened a new log
I20251026 21:05:09.451830 10214 tablet_bootstrap.cc:492] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b: No bootstrap required, opened a new log
I20251026 21:05:09.451963 10214 ts_tablet_manager.cc:1403] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b: Time spent bootstrapping tablet: real 0.025s user 0.008s sys 0.014s
I20251026 21:05:09.451974 10216 ts_tablet_manager.cc:1403] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20251026 21:05:09.452654 10215 tablet_bootstrap.cc:492] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa: No bootstrap required, opened a new log
I20251026 21:05:09.452782 10215 ts_tablet_manager.cc:1403] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.013s
I20251026 21:05:09.452910 10214 raft_consensus.cc:359] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.452991 10216 raft_consensus.cc:359] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.453109 10214 raft_consensus.cc:385] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.453179 10216 raft_consensus.cc:385] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.453192 10214 raft_consensus.cc:740] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4473ec849b894f7b9407b5d1aa4e671b, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.453277 10216 raft_consensus.cc:740] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11e0a781c964fbab4e3d6e7fe89182c, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.453502 10214 consensus_queue.cc:260] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.453505 10216 consensus_queue.cc:260] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.453663 10215 raft_consensus.cc:359] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.453840 10215 raft_consensus.cc:385] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.453922 10215 raft_consensus.cc:740] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7dd9d5893148e8a25ce01222bfd1aa, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.454035 10216 ts_tablet_manager.cc:1434] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20251026 21:05:09.454124 10215 consensus_queue.cc:260] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.454303 10216 tablet_bootstrap.cc:492] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c: Bootstrap starting.
I20251026 21:05:09.455602 10215 ts_tablet_manager.cc:1434] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251026 21:05:09.455899 10215 tablet_bootstrap.cc:492] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Bootstrap starting.
I20251026 21:05:09.456005 10216 tablet_bootstrap.cc:654] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.457218 10214 ts_tablet_manager.cc:1434] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s
I20251026 21:05:09.457499 10214 tablet_bootstrap.cc:492] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b: Bootstrap starting.
I20251026 21:05:09.457851 10215 tablet_bootstrap.cc:654] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.459201 10214 tablet_bootstrap.cc:654] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b: Neither blocks nor log segments found. Creating new log.
W20251026 21:05:09.462989 10187 tablet.cc:2378] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251026 21:05:09.464529 9880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1fbb7e92c0349bf879c8c9c4d4c1912" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" is_pre_election: true
I20251026 21:05:09.464969 9880 raft_consensus.cc:2468] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 0.
I20251026 21:05:09.465736 10074 leader_election.cc:304] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4473ec849b894f7b9407b5d1aa4e671b, e11e0a781c964fbab4e3d6e7fe89182c; no voters: ef7dd9d5893148e8a25ce01222bfd1aa
I20251026 21:05:09.470338 10223 raft_consensus.cc:2804] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251026 21:05:09.470604 10223 raft_consensus.cc:493] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251026 21:05:09.471060 10223 raft_consensus.cc:3060] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.478920 10223 raft_consensus.cc:515] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.480580 10223 leader_election.cc:290] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 election: Requested vote from peers ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969), e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253)
I20251026 21:05:09.487185 10011 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1fbb7e92c0349bf879c8c9c4d4c1912" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa"
I20251026 21:05:09.487511 10011 raft_consensus.cc:3060] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.491954 10011 raft_consensus.cc:2468] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 1.
I20251026 21:05:09.493278 9880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e1fbb7e92c0349bf879c8c9c4d4c1912" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c"
I20251026 21:05:09.493573 9880 raft_consensus.cc:3060] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.497910 9880 raft_consensus.cc:2468] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 1.
I20251026 21:05:09.498724 10074 leader_election.cc:304] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4473ec849b894f7b9407b5d1aa4e671b, e11e0a781c964fbab4e3d6e7fe89182c; no voters:
I20251026 21:05:09.499451 10233 raft_consensus.cc:2804] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Leader election won for term 1
I20251026 21:05:09.499734 10233 raft_consensus.cc:697] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 LEADER]: Becoming Leader. State: Replica: 4473ec849b894f7b9407b5d1aa4e671b, State: Running, Role: LEADER
I20251026 21:05:09.502421 10233 consensus_queue.cc:237] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } }
I20251026 21:05:09.507843 10216 tablet_bootstrap.cc:492] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c: No bootstrap required, opened a new log
I20251026 21:05:09.507840 10215 tablet_bootstrap.cc:492] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: No bootstrap required, opened a new log
I20251026 21:05:09.507864 10214 tablet_bootstrap.cc:492] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b: No bootstrap required, opened a new log
I20251026 21:05:09.508023 10215 ts_tablet_manager.cc:1403] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent bootstrapping tablet: real 0.052s user 0.009s sys 0.041s
I20251026 21:05:09.508023 10216 ts_tablet_manager.cc:1403] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c: Time spent bootstrapping tablet: real 0.054s user 0.015s sys 0.037s
I20251026 21:05:09.508065 10214 ts_tablet_manager.cc:1403] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b: Time spent bootstrapping tablet: real 0.051s user 0.011s sys 0.034s
I20251026 21:05:09.508810 10215 raft_consensus.cc:359] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.508797 10216 raft_consensus.cc:359] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.508860 10214 raft_consensus.cc:359] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.509006 10215 raft_consensus.cc:385] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.509006 10216 raft_consensus.cc:385] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.509073 10215 raft_consensus.cc:740] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7dd9d5893148e8a25ce01222bfd1aa, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.509083 10216 raft_consensus.cc:740] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11e0a781c964fbab4e3d6e7fe89182c, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.509083 10214 raft_consensus.cc:385] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.509159 10214 raft_consensus.cc:740] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4473ec849b894f7b9407b5d1aa4e671b, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.509357 10215 consensus_queue.cc:260] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.509336 10216 consensus_queue.cc:260] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.509380 10214 consensus_queue.cc:260] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.509862 10214 ts_tablet_manager.cc:1434] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251026 21:05:09.510175 10214 tablet_bootstrap.cc:492] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: Bootstrap starting.
I20251026 21:05:09.510579 9737 catalog_manager.cc:5649] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3). New cstate: current_term: 1 leader_uuid: "4473ec849b894f7b9407b5d1aa4e671b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } health_report { overall_health: UNKNOWN } } }
I20251026 21:05:09.511672 10215 ts_tablet_manager.cc:1434] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20251026 21:05:09.511969 10214 tablet_bootstrap.cc:654] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.511976 10215 tablet_bootstrap.cc:492] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa: Bootstrap starting.
I20251026 21:05:09.514366 10215 tablet_bootstrap.cc:654] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.515978 10216 ts_tablet_manager.cc:1434] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s
I20251026 21:05:09.518323 10216 tablet_bootstrap.cc:492] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Bootstrap starting.
I20251026 21:05:09.520305 10214 tablet_bootstrap.cc:492] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: No bootstrap required, opened a new log
I20251026 21:05:09.520356 10216 tablet_bootstrap.cc:654] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:09.520442 10214 ts_tablet_manager.cc:1403] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20251026 21:05:09.520841 10215 tablet_bootstrap.cc:492] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa: No bootstrap required, opened a new log
I20251026 21:05:09.520987 10215 ts_tablet_manager.cc:1403] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20251026 21:05:09.521080 10214 raft_consensus.cc:359] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.521245 10214 raft_consensus.cc:385] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.521334 10214 raft_consensus.cc:740] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4473ec849b894f7b9407b5d1aa4e671b, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.521570 10214 consensus_queue.cc:260] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.522011 10214 ts_tablet_manager.cc:1434] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251026 21:05:09.522086 10215 raft_consensus.cc:359] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.522360 10215 raft_consensus.cc:385] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.522466 10215 raft_consensus.cc:740] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7dd9d5893148e8a25ce01222bfd1aa, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.522758 10215 consensus_queue.cc:260] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.523267 10215 ts_tablet_manager.cc:1434] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20251026 21:05:09.524012 10216 tablet_bootstrap.cc:492] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: No bootstrap required, opened a new log
I20251026 21:05:09.524155 10216 ts_tablet_manager.cc:1403] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20251026 21:05:09.524874 10216 raft_consensus.cc:359] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.525065 10216 raft_consensus.cc:385] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:09.525167 10216 raft_consensus.cc:740] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11e0a781c964fbab4e3d6e7fe89182c, State: Initialized, Role: FOLLOWER
I20251026 21:05:09.525398 10216 consensus_queue.cc:260] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.525931 10216 ts_tablet_manager.cc:1434] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20251026 21:05:09.542237 10057 tablet.cc:2378] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251026 21:05:09.620371 9926 tablet.cc:2378] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251026 21:05:09.660336 10221 raft_consensus.cc:493] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251026 21:05:09.660562 10221 raft_consensus.cc:515] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.661298 10221 leader_election.cc:290] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253), 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293)
I20251026 21:05:09.661877 9880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" candidate_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" is_pre_election: true
I20251026 21:05:09.661856 10141 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" candidate_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4473ec849b894f7b9407b5d1aa4e671b" is_pre_election: true
I20251026 21:05:09.662083 9880 raft_consensus.cc:2468] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7dd9d5893148e8a25ce01222bfd1aa in term 0.
I20251026 21:05:09.662122 10141 raft_consensus.cc:2468] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7dd9d5893148e8a25ce01222bfd1aa in term 0.
I20251026 21:05:09.662557 9947 leader_election.cc:304] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4473ec849b894f7b9407b5d1aa4e671b, e11e0a781c964fbab4e3d6e7fe89182c, ef7dd9d5893148e8a25ce01222bfd1aa; no voters:
I20251026 21:05:09.662868 10221 raft_consensus.cc:2804] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251026 21:05:09.662954 10221 raft_consensus.cc:493] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251026 21:05:09.663056 10221 raft_consensus.cc:3060] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.668129 10221 raft_consensus.cc:515] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.668748 10221 leader_election.cc:290] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [CANDIDATE]: Term 1 election: Requested vote from peers e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253), 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293)
I20251026 21:05:09.669204 10141 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" candidate_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4473ec849b894f7b9407b5d1aa4e671b"
I20251026 21:05:09.669231 9880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" candidate_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c"
I20251026 21:05:09.669410 9880 raft_consensus.cc:3060] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.669421 10141 raft_consensus.cc:3060] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.671399 9880 raft_consensus.cc:2468] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7dd9d5893148e8a25ce01222bfd1aa in term 1.
I20251026 21:05:09.671432 10141 raft_consensus.cc:2468] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7dd9d5893148e8a25ce01222bfd1aa in term 1.
I20251026 21:05:09.671790 9944 leader_election.cc:304] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11e0a781c964fbab4e3d6e7fe89182c, ef7dd9d5893148e8a25ce01222bfd1aa; no voters:
I20251026 21:05:09.672030 10221 raft_consensus.cc:2804] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Leader election won for term 1
I20251026 21:05:09.672175 10221 raft_consensus.cc:697] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 LEADER]: Becoming Leader. State: Replica: ef7dd9d5893148e8a25ce01222bfd1aa, State: Running, Role: LEADER
I20251026 21:05:09.672571 10221 consensus_queue.cc:237] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.677390 9738 catalog_manager.cc:5649] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2). New cstate: current_term: 1 leader_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } health_report { overall_health: UNKNOWN } } }
I20251026 21:05:09.713400 10224 raft_consensus.cc:493] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251026 21:05:09.713587 10224 raft_consensus.cc:515] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.715222 10224 leader_election.cc:290] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969), 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293)
I20251026 21:05:09.721814 10011 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7f814d7bc644e5befcbbdcb5f07ce0" candidate_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" is_pre_election: true
I20251026 21:05:09.721823 10141 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7f814d7bc644e5befcbbdcb5f07ce0" candidate_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4473ec849b894f7b9407b5d1aa4e671b" is_pre_election: true
I20251026 21:05:09.722014 10011 raft_consensus.cc:2468] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11e0a781c964fbab4e3d6e7fe89182c in term 0.
I20251026 21:05:09.722013 10141 raft_consensus.cc:2468] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e11e0a781c964fbab4e3d6e7fe89182c in term 0.
I20251026 21:05:09.722424 9816 leader_election.cc:304] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4473ec849b894f7b9407b5d1aa4e671b, e11e0a781c964fbab4e3d6e7fe89182c; no voters:
I20251026 21:05:09.722774 10224 raft_consensus.cc:2804] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251026 21:05:09.722892 10224 raft_consensus.cc:493] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251026 21:05:09.722986 10224 raft_consensus.cc:3060] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.724857 10224 raft_consensus.cc:515] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.725476 10224 leader_election.cc:290] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [CANDIDATE]: Term 1 election: Requested vote from peers ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969), 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293)
I20251026 21:05:09.725821 10011 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7f814d7bc644e5befcbbdcb5f07ce0" candidate_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa"
I20251026 21:05:09.725941 10141 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7f814d7bc644e5befcbbdcb5f07ce0" candidate_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4473ec849b894f7b9407b5d1aa4e671b"
I20251026 21:05:09.726002 10011 raft_consensus.cc:3060] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.726114 10141 raft_consensus.cc:3060] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.728696 10141 raft_consensus.cc:2468] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11e0a781c964fbab4e3d6e7fe89182c in term 1.
I20251026 21:05:09.728694 10011 raft_consensus.cc:2468] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e11e0a781c964fbab4e3d6e7fe89182c in term 1.
I20251026 21:05:09.729121 9813 leader_election.cc:304] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e11e0a781c964fbab4e3d6e7fe89182c, ef7dd9d5893148e8a25ce01222bfd1aa; no voters:
I20251026 21:05:09.729394 10224 raft_consensus.cc:2804] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Leader election won for term 1
I20251026 21:05:09.729812 10224 raft_consensus.cc:697] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 LEADER]: Becoming Leader. State: Replica: e11e0a781c964fbab4e3d6e7fe89182c, State: Running, Role: LEADER
I20251026 21:05:09.730238 10224 consensus_queue.cc:237] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.734776 9738 catalog_manager.cc:5649] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c reported cstate change: term changed from 0 to 1, leader changed from <none> to e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1). New cstate: current_term: 1 leader_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } health_report { overall_health: UNKNOWN } } }
I20251026 21:05:09.770262 10233 raft_consensus.cc:493] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251026 21:05:09.770489 10233 raft_consensus.cc:515] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.771128 10233 leader_election.cc:290] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253), ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969)
I20251026 21:05:09.771728 9880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "255a20e2532944eb8c49530b1d38f10e" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" is_pre_election: true
I20251026 21:05:09.771744 10011 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "255a20e2532944eb8c49530b1d38f10e" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" is_pre_election: true
I20251026 21:05:09.771944 10011 raft_consensus.cc:2468] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 0.
I20251026 21:05:09.771958 9880 raft_consensus.cc:2468] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 0.
I20251026 21:05:09.772379 10074 leader_election.cc:304] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4473ec849b894f7b9407b5d1aa4e671b, ef7dd9d5893148e8a25ce01222bfd1aa; no voters:
I20251026 21:05:09.772629 10233 raft_consensus.cc:2804] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251026 21:05:09.772708 10233 raft_consensus.cc:493] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251026 21:05:09.772812 10233 raft_consensus.cc:3060] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.774652 10233 raft_consensus.cc:515] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.775161 10233 leader_election.cc:290] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 election: Requested vote from peers e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253), ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969)
I20251026 21:05:09.775615 10011 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "255a20e2532944eb8c49530b1d38f10e" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa"
I20251026 21:05:09.775602 9880 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "255a20e2532944eb8c49530b1d38f10e" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c"
I20251026 21:05:09.775825 9880 raft_consensus.cc:3060] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.775919 10011 raft_consensus.cc:3060] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:09.778815 9880 raft_consensus.cc:2468] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 1.
I20251026 21:05:09.778986 10011 raft_consensus.cc:2468] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 1.
I20251026 21:05:09.779273 10074 leader_election.cc:304] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4473ec849b894f7b9407b5d1aa4e671b, e11e0a781c964fbab4e3d6e7fe89182c; no voters:
I20251026 21:05:09.779477 10233 raft_consensus.cc:2804] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Leader election won for term 1
I20251026 21:05:09.779614 10233 raft_consensus.cc:697] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [term 1 LEADER]: Becoming Leader. State: Replica: 4473ec849b894f7b9407b5d1aa4e671b, State: Running, Role: LEADER
I20251026 21:05:09.779906 10233 consensus_queue.cc:237] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:09.782377 9738 catalog_manager.cc:5649] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3). New cstate: current_term: 1 leader_uuid: "4473ec849b894f7b9407b5d1aa4e671b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } health_report { overall_health: HEALTHY } } }
I20251026 21:05:09.867228 9880 raft_consensus.cc:1275] T e1fbb7e92c0349bf879c8c9c4d4c1912 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Refusing update from remote peer 4473ec849b894f7b9407b5d1aa4e671b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251026 21:05:09.868486 10011 raft_consensus.cc:1275] T e1fbb7e92c0349bf879c8c9c4d4c1912 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Refusing update from remote peer 4473ec849b894f7b9407b5d1aa4e671b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251026 21:05:09.868709 10233 consensus_queue.cc:1048] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251026 21:05:09.869210 10010 raft_consensus.cc:1275] T 255a20e2532944eb8c49530b1d38f10e P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Refusing update from remote peer 4473ec849b894f7b9407b5d1aa4e671b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251026 21:05:09.870251 10223 consensus_queue.cc:1048] T e1fbb7e92c0349bf879c8c9c4d4c1912 P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251026 21:05:09.870379 10233 consensus_queue.cc:1048] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251026 21:05:09.871040 9880 raft_consensus.cc:1275] T 255a20e2532944eb8c49530b1d38f10e P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Refusing update from remote peer 4473ec849b894f7b9407b5d1aa4e671b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251026 21:05:09.874125 9880 raft_consensus.cc:1275] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Refusing update from remote peer ef7dd9d5893148e8a25ce01222bfd1aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251026 21:05:09.874130 10141 raft_consensus.cc:1275] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Refusing update from remote peer ef7dd9d5893148e8a25ce01222bfd1aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251026 21:05:09.874141 10233 consensus_queue.cc:1048] T 255a20e2532944eb8c49530b1d38f10e P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251026 21:05:09.874948 10220 consensus_queue.cc:1048] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251026 21:05:09.875236 10221 consensus_queue.cc:1048] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251026 21:05:09.889492 10140 raft_consensus.cc:1275] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Refusing update from remote peer e11e0a781c964fbab4e3d6e7fe89182c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251026 21:05:09.890023 10253 mvcc.cc:204] Tried to move back new op lower bound from 7215156059630157824 to 7215156058822631424. Current Snapshot: MvccSnapshot[applied={T|T < 7215156059630157824}]
I20251026 21:05:09.890246 10224 consensus_queue.cc:1048] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251026 21:05:09.896914 10009 raft_consensus.cc:1275] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Refusing update from remote peer e11e0a781c964fbab4e3d6e7fe89182c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251026 21:05:09.898016 10224 consensus_queue.cc:1048] T 1f7f814d7bc644e5befcbbdcb5f07ce0 P e11e0a781c964fbab4e3d6e7fe89182c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251026 21:05:09.912896 10257 mvcc.cc:204] Tried to move back new op lower bound from 7215156059685773312 to 7215156059059343360. Current Snapshot: MvccSnapshot[applied={T|T < 7215156059685773312 or (T in {7215156059685773312})}]
I20251026 21:05:09.939869 10252 mvcc.cc:204] Tried to move back new op lower bound from 7215156059630157824 to 7215156058822631424. Current Snapshot: MvccSnapshot[applied={T|T < 7215156059630157824}]
I20251026 21:05:12.684979 9739 master_service.cc:954] ReplaceTablet: received request to replace tablet 1c8a1258ed064cddaf9ce5901ebc14c9 from {username='slave'} at 127.0.0.1:36190
I20251026 21:05:12.736507 9739 catalog_manager.cc:5936] T 00000000000000000000000000000000 P ad72f82bb77a4d2cac109eb4cffc0050: Sending DeleteTablet for 3 replicas of tablet 1c8a1258ed064cddaf9ce5901ebc14c9
I20251026 21:05:12.737412 9739 catalog_manager.cc:6719] ReplaceTablet: tablet 1c8a1258ed064cddaf9ce5901ebc14c9 deleted and replaced by tablet 92a81eb6fb164ce2a8f62232282a8c70
I20251026 21:05:12.740532 10121 tablet_service.cc:1552] Processing DeleteTablet for tablet 1c8a1258ed064cddaf9ce5901ebc14c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 92a81eb6fb164ce2a8f62232282a8c70) from {username='slave'} at 127.0.0.1:43238
I20251026 21:05:12.740728 9990 tablet_service.cc:1552] Processing DeleteTablet for tablet 1c8a1258ed064cddaf9ce5901ebc14c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 92a81eb6fb164ce2a8f62232282a8c70) from {username='slave'} at 127.0.0.1:60112
I20251026 21:05:12.743990 9858 tablet_service.cc:1552] Processing DeleteTablet for tablet 1c8a1258ed064cddaf9ce5901ebc14c9 with delete_type TABLET_DATA_DELETED (replaced by tablet 92a81eb6fb164ce2a8f62232282a8c70) from {username='slave'} at 127.0.0.1:54492
I20251026 21:05:12.775877 10299 tablet_replica.cc:333] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: stopping tablet replica
I20251026 21:05:12.780999 10299 raft_consensus.cc:2243] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Raft consensus shutting down.
I20251026 21:05:12.781847 9857 tablet_service.cc:1505] Processing CreateTablet for tablet 92a81eb6fb164ce2a8f62232282a8c70 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
W20251026 21:05:12.782171 9947 consensus_peers.cc:597] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa -> Peer 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293): Couldn't send request to peer 4473ec849b894f7b9407b5d1aa4e671b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20251026 21:05:12.782266 9857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a81eb6fb164ce2a8f62232282a8c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:12.783233 10299 raft_consensus.cc:2272] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Raft consensus is shut down!
I20251026 21:05:12.783747 9989 tablet_service.cc:1505] Processing CreateTablet for tablet 92a81eb6fb164ce2a8f62232282a8c70 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251026 21:05:12.784165 9989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a81eb6fb164ce2a8f62232282a8c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:12.809886 10300 tablet_replica.cc:333] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: stopping tablet replica
I20251026 21:05:12.810441 10300 raft_consensus.cc:2243] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 LEADER]: Raft consensus shutting down.
I20251026 21:05:12.811167 10300 pending_rounds.cc:70] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Trying to abort 4 pending ops.
I20251026 21:05:12.811949 10300 pending_rounds.cc:77] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Aborting op as it isn't in flight: id { term: 1 index: 218 } timestamp: 7215156071595253760 op_type: WRITE_OP write_request { tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000K\204so\227\201\023\355\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000^z\216y\367\277kq\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\331\314\256z\2400\201\366 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000`\030\336t\215\016:\3060\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\251\371uw\216\001\235\003@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000sz\004a\272C\332\361P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\0006\207\202r\261}\267\325`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\311 \223r\017\216\007\271p\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000m\356\260\177\005\373~\373\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000P\333\217d\213\3407%\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\247V\315|\320\364\364r\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000=Qo\177^\177\364\371\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\0009\302\350x\3026\255\n\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000,>\014~\264\375\3708\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000.\351\232i\022\r\002^\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\245\305\215on\337\3309\360\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000;\304\232~\037W!\n\000\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000O\014\212h\330\264\211\370\020\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000I7\304c\237\026d4 \001\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""76a61a1825f6735fd3a97cf2b8943d8e84fcc1a1dc18a8d2e38737fa84d86245132b27846c5ea9e1b723ddf3a7817341f8b9e9caeb481563cf2b4362c2a9ff121eeb011fad2d95d08dc893bdd6b70a6076884e715dabf15e8e52f02bce2b7e72d98602fe5a5cfd92b3ec0c571c3c7cc58826fd266f6b9bf062ac97da624af5fdee2f94bd6b9c37f6348391d753b7aa602f93c1fc1b493f96" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7215156071503634432 authz_token { token_data: "\010\261\234\372\307\006\"3\n\005slave\022*\n 197ea08eb59f4710bcc66f52fbd80de5\020\001\030\001 \001(\001" signature: "<redacted>""\202\275\006\347q\237\335\325k\373*\301\344\212P\234\211\0059~\206a\t\375@\336S\023\222\"\256\324\rj:J]\226P\272M\362\312n\233Sl0\022?\310u\017$\371\354\017\261\004\277\301(\307I" signing_key_seq_num: 0 } } request_id { client_id: "e5e8583ea5474cd6af9f5deff5437407" seq_no: 867 first_incomplete_seq_no: 855 attempt_no: 0 }
W20251026 21:05:12.813120 10300 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60114: Aborted: Op aborted
I20251026 21:05:12.813642 10300 pending_rounds.cc:77] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Aborting op as it isn't in flight: id { term: 1 index: 217 } timestamp: 7215156071523139584 op_type: WRITE_OP write_request { tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\014nBe\276\030\322\253\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000&\205\240{\266\356N~\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\2123fy \27676 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000R\030:b\230\"\253\2430\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\347\370\024x\357@\010]@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\346\3268{\'\301\253\365P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\305\255\251}\271\277P\341`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000`\033\347~\235\315\265Fp\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\367/Tb\2155\2109\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\254\261\026h\000G\027\365\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\177\346\364n\350\024\210\035\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000Y90v\000\375U\300\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\004\301\344j\220\034|\234\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\245p.vy\007\267P\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\373\352\224`\034W\364S\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\207\214\262jL\306\317\\\360\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\211tA~\034=\';\000\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""f77df8b25ea5152863929ca6dcd512b810b77906fad544a0e4d98bfa8ce9fba05bc101e038c44eb853440a993027996124f3af78750a0477be239a81a6e997b35065d6531bb3d71cf5335c5afde8a9a54fd55710fe8e08c4495dcd01da7c4490a9b759df88daeb6466e1b581d8a6b9d7809ab3b5591860c4c1221a394bcf2987387c63eb5d07ec8b" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7215156071458852864 authz_token { token_data: "\010\261\234\372\307\006\"3\n\005slave\022*\n 197ea08eb59f4710bcc66f52fbd80de5\020\001\030\001 \001(\001" signature: "<redacted>""\202\275\006\347q\237\335\325k\373*\301\344\212P\234\211\0059~\206a\t\375@\336S\023\222\"\256\324\rj:J]\226P\272M\362\312n\233Sl0\022?\310u\017$\371\354\017\261\004\277\301(\307I" signing_key_seq_num: 0 } } request_id { client_id: "e5e8583ea5474cd6af9f5deff5437407" seq_no: 859 first_incomplete_seq_no: 854 attempt_no: 0 }
I20251026 21:05:12.815624 10304 tablet_bootstrap.cc:492] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c: Bootstrap starting.
I20251026 21:05:12.816560 10121 tablet_service.cc:1505] Processing CreateTablet for tablet 92a81eb6fb164ce2a8f62232282a8c70 (DEFAULT_TABLE table=test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251026 21:05:12.817011 10121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92a81eb6fb164ce2a8f62232282a8c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251026 21:05:12.817588 10304 tablet_bootstrap.cc:654] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:12.818946 10301 tablet_replica.cc:333] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: stopping tablet replica
I20251026 21:05:12.819366 10301 raft_consensus.cc:2243] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Raft consensus shutting down.
I20251026 21:05:12.819622 10301 pending_rounds.cc:70] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Trying to abort 4 pending ops.
I20251026 21:05:12.819739 10301 pending_rounds.cc:77] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Aborting op as it isn't in flight: id { term: 1 index: 218 } timestamp: 7215156071595253760 op_type: WRITE_OP write_request { tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000K\204so\227\201\023\355\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000^z\216y\367\277kq\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\331\314\256z\2400\201\366 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000`\030\336t\215\016:\3060\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\251\371uw\216\001\235\003@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000sz\004a\272C\332\361P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\0006\207\202r\261}\267\325`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\311 \223r\017\216\007\271p\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000m\356\260\177\005\373~\373\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000P\333\217d\213\3407%\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\247V\315|\320\364\364r\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000=Qo\177^\177\364\371\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\0009\302\350x\3026\255\n\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000,>\014~\264\375\3708\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000.\351\232i\022\r\002^\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\245\305\215on\337\3309\360\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000;\304\232~\037W!\n\000\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000O\014\212h\330\264\211\370\020\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000I7\304c\237\026d4 \001\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""76a61a1825f6735fd3a97cf2b8943d8e84fcc1a1dc18a8d2e38737fa84d86245132b27846c5ea9e1b723ddf3a7817341f8b9e9caeb481563cf2b4362c2a9ff121eeb011fad2d95d08dc893bdd6b70a6076884e715dabf15e8e52f02bce2b7e72d98602fe5a5cfd92b3ec0c571c3c7cc58826fd266f6b9bf062ac97da624af5fdee2f94bd6b9c37f6348391d753b7aa602f93c1fc1b493f96" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7215156071503634432 authz_token { token_data: "\010\261\234\372\307\006\"3\n\005slave\022*\n 197ea08eb59f4710bcc66f52fbd80de5\020\001\030\001 \001(\001" signature: "<redacted>""\202\275\006\347q\237\335\325k\373*\301\344\212P\234\211\0059~\206a\t\375@\336S\023\222\"\256\324\rj:J]\226P\272M\362\312n\233Sl0\022?\310u\017$\371\354\017\261\004\277\301(\307I" signing_key_seq_num: 0 } } request_id { client_id: "e5e8583ea5474cd6af9f5deff5437407" seq_no: 867 first_incomplete_seq_no: 855 attempt_no: 0 }
I20251026 21:05:12.820580 10301 pending_rounds.cc:77] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Aborting op as it isn't in flight: id { term: 1 index: 217 } timestamp: 7215156071523139584 op_type: WRITE_OP write_request { tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\014nBe\276\030\322\253\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000&\205\240{\266\356N~\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\2123fy \27676 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000R\030:b\230\"\253\2430\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\347\370\024x\357@\010]@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\346\3268{\'\301\253\365P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\305\255\251}\271\277P\341`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000`\033\347~\235\315\265Fp\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\367/Tb\2155\2109\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\254\261\026h\000G\027\365\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\177\346\364n\350\024\210\035\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000Y90v\000\375U\300\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\004\301\344j\220\034|\234\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\245p.vy\007\267P\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\373\352\224`\034W\364S\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\207\214\262jL\306\317\\\360\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\211tA~\034=\';\000\001\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""f77df8b25ea5152863929ca6dcd512b810b77906fad544a0e4d98bfa8ce9fba05bc101e038c44eb853440a993027996124f3af78750a0477be239a81a6e997b35065d6531bb3d71cf5335c5afde8a9a54fd55710fe8e08c4495dcd01da7c4490a9b759df88daeb6466e1b581d8a6b9d7809ab3b5591860c4c1221a394bcf2987387c63eb5d07ec8b" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7215156071458852864 authz_token { token_data: "\010\261\234\372\307\006\"3\n\005slave\022*\n 197ea08eb59f4710bcc66f52fbd80de5\020\001\030\001 \001(\001" signature: "<redacted>""\202\275\006\347q\237\335\325k\373*\301\344\212P\234\211\0059~\206a\t\375@\336S\023\222\"\256\324\rj:J]\226P\272M\362\312n\233Sl0\022?\310u\017$\371\354\017\261\004\277\301(\307I" signing_key_seq_num: 0 } } request_id { client_id: "e5e8583ea5474cd6af9f5deff5437407" seq_no: 859 first_incomplete_seq_no: 854 attempt_no: 0 }
I20251026 21:05:12.821062 10301 pending_rounds.cc:77] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Aborting op as it isn't in flight: id { term: 1 index: 216 } timestamp: 7215156071511584768 op_type: WRITE_OP write_request { tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000C?\245p \354\270\234\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000/\307\016j\260\203G0\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000x\275\225oa\007\342\351 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\342\177\302mv\233o\3720\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\216r\332s\2208\213@@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\"\3139o\376\372\320\345P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000DL\232p^\3630\206`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\354\204\357jy\204\362\332p\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""eb0e5d0477f98f62a1514b78c063ca64163c31f193e5e2e4b8847a3e82eb74854f5f268edfb8baaf6833cc25c13f8d2a5e4e714d5fe10b8c74b753e75fcafb75" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7215156071373099008 authz_token { token_data: "\010\261\234\372\307\006\"3\n\005slave\022*\n 197ea08eb59f4710bcc66f52fbd80de5\020\001\030\001 \001(\001" signature: "<redacted>""\202\275\006\347q\237\335\325k\373*\301\344\212P\234\211\0059~\206a\t\375@\336S\023\222\"\256\324\rj:J]\226P\272M\362\312n\233Sl0\022?\310u\017$\371\354\017\261\004\277\301(\307I" signing_key_seq_num: 0 } } request_id { client_id: "e5e8583ea5474cd6af9f5deff5437407" seq_no: 858 first_incomplete_seq_no: 854 attempt_no: 0 }
I20251026 21:05:12.821485 10301 pending_rounds.cc:77] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Aborting op as it isn't in flight: id { term: 1 index: 215 } timestamp: 7215156071493496832 op_type: WRITE_OP write_request { tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\014D\336d\331a\365\177\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000A\025e`<\264\375\006\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\310\352\324a\246\260\260\246 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000?Ccpl\026!\0000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\r\0055e\035\267<\340@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\r\320ke2\007\327/P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\3579%f\203Le\203`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""bd338e57878c63f1bd5fd7323e526631821b5fc9a65b4e0e4e4376ed5e6991d7e4c5ce81ecf155adb593063f8efe9ccea5d386e7c47bb7d6" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7215156071458852864 authz_token { token_data: "\010\261\234\372\307\006\"3\n\005slave\022*\n 197ea08eb59f4710bcc66f52fbd80de5\020\001\030\001 \001(\001" signature: "<redacted>""\202\275\006\347q\237\335\325k\373*\301\344\212P\234\211\0059~\206a\t\375@\336S\023\222\"\256\324\rj:J]\226P\272M\362\312n\233Sl0\022?\310u\017$\371\354\017\261\004\277\301(\307I" signing_key_seq_num: 0 } } request_id { client_id: "e5e8583ea5474cd6af9f5deff5437407" seq_no: 855 first_incomplete_seq_no: 852 attempt_no: 0 }
I20251026 21:05:12.821825 10301 raft_consensus.cc:2272] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Raft consensus is shut down!
I20251026 21:05:12.822553 10306 tablet_bootstrap.cc:492] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b: Bootstrap starting.
I20251026 21:05:12.823222 10299 ts_tablet_manager.cc:1916] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251026 21:05:12.824151 10306 tablet_bootstrap.cc:654] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:12.826432 10306 tablet_bootstrap.cc:492] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b: No bootstrap required, opened a new log
I20251026 21:05:12.826608 10306 ts_tablet_manager.cc:1403] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
W20251026 21:05:12.827363 10300 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60114: Aborted: Op aborted
I20251026 21:05:12.827332 10306 raft_consensus.cc:359] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.827472 10306 raft_consensus.cc:385] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:12.827551 10306 raft_consensus.cc:740] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4473ec849b894f7b9407b5d1aa4e671b, State: Initialized, Role: FOLLOWER
I20251026 21:05:12.814752 10303 tablet_bootstrap.cc:492] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa: Bootstrap starting.
I20251026 21:05:12.827754 10306 consensus_queue.cc:260] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.828323 10306 ts_tablet_manager.cc:1434] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251026 21:05:12.830099 10303 tablet_bootstrap.cc:654] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa: Neither blocks nor log segments found. Creating new log.
I20251026 21:05:12.831553 10300 pending_rounds.cc:77] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Aborting op as it isn't in flight: id { term: 1 index: 216 } timestamp: 7215156071511584768 op_type: WRITE_OP write_request { tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000C?\245p \354\270\234\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000/\307\016j\260\203G0\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000x\275\225oa\007\342\351 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\342\177\302mv\233o\3720\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\216r\332s\2208\213@@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\"\3139o\376\372\320\345P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000DL\232p^\3630\206`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\354\204\357jy\204\362\332p\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""eb0e5d0477f98f62a1514b78c063ca64163c31f193e5e2e4b8847a3e82eb74854f5f268edfb8baaf6833cc25c13f8d2a5e4e714d5fe10b8c74b753e75fcafb75" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7215156071373099008 authz_token { token_data: "\010\261\234\372\307\006\"3\n\005slave\022*\n 197ea08eb59f4710bcc66f52fbd80de5\020\001\030\001 \001(\001" signature: "<redacted>""\202\275\006\347q\237\335\325k\373*\301\344\212P\234\211\0059~\206a\t\375@\336S\023\222\"\256\324\rj:J]\226P\272M\362\312n\233Sl0\022?\310u\017$\371\354\017\261\004\277\301(\307I" signing_key_seq_num: 0 } } request_id { client_id: "e5e8583ea5474cd6af9f5deff5437407" seq_no: 858 first_incomplete_seq_no: 854 attempt_no: 0 }
I20251026 21:05:12.833580 10301 ts_tablet_manager.cc:1916] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251026 21:05:12.833868 10300 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60114: Aborted: Op aborted
I20251026 21:05:12.834218 10300 pending_rounds.cc:77] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Aborting op as it isn't in flight: id { term: 1 index: 215 } timestamp: 7215156071493496832 op_type: WRITE_OP write_request { tablet_id: "1c8a1258ed064cddaf9ce5901ebc14c9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\014D\336d\331a\365\177\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000A\025e`<\264\375\006\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\310\352\324a\246\260\260\246 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000?Ccpl\026!\0000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\r\0055e\035\267<\340@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\r\320ke2\007\327/P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\3579%f\203Le\203`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""bd338e57878c63f1bd5fd7323e526631821b5fc9a65b4e0e4e4376ed5e6991d7e4c5ce81ecf155adb593063f8efe9ccea5d386e7c47bb7d6" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7215156071458852864 authz_token { token_data: "\010\261\234\372\307\006\"3\n\005slave\022*\n 197ea08eb59f4710bcc66f52fbd80de5\020\001\030\001 \001(\001" signature: "<redacted>""\202\275\006\347q\237\335\325k\373*\301\344\212P\234\211\0059~\206a\t\375@\336S\023\222\"\256\324\rj:J]\226P\272M\362\312n\233Sl0\022?\310u\017$\371\354\017\261\004\277\301(\307I" signing_key_seq_num: 0 } } request_id { client_id: "e5e8583ea5474cd6af9f5deff5437407" seq_no: 855 first_incomplete_seq_no: 852 attempt_no: 0 }
W20251026 21:05:12.834689 10300 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:60114: Aborted: Op aborted
I20251026 21:05:12.835076 10300 raft_consensus.cc:2272] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20251026 21:05:12.836396 10304 tablet_bootstrap.cc:492] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c: No bootstrap required, opened a new log
I20251026 21:05:12.836578 10304 ts_tablet_manager.cc:1403] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.000s
I20251026 21:05:12.837374 10304 raft_consensus.cc:359] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.837625 10304 raft_consensus.cc:385] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:12.837764 10304 raft_consensus.cc:740] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e11e0a781c964fbab4e3d6e7fe89182c, State: Initialized, Role: FOLLOWER
I20251026 21:05:12.838057 10304 consensus_queue.cc:260] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.839761 10304 ts_tablet_manager.cc:1434] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251026 21:05:12.843431 10300 ts_tablet_manager.cc:1916] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251026 21:05:12.844336 10303 tablet_bootstrap.cc:492] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa: No bootstrap required, opened a new log
I20251026 21:05:12.844519 10303 ts_tablet_manager.cc:1403] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s
I20251026 21:05:12.845683 10303 raft_consensus.cc:359] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.846784 10303 raft_consensus.cc:385] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251026 21:05:12.846927 10303 raft_consensus.cc:740] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7dd9d5893148e8a25ce01222bfd1aa, State: Initialized, Role: FOLLOWER
I20251026 21:05:12.846982 9736 master_service.cc:954] ReplaceTablet: received request to replace tablet 1c8a1258ed064cddaf9ce5901ebc14c9 from {username='slave'} at 127.0.0.1:36190
I20251026 21:05:12.847208 10303 consensus_queue.cc:260] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.847676 10303 ts_tablet_manager.cc:1434] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/replace_tablet-itest.cc:133: Failure
Failed
Bad status: Not found: Tablet 1c8a1258ed064cddaf9ce5901ebc14c9 already deleted
I20251026 21:05:12.849048 10299 ts_tablet_manager.cc:1929] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.214
I20251026 21:05:12.851614 10299 log.cc:1199] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: Deleting WAL directory at /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-2/wal/wals/1c8a1258ed064cddaf9ce5901ebc14c9
I20251026 21:05:12.852108 10301 ts_tablet_manager.cc:1929] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.218
I20251026 21:05:12.852238 10299 ts_tablet_manager.cc:1950] T 1c8a1258ed064cddaf9ce5901ebc14c9 P 4473ec849b894f7b9407b5d1aa4e671b: Deleting consensus metadata
I20251026 21:05:12.852348 10301 log.cc:1199] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Deleting WAL directory at /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-0/wal/wals/1c8a1258ed064cddaf9ce5901ebc14c9
I20251026 21:05:12.852905 10301 ts_tablet_manager.cc:1950] T 1c8a1258ed064cddaf9ce5901ebc14c9 P e11e0a781c964fbab4e3d6e7fe89182c: Deleting consensus metadata
I20251026 21:05:12.853906 9726 catalog_manager.cc:4985] TS 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3:37293): tablet 1c8a1258ed064cddaf9ce5901ebc14c9 (table test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]) successfully deleted
I20251026 21:05:12.854532 9723 catalog_manager.cc:4985] TS e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253): tablet 1c8a1258ed064cddaf9ce5901ebc14c9 (table test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]) successfully deleted
I20251026 21:05:12.858749 10300 ts_tablet_manager.cc:1929] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.218
I20251026 21:05:12.858927 10300 log.cc:1199] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Deleting WAL directory at /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0/minicluster-data/ts-1/wal/wals/1c8a1258ed064cddaf9ce5901ebc14c9
I20251026 21:05:12.859428 10300 ts_tablet_manager.cc:1950] T 1c8a1258ed064cddaf9ce5901ebc14c9 P ef7dd9d5893148e8a25ce01222bfd1aa: Deleting consensus metadata
I20251026 21:05:12.861027 9723 catalog_manager.cc:4985] TS ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969): tablet 1c8a1258ed064cddaf9ce5901ebc14c9 (table test-workload [id=197ea08eb59f4710bcc66f52fbd80de5]) successfully deleted
I20251026 21:05:12.967170 10256 raft_consensus.cc:493] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251026 21:05:12.967383 10256 raft_consensus.cc:515] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.968087 10256 leader_election.cc:290] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253), ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969)
I20251026 21:05:12.968623 9877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92a81eb6fb164ce2a8f62232282a8c70" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" is_pre_election: true
I20251026 21:05:12.968662 10009 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92a81eb6fb164ce2a8f62232282a8c70" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" is_pre_election: true
I20251026 21:05:12.968876 10009 raft_consensus.cc:2468] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 0.
I20251026 21:05:12.968868 9877 raft_consensus.cc:2468] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 0.
I20251026 21:05:12.969326 10074 leader_election.cc:304] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4473ec849b894f7b9407b5d1aa4e671b, ef7dd9d5893148e8a25ce01222bfd1aa; no voters:
I20251026 21:05:12.969573 10256 raft_consensus.cc:2804] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251026 21:05:12.969686 10256 raft_consensus.cc:493] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251026 21:05:12.969789 10256 raft_consensus.cc:3060] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:12.971648 10256 raft_consensus.cc:515] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.972126 10256 leader_election.cc:290] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 election: Requested vote from peers e11e0a781c964fbab4e3d6e7fe89182c (127.9.121.1:37253), ef7dd9d5893148e8a25ce01222bfd1aa (127.9.121.2:39969)
I20251026 21:05:12.972541 9877 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92a81eb6fb164ce2a8f62232282a8c70" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e11e0a781c964fbab4e3d6e7fe89182c"
I20251026 21:05:12.972637 10009 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "92a81eb6fb164ce2a8f62232282a8c70" candidate_uuid: "4473ec849b894f7b9407b5d1aa4e671b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa"
I20251026 21:05:12.972712 9877 raft_consensus.cc:3060] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:12.972865 10009 raft_consensus.cc:3060] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa [term 0 FOLLOWER]: Advancing to term 1
I20251026 21:05:12.974582 9877 raft_consensus.cc:2468] T 92a81eb6fb164ce2a8f62232282a8c70 P e11e0a781c964fbab4e3d6e7fe89182c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 1.
I20251026 21:05:12.974721 10009 raft_consensus.cc:2468] T 92a81eb6fb164ce2a8f62232282a8c70 P ef7dd9d5893148e8a25ce01222bfd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4473ec849b894f7b9407b5d1aa4e671b in term 1.
I20251026 21:05:12.975054 10074 leader_election.cc:304] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4473ec849b894f7b9407b5d1aa4e671b, e11e0a781c964fbab4e3d6e7fe89182c; no voters:
I20251026 21:05:12.975375 10256 raft_consensus.cc:2804] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 FOLLOWER]: Leader election won for term 1
I20251026 21:05:12.975528 10256 raft_consensus.cc:697] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [term 1 LEADER]: Becoming Leader. State: Replica: 4473ec849b894f7b9407b5d1aa4e671b, State: Running, Role: LEADER
I20251026 21:05:12.975800 10256 consensus_queue.cc:237] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } }
I20251026 21:05:12.978377 9736 catalog_manager.cc:5649] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4473ec849b894f7b9407b5d1aa4e671b (127.9.121.3). New cstate: current_term: 1 leader_uuid: "4473ec849b894f7b9407b5d1aa4e671b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4473ec849b894f7b9407b5d1aa4e671b" member_type: VOTER last_known_addr { host: "127.9.121.3" port: 37293 } health_report { overall_health: HEALTHY } } }
I20251026 21:05:12.982285 10200 meta_cache.cc:557] tablet seems to be replaced: former ID 1c8a1258ed064cddaf9ce5901ebc14c9, new ID 92a81eb6fb164ce2a8f62232282a8c70 (table test-workload)
W20251026 21:05:12.982460 10200 batcher.cc:441] Invalid argument: Failed to write batch of 17 ops to tablet 1c8a1258ed064cddaf9ce5901ebc14c9 after 3 attempt(s): tablet ID 1c8a1258ed064cddaf9ce5901ebc14c9 is not valid
I20251026 21:05:12.983088 10200 meta_cache.cc:557] tablet seems to be replaced: former ID 1c8a1258ed064cddaf9ce5901ebc14c9, new ID 92a81eb6fb164ce2a8f62232282a8c70 (table test-workload)
I20251026 21:05:12.994839 10200 meta_cache.cc:557] tablet seems to be replaced: former ID 1c8a1258ed064cddaf9ce5901ebc14c9, new ID 92a81eb6fb164ce2a8f62232282a8c70 (table test-workload)
I20251026 21:05:12.997285 10200 meta_cache.cc:557] tablet seems to be replaced: former ID 1c8a1258ed064cddaf9ce5901ebc14c9, new ID 92a81eb6fb164ce2a8f62232282a8c70 (table test-workload)
I20251026 21:05:12.999723 9700 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20251026 21:05:12.999902 9700 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID e11e0a781c964fbab4e3d6e7fe89182c and pid 9798
************************ BEGIN STACKS **************************
[New LWP 9799]
[New LWP 9800]
[New LWP 9801]
[New LWP 9802]
[New LWP 9808]
[New LWP 9809]
[New LWP 9810]
[New LWP 9813]
[New LWP 9814]
[New LWP 9815]
[New LWP 9816]
[New LWP 9817]
[New LWP 9818]
[New LWP 9819]
[New LWP 9820]
[New LWP 9821]
[New LWP 9822]
[New LWP 9823]
[New LWP 9824]
[New LWP 9825]
[New LWP 9826]
[New LWP 9827]
[New LWP 9828]
[New LWP 9829]
[New LWP 9830]
[New LWP 9831]
[New LWP 9832]
[New LWP 9833]
[New LWP 9834]
[New LWP 9835]
[New LWP 9836]
[New LWP 9837]
[New LWP 9838]
[New LWP 9839]
[New LWP 9840]
[New LWP 9841]
[New LWP 9842]
[New LWP 9843]
[New LWP 9844]
[New LWP 9845]
[New LWP 9846]
[New LWP 9847]
[New LWP 9848]
[New LWP 9849]
[New LWP 9850]
[New LWP 9851]
[New LWP 9852]
[New LWP 9853]
[New LWP 9854]
[New LWP 9855]
[New LWP 9856]
[New LWP 9857]
[New LWP 9858]
[New LWP 9859]
[New LWP 9860]
[New LWP 9861]
[New LWP 9862]
[New LWP 9863]
[New LWP 9864]
[New LWP 9865]
[New LWP 9866]
[New LWP 9867]
[New LWP 9868]
[New LWP 9869]
[New LWP 9870]
[New LWP 9871]
[New LWP 9872]
[New LWP 9873]
[New LWP 9874]
[New LWP 9875]
[New LWP 9876]
[New LWP 9877]
[New LWP 9878]
[New LWP 9879]
[New LWP 9880]
[New LWP 9881]
[New LWP 9882]
[New LWP 9883]
[New LWP 9884]
[New LWP 9885]
[New LWP 9886]
[New LWP 9887]
[New LWP 9888]
[New LWP 9889]
[New LWP 9890]
[New LWP 9891]
[New LWP 9892]
[New LWP 9893]
[New LWP 9894]
[New LWP 9895]
[New LWP 9896]
[New LWP 9897]
[New LWP 9898]
[New LWP 9899]
[New LWP 9900]
[New LWP 9901]
[New LWP 9902]
[New LWP 9903]
[New LWP 9904]
[New LWP 9905]
[New LWP 9906]
[New LWP 9907]
[New LWP 9908]
[New LWP 9909]
[New LWP 9910]
[New LWP 9911]
[New LWP 9912]
[New LWP 9913]
[New LWP 9914]
[New LWP 9915]
[New LWP 9916]
[New LWP 9917]
[New LWP 9918]
[New LWP 9919]
[New LWP 9920]
[New LWP 9921]
[New LWP 9922]
[New LWP 9923]
[New LWP 9924]
[New LWP 9925]
[New LWP 9926]
[New LWP 10241]
[New LWP 10242]
[New LWP 10263]
[New LWP 10271]
I20251026 21:05:13.501006 10256 consensus_queue.cc:1048] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7dd9d5893148e8a25ce01222bfd1aa" member_type: VOTER last_known_addr { host: "127.9.121.2" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f31
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f31
0x00007fe23bed0d50 in ?? ()
Id Target Id Frame
* 1 LWP 9798 "kudu" 0x00007fe23bed0d50 in ?? ()
2 LWP 9799 "kudu" 0x00007fe23beccfb9 in ?? ()
3 LWP 9800 "kudu" 0x00007fe23beccfb9 in ?? ()
4 LWP 9801 "kudu" 0x00007fe23beccfb9 in ?? ()
5 LWP 9802 "kernel-watcher-" 0x00007fe23beccfb9 in ?? ()
6 LWP 9808 "ntp client-9808" 0x00007fe23bed09e2 in ?? ()
7 LWP 9809 "file cache-evic" 0x00007fe23beccfb9 in ?? ()
8 LWP 9810 "sq_acceptor" 0x00007fe2349eecb9 in ?? ()
9 LWP 9813 "rpc reactor-981" 0x00007fe2349fba47 in ?? ()
10 LWP 9814 "rpc reactor-981" 0x00007fe2349fba47 in ?? ()
11 LWP 9815 "rpc reactor-981" 0x00007fe2349fba47 in ?? ()
12 LWP 9816 "rpc reactor-981" 0x00007fe2349fba47 in ?? ()
13 LWP 9817 "MaintenanceMgr " 0x00007fe23beccad3 in ?? ()
14 LWP 9818 "txn-status-mana" 0x00007fe23beccfb9 in ?? ()
15 LWP 9819 "collect_and_rem" 0x00007fe23beccfb9 in ?? ()
16 LWP 9820 "tc-session-exp-" 0x00007fe23beccfb9 in ?? ()
17 LWP 9821 "rpc worker-9821" 0x00007fe23beccad3 in ?? ()
18 LWP 9822 "rpc worker-9822" 0x00007fe23beccad3 in ?? ()
19 LWP 9823 "rpc worker-9823" 0x00007fe23beccad3 in ?? ()
20 LWP 9824 "rpc worker-9824" 0x00007fe23beccad3 in ?? ()
21 LWP 9825 "rpc worker-9825" 0x00007fe23beccad3 in ?? ()
22 LWP 9826 "rpc worker-9826" 0x00007fe23beccad3 in ?? ()
23 LWP 9827 "rpc worker-9827" 0x00007fe23beccad3 in ?? ()
24 LWP 9828 "rpc worker-9828" 0x00007fe23beccad3 in ?? ()
25 LWP 9829 "rpc worker-9829" 0x00007fe23beccad3 in ?? ()
26 LWP 9830 "rpc worker-9830" 0x00007fe23beccad3 in ?? ()
27 LWP 9831 "rpc worker-9831" 0x00007fe23beccad3 in ?? ()
28 LWP 9832 "rpc worker-9832" 0x00007fe23beccad3 in ?? ()
29 LWP 9833 "rpc worker-9833" 0x00007fe23beccad3 in ?? ()
30 LWP 9834 "rpc worker-9834" 0x00007fe23beccad3 in ?? ()
31 LWP 9835 "rpc worker-9835" 0x00007fe23beccad3 in ?? ()
32 LWP 9836 "rpc worker-9836" 0x00007fe23beccad3 in ?? ()
33 LWP 9837 "rpc worker-9837" 0x00007fe23beccad3 in ?? ()
34 LWP 9838 "rpc worker-9838" 0x00007fe23beccad3 in ?? ()
35 LWP 9839 "rpc worker-9839" 0x00007fe23beccad3 in ?? ()
36 LWP 9840 "rpc worker-9840" 0x00007fe23beccad3 in ?? ()
37 LWP 9841 "rpc worker-9841" 0x00007fe23beccad3 in ?? ()
38 LWP 9842 "rpc worker-9842" 0x00007fe23beccad3 in ?? ()
39 LWP 9843 "rpc worker-9843" 0x00007fe23beccad3 in ?? ()
40 LWP 9844 "rpc worker-9844" 0x00007fe23beccad3 in ?? ()
41 LWP 9845 "rpc worker-9845" 0x00007fe23beccad3 in ?? ()
42 LWP 9846 "rpc worker-9846" 0x00007fe23beccad3 in ?? ()
43 LWP 9847 "rpc worker-9847" 0x00007fe23beccad3 in ?? ()
44 LWP 9848 "rpc worker-9848" 0x00007fe23beccad3 in ?? ()
45 LWP 9849 "rpc worker-9849" 0x00007fe23beccad3 in ?? ()
46 LWP 9850 "rpc worker-9850" 0x00007fe23beccad3 in ?? ()
47 LWP 9851 "rpc worker-9851" 0x00007fe23beccad3 in ?? ()
48 LWP 9852 "rpc worker-9852" 0x00007fe23beccad3 in ?? ()
49 LWP 9853 "rpc worker-9853" 0x00007fe23beccad3 in ?? ()
50 LWP 9854 "rpc worker-9854" 0x00007fe23beccad3 in ?? ()
51 LWP 9855 "rpc worker-9855" 0x00007fe23beccad3 in ?? ()
52 LWP 9856 "rpc worker-9856" 0x00007fe23beccad3 in ?? ()
53 LWP 9857 "rpc worker-9857" 0x00007fe23beccad3 in ?? ()
54 LWP 9858 "rpc worker-9858" 0x00007fe23beccad3 in ?? ()
55 LWP 9859 "rpc worker-9859" 0x00007fe23beccad3 in ?? ()
56 LWP 9860 "rpc worker-9860" 0x00007fe23beccad3 in ?? ()
57 LWP 9861 "rpc worker-9861" 0x00007fe23beccad3 in ?? ()
58 LWP 9862 "rpc worker-9862" 0x00007fe23beccad3 in ?? ()
59 LWP 9863 "rpc worker-9863" 0x00007fe23beccad3 in ?? ()
60 LWP 9864 "rpc worker-9864" 0x00007fe23beccad3 in ?? ()
61 LWP 9865 "rpc worker-9865" 0x00007fe23beccad3 in ?? ()
62 LWP 9866 "rpc worker-9866" 0x00007fe23beccad3 in ?? ()
63 LWP 9867 "rpc worker-9867" 0x00007fe23beccad3 in ?? ()
64 LWP 9868 "rpc worker-9868" 0x00007fe23beccad3 in ?? ()
65 LWP 9869 "rpc worker-9869" 0x00007fe23beccad3 in ?? ()
66 LWP 9870 "rpc worker-9870" 0x00007fe23beccad3 in ?? ()
67 LWP 9871 "rpc worker-9871" 0x00007fe23beccad3 in ?? ()
68 LWP 9872 "rpc worker-9872" 0x00007fe23beccad3 in ?? ()
69 LWP 9873 "rpc worker-9873" 0x00007fe23beccad3 in ?? ()
70 LWP 9874 "rpc worker-9874" 0x00007fe23beccad3 in ?? ()
71 LWP 9875 "rpc worker-9875" 0x00007fe23beccad3 in ?? ()
72 LWP 9876 "rpc worker-9876" 0x00007fe23beccad3 in ?? ()
73 LWP 9877 "rpc worker-9877" 0x00007fe23beccad3 in ?? ()
74 LWP 9878 "rpc worker-9878" 0x00007fe23beccad3 in ?? ()
75 LWP 9879 "rpc worker-9879" 0x00007fe23beccad3 in ?? ()
76 LWP 9880 "rpc worker-9880" 0x00007fe23beccad3 in ?? ()
77 LWP 9881 "rpc worker-9881" 0x00007fe23beccad3 in ?? ()
78 LWP 9882 "rpc worker-9882" 0x00007fe23beccad3 in ?? ()
79 LWP 9883 "rpc worker-9883" 0x00007fe23beccad3 in ?? ()
80 LWP 9884 "rpc worker-9884" 0x00007fe23beccad3 in ?? ()
81 LWP 9885 "rpc worker-9885" 0x00007fe23beccad3 in ?? ()
82 LWP 9886 "rpc worker-9886" 0x00007fe23beccad3 in ?? ()
83 LWP 9887 "rpc worker-9887" 0x00007fe23beccad3 in ?? ()
84 LWP 9888 "rpc worker-9888" 0x00007fe23beccad3 in ?? ()
85 LWP 9889 "rpc worker-9889" 0x00007fe23beccad3 in ?? ()
86 LWP 9890 "rpc worker-9890" 0x00007fe23beccad3 in ?? ()
87 LWP 9891 "rpc worker-9891" 0x00007fe23beccad3 in ?? ()
88 LWP 9892 "rpc worker-9892" 0x00007fe23beccad3 in ?? ()
89 LWP 9893 "rpc worker-9893" 0x00007fe23beccad3 in ?? ()
90 LWP 9894 "rpc worker-9894" 0x00007fe23beccad3 in ?? ()
91 LWP 9895 "rpc worker-9895" 0x00007fe23beccad3 in ?? ()
92 LWP 9896 "rpc worker-9896" 0x00007fe23beccad3 in ?? ()
93 LWP 9897 "rpc worker-9897" 0x00007fe23beccad3 in ?? ()
94 LWP 9898 "rpc worker-9898" 0x00007fe23beccad3 in ?? ()
95 LWP 9899 "rpc worker-9899" 0x00007fe23beccad3 in ?? ()
96 LWP 9900 "rpc worker-9900" 0x00007fe23beccad3 in ?? ()
97 LWP 9901 "rpc worker-9901" 0x00007fe23beccad3 in ?? ()
98 LWP 9902 "rpc worker-9902" 0x00007fe23beccad3 in ?? ()
99 LWP 9903 "rpc worker-9903" 0x00007fe23beccad3 in ?? ()
100 LWP 9904 "rpc worker-9904" 0x00007fe23beccad3 in ?? ()
101 LWP 9905 "rpc worker-9905" 0x00007fe23beccad3 in ?? ()
102 LWP 9906 "rpc worker-9906" 0x00007fe23beccad3 in ?? ()
103 LWP 9907 "rpc worker-9907" 0x00007fe23beccad3 in ?? ()
104 LWP 9908 "rpc worker-9908" 0x00007fe23beccad3 in ?? ()
105 LWP 9909 "rpc worker-9909" 0x00007fe23beccad3 in ?? ()
106 LWP 9910 "rpc worker-9910" 0x00007fe23beccad3 in ?? ()
107 LWP 9911 "rpc worker-9911" 0x00007fe23beccad3 in ?? ()
108 LWP 9912 "rpc worker-9912" 0x00007fe23beccad3 in ?? ()
109 LWP 9913 "rpc worker-9913" 0x00007fe23beccad3 in ?? ()
110 LWP 9914 "rpc worker-9914" 0x00007fe23beccad3 in ?? ()
111 LWP 9915 "rpc worker-9915" 0x00007fe23beccad3 in ?? ()
112 LWP 9916 "rpc worker-9916" 0x00007fe23beccad3 in ?? ()
113 LWP 9917 "rpc worker-9917" 0x00007fe23beccad3 in ?? ()
114 LWP 9918 "rpc worker-9918" 0x00007fe23beccad3 in ?? ()
115 LWP 9919 "rpc worker-9919" 0x00007fe23beccad3 in ?? ()
116 LWP 9920 "rpc worker-9920" 0x00007fe23beccad3 in ?? ()
117 LWP 9921 "diag-logger-992" 0x00007fe23beccfb9 in ?? ()
118 LWP 9922 "result-tracker-" 0x00007fe23beccfb9 in ?? ()
119 LWP 9923 "excess-log-dele" 0x00007fe23beccfb9 in ?? ()
120 LWP 9924 "acceptor-9924" 0x00007fe2349fd0c7 in ?? ()
121 LWP 9925 "heartbeat-9925" 0x00007fe23beccfb9 in ?? ()
122 LWP 9926 "maintenance_sch" 0x00007fe23beccfb9 in ?? ()
123 LWP 10241 "raft [worker]-1" 0x00007fe23beccfb9 in ?? ()
124 LWP 10242 "wal-append [wor" 0x00007fe23beccfb9 in ?? ()
125 LWP 10263 "wal-append [wor" 0x00007fe23beccfb9 in ?? ()
126 LWP 10271 "wal-append [wor" 0x00007fe23beccfb9 in ?? ()
Thread 126 (LWP 10271):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00006020001b6158 in ?? ()
#2 0x0000000000000121 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a0000529b4 in ?? ()
#5 0x00007fe1e7a91130 in ?? ()
#6 0x0000000000000243 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fe1e7a91150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 125 (LWP 10263):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x000060200017ce98 in ?? ()
#2 0x000000000000011b in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a000051db4 in ?? ()
#5 0x00007fe1e92d7130 in ?? ()
#6 0x0000000000000237 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fe1e92d7150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 124 (LWP 10242):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00006020001aa758 in ?? ()
#2 0x0000000000000199 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a00004ffb4 in ?? ()
#5 0x00007fe1ebb46130 in ?? ()
#6 0x0000000000000333 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fe1ebb46150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 123 (LWP 10241):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x000000000000017c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007fe1ec35ebc0 in ?? ()
#5 0x00007fe1ec35e850 in ?? ()
#6 0x00000000000002f8 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 122 (LWP 9926):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00007fe1f0d2a700 in ?? ()
#2 0x0000000000000014 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007fe1f0d2a750 in ?? ()
#6 0x0000000000000028 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 9925):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x9e33ba35ca9a2782 in ?? ()
#2 0x000000000000000b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019240 in ?? ()
#5 0x00007fe1f1542610 in ?? ()
#6 0x0000000000000016 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 9924):
#0 0x00007fe2349fd0c7 in ?? ()
#1 0x0000614000041aa8 in ?? ()
#2 0x00007fe1f1d69d70 in ?? ()
#3 0x00007fe1f1d69da0 in ?? ()
#4 0x00007fe1f1d69ea0 in ?? ()
#5 0x00007fe1f1d69d90 in ?? ()
#6 0x00007fe1f1d69e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c323b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007fe1f1d69f20 in ?? ()
#11 0x00007fe1f1d6965c in ?? ()
#12 0x00000032f1d695d0 in ?? ()
#13 0x00007fe1f156d000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 9923):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00007fe1f2583f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 9922):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00007fe1f2d9c120 in ?? ()
#2 0x0000000000000005 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008a930 in ?? ()
#5 0x00007fe1f2d9c110 in ?? ()
#6 0x000000000000000a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 9921):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 9920):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 9919):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 9918):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 9917):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 9916):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 9915):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 9914):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 9913):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 9912):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 9911):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 9910):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 9909):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 9908):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 9907):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 9906):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 9905):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 9904):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 9903):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 9902):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 9901):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 9900):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 9899):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 9898):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 9897):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 9896):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 9895):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 9894):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 9893):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 9892):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 9891):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 9890):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 9889):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 9888):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 9887):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 9886):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 9885):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 9884):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 9883):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 9882):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 9881):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 9880):
#0 0x00007fe23beccad3 in ?? ()
#1 0x000000000000009e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007fe20819ceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe20819ced0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 9879):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000007 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007fe2089b4eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe2089b4ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007fe23becc770 in ?? ()
#10 0x00007fe2089b4ed0 in ?? ()
#11 0x00000ffc411369dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 9878):
#0 0x00007fe23beccad3 in ?? ()
#1 0x00000000000000d0 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001967c8 in ?? ()
#4 0x00007fe2091cceb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe2091cced0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 9877):
#0 0x00007fe23beccad3 in ?? ()
#1 0x00000000000000bd in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00018ffcc in ?? ()
#4 0x00007fe2099e4eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe2099e4ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00018ff80 in ?? ()
#9 0x00007fe23becc770 in ?? ()
#10 0x00007fe2099e4ed0 in ?? ()
#11 0x00000ffc4133c9dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 72 (LWP 9876):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 9875):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 9874):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 9873):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 9872):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 9871):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 9870):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 9869):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 9868):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 9867):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 9866):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 9865):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 9864):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 9863):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 9862):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 9861):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 9860):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007fe21237deb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe21237ded0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007fe23becc770 in ?? ()
#10 0x00007fe21237ded0 in ?? ()
#11 0x00000ffc4246fbdc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 9859):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011d04c in ?? ()
#4 0x00007fe212b95eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe212b95ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011d000 in ?? ()
#9 0x00007fe23becc770 in ?? ()
#10 0x00007fe212b95ed0 in ?? ()
#11 0x00000ffc42572bdc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 54 (LWP 9858):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000116848 in ?? ()
#4 0x00007fe2133adeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe2133aded0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 53 (LWP 9857):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000110048 in ?? ()
#4 0x00007fe213bc5eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe213bc5ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 52 (LWP 9856):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 9855):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 9854):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 9853):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 9852):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 9851):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 9850):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 9849):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 9848):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 9847):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 9846):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 9845):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 9844):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 9843):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 9842):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 9841):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 9840):
#0 0x00007fe23beccad3 in ?? ()
#1 0x000000000000008e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007fe21c55eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe21c55eed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 9839):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000967fc in ?? ()
#4 0x00007fe21cd76eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe21cd76ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000967b0 in ?? ()
#9 0x00007fe23becc770 in ?? ()
#10 0x00007fe21cd76ed0 in ?? ()
#11 0x00000ffc439aeddc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 9838):
#0 0x00007fe23beccad3 in ?? ()
#1 0x000000000000004c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00008fff8 in ?? ()
#4 0x00007fe21d58eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe21d58eed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 33 (LWP 9837):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008d00c in ?? ()
#4 0x00007fe21dda6eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fe21dda6ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008cfc0 in ?? ()
#9 0x00007fe23becc770 in ?? ()
#10 0x00007fe21dda6ed0 in ?? ()
#11 0x00000ffc43bb4ddc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 32 (LWP 9836):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 9835):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 9834):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 9833):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 9832):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 9831):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 9830):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 9829):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 9828):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 9827):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 9826):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 9825):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 9824):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 9823):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 9822):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 9821):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 9820):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00007fe226761ce0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 9819):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001df18 in ?? ()
#5 0x00007fe226f89270 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 9818):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00007fe22779f260 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 9817):
#0 0x00007fe23beccad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 9816):
#0 0x00007fe2349fba47 in ?? ()
#1 0x00007fe2287b2340 in ?? ()
#2 0x000061a00000cc80 in ?? ()
#3 0x00007fe2287b2330 in ?? ()
#4 0x00007fe2287b2540 in ?? ()
#5 0x00007fe2287b2380 in ?? ()
#6 0x0000614000041c98 in ?? ()
#7 0x00007fe2287b2400 in ?? ()
#8 0x00007fe23706e25d in ?? ()
#9 0x3fb8a4f0ff773000 in ?? ()
#10 0x000061a00000cc80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000cc80 in ?? ()
#13 0x000000004a000000 in ?? ()
#14 0x00007fe200000000 in ?? ()
#15 0x41da3fa2dd9942b0 in ?? ()
#16 0x00000ffcc50ee480 in ?? ()
#17 0x00007fe2287b23e0 in ?? ()
#18 0x00007fe237072ba3 in ?? ()
#19 0x00007fe2287b23b0 in ?? ()
#20 0x3fb8a4f0ff773000 in ?? ()
#21 0x00000000287b2400 in ?? ()
#22 0x000061a00000cc80 in ?? ()
#23 0x0000614000041c98 in ?? ()
#24 0x3fb8a4f0ff773000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 9815):
#0 0x00007fe2349fba47 in ?? ()
#1 0x00007fe228fb3340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007fe228fb3330 in ?? ()
#4 0x00007fe228fb3540 in ?? ()
#5 0x00007fe228fb3380 in ?? ()
#6 0x0000614000041a98 in ?? ()
#7 0x00007fe228fb3400 in ?? ()
#8 0x00007fe23706e25d in ?? ()
#9 0x3fb951402408c000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000004000000 in ?? ()
#14 0x00007fe200000000 in ?? ()
#15 0x41da3fa2dd9942b1 in ?? ()
#16 0x00000ffcc51ee680 in ?? ()
#17 0x00007fe228fb33e0 in ?? ()
#18 0x00007fe237072ba3 in ?? ()
#19 0x00007fe228fb33b0 in ?? ()
#20 0x3fb951402408c000 in ?? ()
#21 0x0000000028fb3400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000041a98 in ?? ()
#24 0x3fb951402408c000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 9814):
#0 0x00007fe2349fba47 in ?? ()
#1 0x00007fe2297b4340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007fe2297b4330 in ?? ()
#4 0x00007fe2297b4540 in ?? ()
#5 0x00007fe2297b4380 in ?? ()
#6 0x0000614000041898 in ?? ()
#7 0x00007fe2297b4400 in ?? ()
#8 0x00007fe23706e25d in ?? ()
#9 0x3fb9789f7902e000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x0000000071000000 in ?? ()
#14 0x00007fe200000000 in ?? ()
#15 0x41da3fa2dd9942b3 in ?? ()
#16 0x00000ffcc52ee880 in ?? ()
#17 0x00007fe2297b43e0 in ?? ()
#18 0x00007fe237072ba3 in ?? ()
#19 0x00007fe2297b43b0 in ?? ()
#20 0x3fb9789f7902e000 in ?? ()
#21 0x00000000297b4400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000041898 in ?? ()
#24 0x3fb9789f7902e000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 9813):
#0 0x00007fe2349fba47 in ?? ()
#1 0x00007fe22b7ad340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007fe22b7ad330 in ?? ()
#4 0x00007fe22b7ad540 in ?? ()
#5 0x00007fe22b7ad380 in ?? ()
#6 0x0000614000041698 in ?? ()
#7 0x00007fe22b7ad400 in ?? ()
#8 0x00007fe23706e25d in ?? ()
#9 0x3fb97d3770277000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000dec00000 in ?? ()
#14 0x00007fe200000000 in ?? ()
#15 0x41da3fa2dd9942af in ?? ()
#16 0x00000ffcc56eda80 in ?? ()
#17 0x00007fe22b7ad3e0 in ?? ()
#18 0x00007fe237072ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 9810):
#0 0x00007fe2349eecb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fe22d1b77b8 in ?? ()
#3 0x000060200001c750 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bae81 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 9809):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00007fe22c9b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 9808):
#0 0x00007fe23bed09e2 in ?? ()
#1 0x00007fe22c1b3bc0 in ?? ()
#2 0x00007fe22c1b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fe22c1b3c10 in ?? ()
#6 0x00000000017a8c60 in ?? ()
#7 0x00007fe22c1b3c70 in ?? ()
#8 0x000061100008b290 in ?? ()
#9 0x00007fe22c1b3c60 in ?? ()
#10 0x00000000008b5377 in __sanitizer::theDepot ()
#11 0x00007fe2417fa50c in ?? ()
#12 0x00007fe2417e9b19 in ?? ()
#13 0x00007fe2417ee106 in ?? ()
#14 0x00007fe2417f2b40 in ?? ()
#15 0x00007fe2417f2969 in ?? ()
#16 0x0000000000a880ed in __sanitizer::theDepot ()
#17 0x00007fe2388be909 in ?? ()
#18 0x00007fe23bec66db in ?? ()
#19 0x00000ffcc582e688 in ?? ()
#20 0x00007fe22c1b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 9802):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x00007fe22e1b8ca0 in ?? ()
#2 0x000000000000001a in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007fe22e1b8c90 in ?? ()
#6 0x0000000000000034 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 9801):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 9800):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 9799):
#0 0x00007fe23beccfb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007fe22f9bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 9798):
#0 0x00007fe23bed0d50 in ?? ()
#1 0x0000000000000000 in ?? ()
I20251026 21:05:13.559810 10256 consensus_queue.cc:1048] T 92a81eb6fb164ce2a8f62232282a8c70 P 4473ec849b894f7b9407b5d1aa4e671b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e11e0a781c964fbab4e3d6e7fe89182c" member_type: VOTER last_known_addr { host: "127.9.121.1" port: 37253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
************************* END STACKS ***************************
I20251026 21:05:13.568691 9700 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID ef7dd9d5893148e8a25ce01222bfd1aa and pid 9929
************************ BEGIN STACKS **************************
[New LWP 9930]
[New LWP 9931]
[New LWP 9932]
[New LWP 9933]
[New LWP 9939]
[New LWP 9940]
[New LWP 9941]
[New LWP 9944]
[New LWP 9945]
[New LWP 9946]
[New LWP 9947]
[New LWP 9948]
[New LWP 9949]
[New LWP 9950]
[New LWP 9951]
[New LWP 9952]
[New LWP 9953]
[New LWP 9954]
[New LWP 9955]
[New LWP 9956]
[New LWP 9957]
[New LWP 9958]
[New LWP 9959]
[New LWP 9960]
[New LWP 9961]
[New LWP 9962]
[New LWP 9963]
[New LWP 9964]
[New LWP 9965]
[New LWP 9966]
[New LWP 9967]
[New LWP 9968]
[New LWP 9969]
[New LWP 9970]
[New LWP 9971]
[New LWP 9972]
[New LWP 9973]
[New LWP 9974]
[New LWP 9975]
[New LWP 9976]
[New LWP 9977]
[New LWP 9978]
[New LWP 9979]
[New LWP 9980]
[New LWP 9981]
[New LWP 9982]
[New LWP 9983]
[New LWP 9984]
[New LWP 9985]
[New LWP 9986]
[New LWP 9987]
[New LWP 9988]
[New LWP 9989]
[New LWP 9990]
[New LWP 9991]
[New LWP 9992]
[New LWP 9993]
[New LWP 9994]
[New LWP 9995]
[New LWP 9996]
[New LWP 9997]
[New LWP 9998]
[New LWP 9999]
[New LWP 10000]
[New LWP 10001]
[New LWP 10002]
[New LWP 10003]
[New LWP 10004]
[New LWP 10005]
[New LWP 10006]
[New LWP 10007]
[New LWP 10008]
[New LWP 10009]
[New LWP 10010]
[New LWP 10011]
[New LWP 10012]
[New LWP 10013]
[New LWP 10014]
[New LWP 10015]
[New LWP 10016]
[New LWP 10017]
[New LWP 10018]
[New LWP 10019]
[New LWP 10020]
[New LWP 10021]
[New LWP 10022]
[New LWP 10023]
[New LWP 10024]
[New LWP 10025]
[New LWP 10026]
[New LWP 10027]
[New LWP 10028]
[New LWP 10029]
[New LWP 10030]
[New LWP 10031]
[New LWP 10032]
[New LWP 10033]
[New LWP 10034]
[New LWP 10035]
[New LWP 10036]
[New LWP 10037]
[New LWP 10038]
[New LWP 10039]
[New LWP 10040]
[New LWP 10041]
[New LWP 10042]
[New LWP 10043]
[New LWP 10044]
[New LWP 10045]
[New LWP 10046]
[New LWP 10047]
[New LWP 10048]
[New LWP 10049]
[New LWP 10050]
[New LWP 10051]
[New LWP 10052]
[New LWP 10053]
[New LWP 10054]
[New LWP 10055]
[New LWP 10056]
[New LWP 10057]
[New LWP 10319]
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f31
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f31
0x00007f1826023d50 in ?? ()
Id Target Id Frame
* 1 LWP 9929 "kudu" 0x00007f1826023d50 in ?? ()
2 LWP 9930 "kudu" 0x00007f182601ffb9 in ?? ()
3 LWP 9931 "kudu" 0x00007f182601ffb9 in ?? ()
4 LWP 9932 "kudu" 0x00007f182601ffb9 in ?? ()
5 LWP 9933 "kernel-watcher-" 0x00007f182601ffb9 in ?? ()
6 LWP 9939 "ntp client-9939" 0x00007f18260239e2 in ?? ()
7 LWP 9940 "file cache-evic" 0x00007f182601ffb9 in ?? ()
8 LWP 9941 "sq_acceptor" 0x00007f181eb41cb9 in ?? ()
9 LWP 9944 "rpc reactor-994" 0x00007f181eb4ea47 in ?? ()
10 LWP 9945 "rpc reactor-994" 0x00007f181eb4ea47 in ?? ()
11 LWP 9946 "rpc reactor-994" 0x00007f181eb4ea47 in ?? ()
12 LWP 9947 "rpc reactor-994" 0x00007f181eb4ea47 in ?? ()
13 LWP 9948 "MaintenanceMgr " 0x00007f182601fad3 in ?? ()
14 LWP 9949 "txn-status-mana" 0x00007f182601ffb9 in ?? ()
15 LWP 9950 "collect_and_rem" 0x00007f182601ffb9 in ?? ()
16 LWP 9951 "tc-session-exp-" 0x00007f182601ffb9 in ?? ()
17 LWP 9952 "rpc worker-9952" 0x00007f182601fad3 in ?? ()
18 LWP 9953 "rpc worker-9953" 0x00007f182601fad3 in ?? ()
19 LWP 9954 "rpc worker-9954" 0x00007f182601fad3 in ?? ()
20 LWP 9955 "rpc worker-9955" 0x00007f182601fad3 in ?? ()
21 LWP 9956 "rpc worker-9956" 0x00007f182601fad3 in ?? ()
22 LWP 9957 "rpc worker-9957" 0x00007f182601fad3 in ?? ()
23 LWP 9958 "rpc worker-9958" 0x00007f182601fad3 in ?? ()
24 LWP 9959 "rpc worker-9959" 0x00007f182601fad3 in ?? ()
25 LWP 9960 "rpc worker-9960" 0x00007f182601fad3 in ?? ()
26 LWP 9961 "rpc worker-9961" 0x00007f182601fad3 in ?? ()
27 LWP 9962 "rpc worker-9962" 0x00007f182601fad3 in ?? ()
28 LWP 9963 "rpc worker-9963" 0x00007f182601fad3 in ?? ()
29 LWP 9964 "rpc worker-9964" 0x00007f182601fad3 in ?? ()
30 LWP 9965 "rpc worker-9965" 0x00007f182601fad3 in ?? ()
31 LWP 9966 "rpc worker-9966" 0x00007f182601fad3 in ?? ()
32 LWP 9967 "rpc worker-9967" 0x00007f182601fad3 in ?? ()
33 LWP 9968 "rpc worker-9968" 0x00007f182601fad3 in ?? ()
34 LWP 9969 "rpc worker-9969" 0x00007f182601fad3 in ?? ()
35 LWP 9970 "rpc worker-9970" 0x00007f182601fad3 in ?? ()
36 LWP 9971 "rpc worker-9971" 0x00007f182601fad3 in ?? ()
37 LWP 9972 "rpc worker-9972" 0x00007f182601fad3 in ?? ()
38 LWP 9973 "rpc worker-9973" 0x00007f182601fad3 in ?? ()
39 LWP 9974 "rpc worker-9974" 0x00007f182601fad3 in ?? ()
40 LWP 9975 "rpc worker-9975" 0x00007f182601fad3 in ?? ()
41 LWP 9976 "rpc worker-9976" 0x00007f182601fad3 in ?? ()
42 LWP 9977 "rpc worker-9977" 0x00007f182601fad3 in ?? ()
43 LWP 9978 "rpc worker-9978" 0x00007f182601fad3 in ?? ()
44 LWP 9979 "rpc worker-9979" 0x00007f182601fad3 in ?? ()
45 LWP 9980 "rpc worker-9980" 0x00007f182601fad3 in ?? ()
46 LWP 9981 "rpc worker-9981" 0x00007f182601fad3 in ?? ()
47 LWP 9982 "rpc worker-9982" 0x00007f182601fad3 in ?? ()
48 LWP 9983 "rpc worker-9983" 0x00007f182601fad3 in ?? ()
49 LWP 9984 "rpc worker-9984" 0x00007f182601fad3 in ?? ()
50 LWP 9985 "rpc worker-9985" 0x00007f182601fad3 in ?? ()
51 LWP 9986 "rpc worker-9986" 0x00007f182601fad3 in ?? ()
52 LWP 9987 "rpc worker-9987" 0x00007f182601fad3 in ?? ()
53 LWP 9988 "rpc worker-9988" 0x00007f182601fad3 in ?? ()
54 LWP 9989 "rpc worker-9989" 0x00007f182601fad3 in ?? ()
55 LWP 9990 "rpc worker-9990" 0x00007f182601fad3 in ?? ()
56 LWP 9991 "rpc worker-9991" 0x00007f182601fad3 in ?? ()
57 LWP 9992 "rpc worker-9992" 0x00007f182601fad3 in ?? ()
58 LWP 9993 "rpc worker-9993" 0x00007f182601fad3 in ?? ()
59 LWP 9994 "rpc worker-9994" 0x00007f182601fad3 in ?? ()
60 LWP 9995 "rpc worker-9995" 0x00007f182601fad3 in ?? ()
61 LWP 9996 "rpc worker-9996" 0x00007f182601fad3 in ?? ()
62 LWP 9997 "rpc worker-9997" 0x00007f182601fad3 in ?? ()
63 LWP 9998 "rpc worker-9998" 0x00007f182601fad3 in ?? ()
64 LWP 9999 "rpc worker-9999" 0x00007f182601fad3 in ?? ()
65 LWP 10000 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
66 LWP 10001 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
67 LWP 10002 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
68 LWP 10003 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
69 LWP 10004 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
70 LWP 10005 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
71 LWP 10006 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
72 LWP 10007 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
73 LWP 10008 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
74 LWP 10009 "rpc worker-1000" 0x00007f182601fad3 in ?? ()
75 LWP 10010 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
76 LWP 10011 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
77 LWP 10012 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
78 LWP 10013 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
79 LWP 10014 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
80 LWP 10015 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
81 LWP 10016 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
82 LWP 10017 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
83 LWP 10018 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
84 LWP 10019 "rpc worker-1001" 0x00007f182601fad3 in ?? ()
85 LWP 10020 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
86 LWP 10021 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
87 LWP 10022 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
88 LWP 10023 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
89 LWP 10024 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
90 LWP 10025 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
91 LWP 10026 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
92 LWP 10027 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
93 LWP 10028 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
94 LWP 10029 "rpc worker-1002" 0x00007f182601fad3 in ?? ()
95 LWP 10030 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
96 LWP 10031 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
97 LWP 10032 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
98 LWP 10033 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
99 LWP 10034 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
100 LWP 10035 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
101 LWP 10036 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
102 LWP 10037 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
103 LWP 10038 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
104 LWP 10039 "rpc worker-1003" 0x00007f182601fad3 in ?? ()
105 LWP 10040 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
106 LWP 10041 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
107 LWP 10042 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
108 LWP 10043 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
109 LWP 10044 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
110 LWP 10045 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
111 LWP 10046 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
112 LWP 10047 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
113 LWP 10048 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
114 LWP 10049 "rpc worker-1004" 0x00007f182601fad3 in ?? ()
115 LWP 10050 "rpc worker-1005" 0x00007f182601fad3 in ?? ()
116 LWP 10051 "rpc worker-1005" 0x00007f182601fad3 in ?? ()
117 LWP 10052 "diag-logger-100" 0x00007f182601ffb9 in ?? ()
118 LWP 10053 "result-tracker-" 0x00007f182601ffb9 in ?? ()
119 LWP 10054 "excess-log-dele" 0x00007f182601ffb9 in ?? ()
120 LWP 10055 "acceptor-10055" 0x00007f181eb500c7 in ?? ()
121 LWP 10056 "heartbeat-10056" 0x00007f182601ffb9 in ?? ()
122 LWP 10057 "maintenance_sch" 0x00007f182601ffb9 in ?? ()
123 LWP 10319 "wal-append [wor" 0x00007f182601ffb9 in ?? ()
Thread 123 (LWP 10319):
#0 0x00007f182601ffb9 in ?? ()
#1 0x00006020001cd2d8 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a00010ffb4 in ?? ()
#5 0x00007f17d1a36130 in ?? ()
#6 0x0000000000000003 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f17d1a36150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 10057):
#0 0x00007f182601ffb9 in ?? ()
#1 0x00007f17dae7d700 in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f17dae7d750 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 10056):
#0 0x00007f182601ffb9 in ?? ()
#1 0x9e33ba35ca9a2782 in ?? ()
#2 0x000000000000000d in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x0000613000019244 in ?? ()
#5 0x00007f17db695610 in ?? ()
#6 0x000000000000001b in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f17db695630 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007f17db6956b0 in ?? ()
#12 0x00000fe2fb6d2ad8 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 10055):
#0 0x00007f181eb500c7 in ?? ()
#1 0x00006140000418a8 in ?? ()
#2 0x00007f17dbebcd70 in ?? ()
#3 0x00007f17dbebcda0 in ?? ()
#4 0x00007f17dbebcea0 in ?? ()
#5 0x00007f17dbebcd90 in ?? ()
#6 0x00007f17dbebce00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c323b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f17dbebcf20 in ?? ()
#11 0x00007f17dbebc65c in ?? ()
#12 0x00000032dbebc5d0 in ?? ()
#13 0x00007f17db6c0000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 10054):
#0 0x00007f182601ffb9 in ?? ()
#1 0x00007f17dc6d6f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 10053):
#0 0x00007f182601ffb9 in ?? ()
#1 0x00007f17dceef120 in ?? ()
#2 0x0000000000000005 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008a930 in ?? ()
#5 0x00007f17dceef110 in ?? ()
#6 0x000000000000000a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 10052):
#0 0x00007f182601ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 10051):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 10050):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 10049):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 10048):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 10047):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 10046):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 10045):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 10044):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 10043):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 10042):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 10041):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 10040):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 10039):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 10038):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 10037):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 10036):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 10035):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 10034):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 10033):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 10032):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 10031):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 10030):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 10029):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 10028):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 10027):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 10026):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 10025):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 10024):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 10023):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 10022):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 10021):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 10020):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 10019):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 10018):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 10017):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 10016):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 10015):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 10014):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 10013):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 10012):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 10011):
#0 0x00007f182601fad3 in ?? ()
#1 0x00000000000000ec in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007f17f22efeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17f22efed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 10010):
#0 0x00007f182601fad3 in ?? ()
#1 0x000000000000009e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007f17f2b07eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17f2b07ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 10009):
#0 0x00007f182601fad3 in ?? ()
#1 0x00000000000000ae in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001967c8 in ?? ()
#4 0x00007f17f331feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17f331fed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 10008):
#0 0x00007f182601fad3 in ?? ()
#1 0x00000000000000db in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00018ffcc in ?? ()
#4 0x00007f17f3b37eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17f3b37ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00018ff80 in ?? ()
#9 0x00007f182601f770 in ?? ()
#10 0x00007f17f3b37ed0 in ?? ()
#11 0x00000fe2fe766fdc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 72 (LWP 10007):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001867dc in ?? ()
#4 0x00007f17f434feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17f434fed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000186790 in ?? ()
#9 0x00007f182601f770 in ?? ()
#10 0x00007f17f434fed0 in ?? ()
#11 0x00000fe2fe869fdc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 71 (LWP 10006):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 10005):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 10004):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 10003):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 10002):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 10001):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 10000):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 9999):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 9998):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 9997):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 9996):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 9995):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 9994):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 9993):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 9992):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 9991):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007f17fc4d0eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17fc4d0ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007f182601f770 in ?? ()
#10 0x00007f17fc4d0ed0 in ?? ()
#11 0x00000fe2ff89a1dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 9990):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00011d048 in ?? ()
#4 0x00007f17fcce8eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17fcce8ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 54 (LWP 9989):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000116848 in ?? ()
#4 0x00007f17fd500eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17fd500ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 53 (LWP 9988):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011004c in ?? ()
#4 0x00007f17fdd18eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f17fdd18ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000110000 in ?? ()
#9 0x00007f182601f770 in ?? ()
#10 0x00007f17fdd18ed0 in ?? ()
#11 0x00000fe2ffba31dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 52 (LWP 9987):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 9986):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 9985):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 9984):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 9983):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 9982):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 9981):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 9980):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 9979):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 9978):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 9977):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 9976):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 9975):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 9974):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 9973):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 9972):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 9971):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000056 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007f18066b1eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f18066b1ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 9970):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000034 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000967f8 in ?? ()
#4 0x00007f1806ec9eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f1806ec9ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 9969):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000050 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00008fff8 in ?? ()
#4 0x00007f18076e1eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f18076e1ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 33 (LWP 9968):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008d00c in ?? ()
#4 0x00007f1807ef9eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f1807ef9ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008cfc0 in ?? ()
#9 0x00007f182601f770 in ?? ()
#10 0x00007f1807ef9ed0 in ?? ()
#11 0x00000fe300fdf3dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 32 (LWP 9967):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 9966):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 9965):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 9964):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 9963):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 9962):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 9961):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 9960):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 9959):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 9958):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 9957):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 9956):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 9955):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 9954):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 9953):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 9952):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 9951):
#0 0x00007f182601ffb9 in ?? ()
#1 0x00007f18108b4ce0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 9950):
#0 0x00007f182601ffb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001df18 in ?? ()
#5 0x00007f18110dc270 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 9949):
#0 0x00007f182601ffb9 in ?? ()
#1 0x00007f18118f2260 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 9948):
#0 0x00007f182601fad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 9947):
#0 0x00007f181eb4ea47 in ?? ()
#1 0x00007f1812941340 in ?? ()
#2 0x000061a00000cc80 in ?? ()
#3 0x00007f1812941330 in ?? ()
#4 0x00007f1812941540 in ?? ()
#5 0x00007f1812941380 in ?? ()
#6 0x0000614000041c98 in ?? ()
#7 0x00007f1812941400 in ?? ()
#8 0x00007f18211c125d in ?? ()
#9 0x3fb964b275f9a000 in ?? ()
#10 0x000061a00000cc80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000cc80 in ?? ()
#13 0x000000003e000000 in ?? ()
#14 0x00007f1800000000 in ?? ()
#15 0x41da3fa2dd9942b0 in ?? ()
#16 0x00000fe382520280 in ?? ()
#17 0x00007f18129413e0 in ?? ()
#18 0x00007f18211c5ba3 in ?? ()
#19 0x00007f18129413b0 in ?? ()
#20 0x3fb964b275f9a000 in ?? ()
#21 0x0000000012941400 in ?? ()
#22 0x000061a00000cc80 in ?? ()
#23 0x0000614000041c98 in ?? ()
#24 0x3fb964b275f9a000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 9946):
#0 0x00007f181eb4ea47 in ?? ()
#1 0x00007f1813158340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f1813158330 in ?? ()
#4 0x00007f1813158540 in ?? ()
#5 0x00007f1813158380 in ?? ()
#6 0x0000614000041a98 in ?? ()
#7 0x00007f1813158400 in ?? ()
#8 0x00007f18211c125d in ?? ()
#9 0x3fb98ba55c942000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000017000000 in ?? ()
#14 0x00007f1800000000 in ?? ()
#15 0x41da3fa2dd9942b1 in ?? ()
#16 0x00000fe382623080 in ?? ()
#17 0x00007f18131583e0 in ?? ()
#18 0x00007f18211c5ba3 in ?? ()
#19 0x00007f18131583b0 in ?? ()
#20 0x3fb98ba55c942000 in ?? ()
#21 0x0000000013158400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000041a98 in ?? ()
#24 0x3fb98ba55c942000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 9945):
#0 0x00007f181eb4ea47 in ?? ()
#1 0x00007f181396f340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f181396f330 in ?? ()
#4 0x00007f181396f540 in ?? ()
#5 0x00007f181396f380 in ?? ()
#6 0x0000614000041898 in ?? ()
#7 0x00007f181396f400 in ?? ()
#8 0x00007f18211c125d in ?? ()
#9 0x3fb968dd23b36000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x000000001e000000 in ?? ()
#14 0x00007f1800000000 in ?? ()
#15 0x41da3fa2dd9942b0 in ?? ()
#16 0x00000fe382725e80 in ?? ()
#17 0x00007f181396f3e0 in ?? ()
#18 0x00007f18211c5ba3 in ?? ()
#19 0x00007f181396f3b0 in ?? ()
#20 0x3fb968dd23b36000 in ?? ()
#21 0x000000001396f400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000041898 in ?? ()
#24 0x3fb968dd23b36000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 9944):
#0 0x00007f181eb4ea47 in ?? ()
#1 0x00007f1815995340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f1815995330 in ?? ()
#4 0x00007f1815995540 in ?? ()
#5 0x00007f1815995380 in ?? ()
#6 0x0000614000041698 in ?? ()
#7 0x00007f1815995400 in ?? ()
#8 0x00007f18211c125d in ?? ()
#9 0x3fb959cd66512000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000bc000000 in ?? ()
#14 0x00007f1800000000 in ?? ()
#15 0x41da3fa2dd9942ae in ?? ()
#16 0x00000fe382b2aa80 in ?? ()
#17 0x00007f18159953e0 in ?? ()
#18 0x00007f18211c5ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 9941):
#0 0x00007f181eb41cb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f18173b77b8 in ?? ()
#3 0x000060200001da10 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bae81 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 9940):
#0 0x00007f182601ffb9 in ?? ()
#1 0x00007f1816bb60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 9939):
#0 0x00007f18260239e2 in ?? ()
#1 0x00007f18163b3bc0 in ?? ()
#2 0x00007f18163b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f18163b3c10 in ?? ()
#6 0x00000000017a8c60 in ?? ()
#7 0x00007f18163b3c70 in ?? ()
#8 0x000061100008b290 in ?? ()
#9 0x00007f18163b3c60 in ?? ()
#10 0x00000000008b5377 in __sanitizer::theDepot ()
#11 0x00007f182b94d50c in ?? ()
#12 0x00007f182b93cb19 in ?? ()
#13 0x00007f182b941106 in ?? ()
#14 0x00007f182b945b40 in ?? ()
#15 0x00007f182b945969 in ?? ()
#16 0x0000000000a880ed in __sanitizer::theDepot ()
#17 0x00007f1822a11909 in ?? ()
#18 0x00007f18260196db in ?? ()
#19 0x00000fe382c6e688 in ?? ()
#20 0x00007f18163b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 9933):
#0 0x00007f182601ffb9 in ?? ()
#1 0x00007f18183b8ca0 in ?? ()
#2 0x000000000000001a in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007f18183b8c90 in ?? ()
#6 0x0000000000000034 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 9932):
#0 0x00007f182601ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 9931):
#0 0x00007f182601ffb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 9930):
#0 0x00007f182601ffb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007f1819bbc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 9929):
#0 0x00007f1826023d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20251026 21:05:14.137567 9700 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID 4473ec849b894f7b9407b5d1aa4e671b and pid 10059
************************ BEGIN STACKS **************************
[New LWP 10060]
[New LWP 10061]
[New LWP 10062]
[New LWP 10063]
[New LWP 10069]
[New LWP 10070]
[New LWP 10071]
[New LWP 10074]
[New LWP 10075]
[New LWP 10076]
[New LWP 10077]
[New LWP 10078]
[New LWP 10079]
[New LWP 10080]
[New LWP 10081]
[New LWP 10082]
[New LWP 10083]
[New LWP 10084]
[New LWP 10085]
[New LWP 10086]
[New LWP 10087]
[New LWP 10088]
[New LWP 10089]
[New LWP 10090]
[New LWP 10091]
[New LWP 10092]
[New LWP 10093]
[New LWP 10094]
[New LWP 10095]
[New LWP 10096]
[New LWP 10097]
[New LWP 10098]
[New LWP 10099]
[New LWP 10100]
[New LWP 10101]
[New LWP 10102]
[New LWP 10103]
[New LWP 10104]
[New LWP 10105]
[New LWP 10106]
[New LWP 10107]
[New LWP 10108]
[New LWP 10109]
[New LWP 10110]
[New LWP 10111]
[New LWP 10112]
[New LWP 10113]
[New LWP 10114]
[New LWP 10115]
[New LWP 10116]
[New LWP 10117]
[New LWP 10118]
[New LWP 10119]
[New LWP 10120]
[New LWP 10121]
[New LWP 10122]
[New LWP 10123]
[New LWP 10124]
[New LWP 10125]
[New LWP 10126]
[New LWP 10127]
[New LWP 10128]
[New LWP 10129]
[New LWP 10130]
[New LWP 10131]
[New LWP 10132]
[New LWP 10133]
[New LWP 10134]
[New LWP 10135]
[New LWP 10136]
[New LWP 10137]
[New LWP 10138]
[New LWP 10139]
[New LWP 10140]
[New LWP 10141]
[New LWP 10142]
[New LWP 10143]
[New LWP 10144]
[New LWP 10145]
[New LWP 10146]
[New LWP 10147]
[New LWP 10148]
[New LWP 10149]
[New LWP 10150]
[New LWP 10151]
[New LWP 10152]
[New LWP 10153]
[New LWP 10154]
[New LWP 10155]
[New LWP 10156]
[New LWP 10157]
[New LWP 10158]
[New LWP 10159]
[New LWP 10160]
[New LWP 10161]
[New LWP 10162]
[New LWP 10163]
[New LWP 10164]
[New LWP 10165]
[New LWP 10166]
[New LWP 10167]
[New LWP 10168]
[New LWP 10169]
[New LWP 10170]
[New LWP 10171]
[New LWP 10172]
[New LWP 10173]
[New LWP 10174]
[New LWP 10175]
[New LWP 10176]
[New LWP 10177]
[New LWP 10178]
[New LWP 10179]
[New LWP 10180]
[New LWP 10181]
[New LWP 10182]
[New LWP 10183]
[New LWP 10184]
[New LWP 10185]
[New LWP 10186]
[New LWP 10187]
[New LWP 10332]
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f31
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f39
Cannot access memory at address 0x65726464615f5f31
0x00007fa433e7ad50 in ?? ()
Id Target Id Frame
* 1 LWP 10059 "kudu" 0x00007fa433e7ad50 in ?? ()
2 LWP 10060 "kudu" 0x00007fa433e76fb9 in ?? ()
3 LWP 10061 "kudu" 0x00007fa433e76fb9 in ?? ()
4 LWP 10062 "kudu" 0x00007fa433e76fb9 in ?? ()
5 LWP 10063 "kernel-watcher-" 0x00007fa433e76fb9 in ?? ()
6 LWP 10069 "ntp client-1006" 0x00007fa433e7a9e2 in ?? ()
7 LWP 10070 "file cache-evic" 0x00007fa433e76fb9 in ?? ()
8 LWP 10071 "sq_acceptor" 0x00007fa42c998cb9 in ?? ()
9 LWP 10074 "rpc reactor-100" 0x00007fa42c9a5a47 in ?? ()
10 LWP 10075 "rpc reactor-100" 0x00007fa42c9a5a47 in ?? ()
11 LWP 10076 "rpc reactor-100" 0x00007fa42c9a5a47 in ?? ()
12 LWP 10077 "rpc reactor-100" 0x00007fa42c9a5a47 in ?? ()
13 LWP 10078 "MaintenanceMgr " 0x00007fa433e76ad3 in ?? ()
14 LWP 10079 "txn-status-mana" 0x00007fa433e76fb9 in ?? ()
15 LWP 10080 "collect_and_rem" 0x00007fa433e76fb9 in ?? ()
16 LWP 10081 "tc-session-exp-" 0x00007fa433e76fb9 in ?? ()
17 LWP 10082 "rpc worker-1008" 0x00007fa433e76ad3 in ?? ()
18 LWP 10083 "rpc worker-1008" 0x00007fa433e76ad3 in ?? ()
19 LWP 10084 "rpc worker-1008" 0x00007fa433e76ad3 in ?? ()
20 LWP 10085 "rpc worker-1008" 0x00007fa433e76ad3 in ?? ()
21 LWP 10086 "rpc worker-1008" 0x00007fa433e76ad3 in ?? ()
22 LWP 10087 "rpc worker-1008" 0x00007fa433e76ad3 in ?? ()
23 LWP 10088 "rpc worker-1008" 0x00007fa433e76ad3 in ?? ()
24 LWP 10089 "rpc worker-1008" 0x00007fa433e76ad3 in ?? ()
25 LWP 10090 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
26 LWP 10091 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
27 LWP 10092 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
28 LWP 10093 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
29 LWP 10094 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
30 LWP 10095 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
31 LWP 10096 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
32 LWP 10097 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
33 LWP 10098 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
34 LWP 10099 "rpc worker-1009" 0x00007fa433e76ad3 in ?? ()
35 LWP 10100 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
36 LWP 10101 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
37 LWP 10102 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
38 LWP 10103 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
39 LWP 10104 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
40 LWP 10105 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
41 LWP 10106 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
42 LWP 10107 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
43 LWP 10108 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
44 LWP 10109 "rpc worker-1010" 0x00007fa433e76ad3 in ?? ()
45 LWP 10110 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
46 LWP 10111 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
47 LWP 10112 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
48 LWP 10113 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
49 LWP 10114 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
50 LWP 10115 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
51 LWP 10116 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
52 LWP 10117 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
53 LWP 10118 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
54 LWP 10119 "rpc worker-1011" 0x00007fa433e76ad3 in ?? ()
55 LWP 10120 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
56 LWP 10121 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
57 LWP 10122 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
58 LWP 10123 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
59 LWP 10124 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
60 LWP 10125 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
61 LWP 10126 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
62 LWP 10127 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
63 LWP 10128 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
64 LWP 10129 "rpc worker-1012" 0x00007fa433e76ad3 in ?? ()
65 LWP 10130 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
66 LWP 10131 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
67 LWP 10132 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
68 LWP 10133 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
69 LWP 10134 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
70 LWP 10135 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
71 LWP 10136 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
72 LWP 10137 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
73 LWP 10138 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
74 LWP 10139 "rpc worker-1013" 0x00007fa433e76ad3 in ?? ()
75 LWP 10140 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
76 LWP 10141 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
77 LWP 10142 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
78 LWP 10143 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
79 LWP 10144 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
80 LWP 10145 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
81 LWP 10146 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
82 LWP 10147 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
83 LWP 10148 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
84 LWP 10149 "rpc worker-1014" 0x00007fa433e76ad3 in ?? ()
85 LWP 10150 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
86 LWP 10151 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
87 LWP 10152 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
88 LWP 10153 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
89 LWP 10154 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
90 LWP 10155 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
91 LWP 10156 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
92 LWP 10157 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
93 LWP 10158 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
94 LWP 10159 "rpc worker-1015" 0x00007fa433e76ad3 in ?? ()
95 LWP 10160 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
96 LWP 10161 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
97 LWP 10162 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
98 LWP 10163 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
99 LWP 10164 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
100 LWP 10165 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
101 LWP 10166 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
102 LWP 10167 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
103 LWP 10168 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
104 LWP 10169 "rpc worker-1016" 0x00007fa433e76ad3 in ?? ()
105 LWP 10170 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
106 LWP 10171 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
107 LWP 10172 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
108 LWP 10173 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
109 LWP 10174 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
110 LWP 10175 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
111 LWP 10176 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
112 LWP 10177 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
113 LWP 10178 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
114 LWP 10179 "rpc worker-1017" 0x00007fa433e76ad3 in ?? ()
115 LWP 10180 "rpc worker-1018" 0x00007fa433e76ad3 in ?? ()
116 LWP 10181 "rpc worker-1018" 0x00007fa433e76ad3 in ?? ()
117 LWP 10182 "diag-logger-101" 0x00007fa433e76fb9 in ?? ()
118 LWP 10183 "result-tracker-" 0x00007fa433e76fb9 in ?? ()
119 LWP 10184 "excess-log-dele" 0x00007fa433e76fb9 in ?? ()
120 LWP 10185 "acceptor-10185" 0x00007fa42c9a70c7 in ?? ()
121 LWP 10186 "heartbeat-10186" 0x00007fa433e76fb9 in ?? ()
122 LWP 10187 "maintenance_sch" 0x00007fa433e76fb9 in ?? ()
123 LWP 10332 "raft [worker]-1" 0x00007fa433e76fb9 in ?? ()
Thread 123 (LWP 10332):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x000000000000000d in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007fa3e7c94bc4 in ?? ()
#5 0x00007fa3e7c94850 in ?? ()
#6 0x000000000000001b in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fa3e7c94870 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 10187):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x00007fa3e8cd4700 in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007fa3e8cd4750 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 10186):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x9e33ba35ca9a2782 in ?? ()
#2 0x000000000000000f in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x0000613000019244 in ?? ()
#5 0x00007fa3e94ec610 in ?? ()
#6 0x000000000000001f in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007fa3e94ec630 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007fa3e94ec6b0 in ?? ()
#12 0x00000ff47d29d8d8 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 10185):
#0 0x00007fa42c9a70c7 in ?? ()
#1 0x00006140000416a8 in ?? ()
#2 0x00007fa3e9d13d70 in ?? ()
#3 0x00007fa3e9d13da0 in ?? ()
#4 0x00007fa3e9d13ea0 in ?? ()
#5 0x00007fa3e9d13d90 in ?? ()
#6 0x00007fa3e9d13e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c323b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007fa3e9d13f20 in ?? ()
#11 0x00007fa3e9d1365c in ?? ()
#12 0x00000032e9d135d0 in ?? ()
#13 0x00007fa3e9517000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 10184):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x00007fa3ea52df60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 10183):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x00007fa3ead46120 in ?? ()
#2 0x0000000000000005 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008a930 in ?? ()
#5 0x00007fa3ead46110 in ?? ()
#6 0x000000000000000a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 10182):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 10181):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 10180):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 10179):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 10178):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 10177):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 10176):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 10175):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 10174):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 10173):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 10172):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 10171):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 10170):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 10169):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 10168):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 10167):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 10166):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 10165):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 10164):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 10163):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 10162):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 10161):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 10160):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 10159):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 10158):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 10157):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 10156):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 10155):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 10154):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 10153):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 10152):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 10151):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 10150):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 10149):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 10148):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 10147):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 10146):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 10145):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 10144):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 10143):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 10142):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 10141):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x00000000000000f3 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007fa400146eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa400146ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa400146ed0 in ?? ()
#11 0x00000ff480028ddc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 10140):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x00000000000000a1 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007fa40095eeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa40095eed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa40095eed0 in ?? ()
#11 0x00000ff48012bddc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 10139):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x00000000000000a8 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001967c8 in ?? ()
#4 0x00007fa401176eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa401176ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 10138):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 10137):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 10136):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 10135):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 10134):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 10133):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 10132):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 10131):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 10130):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 10129):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 10128):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 10127):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 10126):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 10125):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 10124):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 10123):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 10122):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 10121):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007fa40a327eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa40a327ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa40a327ed0 in ?? ()
#11 0x00000ff481464fdc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 10120):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011d04c in ?? ()
#4 0x00007fa40ab3feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa40ab3fed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011d000 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa40ab3fed0 in ?? ()
#11 0x00000ff481567fdc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 54 (LWP 10119):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007fa40b357eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa40b357ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa40b357ed0 in ?? ()
#11 0x00000ff48166afdc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 53 (LWP 10118):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011004c in ?? ()
#4 0x00007fa40bb6feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa40bb6fed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000110000 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa40bb6fed0 in ?? ()
#11 0x00000ff48176dfdc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 52 (LWP 10117):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 10116):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 10115):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 10114):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 10113):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 10112):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 10111):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 10110):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 10109):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 10108):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 10107):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 10106):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 10105):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 10104):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 10103):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 10102):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 10101):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x000000000000006b in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007fa414508eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa414508ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa414508ed0 in ?? ()
#11 0x00000ff4828a11dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 10100):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000048 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000967f8 in ?? ()
#4 0x00007fa414d20eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa414d20ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 10099):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x000000000000004f in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008fffc in ?? ()
#4 0x00007fa415538eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa415538ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008ffb0 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa415538ed0 in ?? ()
#11 0x00000ff482aa71dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 10098):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000010 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00008d008 in ?? ()
#4 0x00007fa415d50eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa415d50ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 32 (LWP 10097):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000082 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000086808 in ?? ()
#4 0x00007fa416568eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa416568ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 31 (LWP 10096):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008000c in ?? ()
#4 0x00007fa416d80eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa416d80ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00007ffc0 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa416d80ed0 in ?? ()
#11 0x00000ff482db01dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 30 (LWP 10095):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000003 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00007681c in ?? ()
#4 0x00007fa417598eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa417598ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000767d0 in ?? ()
#9 0x00007fa433e76770 in ?? ()
#10 0x00007fa417598ed0 in ?? ()
#11 0x00000ff482eb31dc in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 29 (LWP 10094):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000018 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000070018 in ?? ()
#4 0x00007fa417db0eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fa417db0ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 28 (LWP 10093):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 10092):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 10091):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 10090):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 10089):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 10088):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 10087):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 10086):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 10085):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 10084):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 10083):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 10082):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 10081):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x00007fa41e70dce0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 10080):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001df18 in ?? ()
#5 0x00007fa41ef36270 in ?? ()
#6 0x0000000000000002 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 14 (LWP 10079):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x00007fa41f74d260 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 10078):
#0 0x00007fa433e76ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 10077):
#0 0x00007fa42c9a5a47 in ?? ()
#1 0x00007fa42079c340 in ?? ()
#2 0x000061a00000cc80 in ?? ()
#3 0x00007fa42079c330 in ?? ()
#4 0x00007fa42079c540 in ?? ()
#5 0x00007fa42079c380 in ?? ()
#6 0x0000614000041c98 in ?? ()
#7 0x00007fa42079c400 in ?? ()
#8 0x00007fa42f01825d in ?? ()
#9 0x3fb135d0bec14000 in ?? ()
#10 0x000061a00000cc80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000cc80 in ?? ()
#13 0x0000000086000000 in ?? ()
#14 0x00007fa400000000 in ?? ()
#15 0x41da3fa2dd9942ae in ?? ()
#16 0x00000ff5040eb880 in ?? ()
#17 0x00007fa42079c3e0 in ?? ()
#18 0x00007fa42f01cba3 in ?? ()
#19 0x00007fa42079c3b0 in ?? ()
#20 0x3fb135d0bec14000 in ?? ()
#21 0x000000002079c400 in ?? ()
#22 0x000061a00000cc80 in ?? ()
#23 0x0000614000041c98 in ?? ()
#24 0x3fb135d0bec14000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 10076):
#0 0x00007fa42c9a5a47 in ?? ()
#1 0x00007fa420fb3340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007fa420fb3330 in ?? ()
#4 0x00007fa420fb3540 in ?? ()
#5 0x00007fa420fb3380 in ?? ()
#6 0x0000614000041a98 in ?? ()
#7 0x00007fa420fb3400 in ?? ()
#8 0x00007fa42f01825d in ?? ()
#9 0x3fb2d5cbbdc7e000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000008b000000 in ?? ()
#14 0x00007fa400000000 in ?? ()
#15 0x41da3fa2dd9942b0 in ?? ()
#16 0x00000ff5041ee680 in ?? ()
#17 0x00007fa420fb33e0 in ?? ()
#18 0x00007fa42f01cba3 in ?? ()
#19 0x00007fa420fb33b0 in ?? ()
#20 0x3fb2d5cbbdc7e000 in ?? ()
#21 0x0000000020fb3400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000041a98 in ?? ()
#24 0x3fb2d5cbbdc7e000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 10075):
#0 0x00007fa42c9a5a47 in ?? ()
#1 0x00007fa4217b4340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007fa4217b4330 in ?? ()
#4 0x00007fa4217b4540 in ?? ()
#5 0x00007fa4217b4380 in ?? ()
#6 0x0000614000041898 in ?? ()
#7 0x00007fa4217b4400 in ?? ()
#8 0x00007fa42f01825d in ?? ()
#9 0x3fb964130f7da000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x000000007c000000 in ?? ()
#14 0x00007fa400000000 in ?? ()
#15 0x41da3fa2dd9942b4 in ?? ()
#16 0x00000ff5042ee880 in ?? ()
#17 0x00007fa4217b43e0 in ?? ()
#18 0x00007fa42f01cba3 in ?? ()
#19 0x00007fa4217b43b0 in ?? ()
#20 0x3fb964130f7da000 in ?? ()
#21 0x00000000217b4400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000041898 in ?? ()
#24 0x3fb964130f7da000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 10074):
#0 0x00007fa42c9a5a47 in ?? ()
#1 0x00007fa4237ad340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007fa4237ad330 in ?? ()
#4 0x00007fa4237ad540 in ?? ()
#5 0x00007fa4237ad380 in ?? ()
#6 0x0000614000041698 in ?? ()
#7 0x00007fa4237ad400 in ?? ()
#8 0x00007fa42f01825d in ?? ()
#9 0x3fb9630d44d24000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000d9800000 in ?? ()
#14 0x00007fa400000000 in ?? ()
#15 0x41da3fa2dd9942af in ?? ()
#16 0x00000ff5046eda80 in ?? ()
#17 0x00007fa4237ad3e0 in ?? ()
#18 0x00007fa42f01cba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 10071):
#0 0x00007fa42c998cb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fa4251b77b8 in ?? ()
#3 0x000060200001c750 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bae81 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 10070):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x00007fa4249b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 10069):
#0 0x00007fa433e7a9e2 in ?? ()
#1 0x00007fa4241b3bc0 in ?? ()
#2 0x00007fa4241b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fa4241b3c10 in ?? ()
#6 0x00000000017a8c60 in ?? ()
#7 0x00007fa4241b3c70 in ?? ()
#8 0x000061100008b290 in ?? ()
#9 0x00007fa4241b3c60 in ?? ()
#10 0x00000000008b5377 in __sanitizer::theDepot ()
#11 0x00007fa4397a450c in ?? ()
#12 0x00007fa439793b19 in ?? ()
#13 0x00007fa439798106 in ?? ()
#14 0x00007fa43979cb40 in ?? ()
#15 0x00007fa43979c969 in ?? ()
#16 0x0000000000a880ed in __sanitizer::theDepot ()
#17 0x00007fa430868909 in ?? ()
#18 0x00007fa433e706db in ?? ()
#19 0x00000ff50482e688 in ?? ()
#20 0x00007fa4241b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 10063):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x00007fa4261b8ca0 in ?? ()
#2 0x000000000000001b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007fa4261b8c90 in ?? ()
#6 0x0000000000000036 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 10062):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 10061):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 10060):
#0 0x00007fa433e76fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007fa4279bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 10059):
#0 0x00007fa433e7ad50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20251026 21:05:14.691015 9700 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu pid 9798
I20251026 21:05:14.703572 9920 generic_service.cc:196] Checking for leaks (request via RPC)
I20251026 21:05:14.843731 9700 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu with pid 9798
W20251026 21:05:14.866067 9945 connection.cc:537] server connection from 127.9.121.1:35923 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251026 21:05:14.866067 10077 connection.cc:537] server connection from 127.9.121.1:49767 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251026 21:05:14.866875 9700 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu pid 9929
I20251026 21:05:14.867975 10051 generic_service.cc:196] Checking for leaks (request via RPC)
I20251026 21:05:14.994572 9700 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu with pid 9929
I20251026 21:05:15.016741 9700 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu pid 10059
I20251026 21:05:15.023846 10181 generic_service.cc:196] Checking for leaks (request via RPC)
I20251026 21:05:15.152572 9700 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu with pid 10059
I20251026 21:05:15.175293 9700 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu pid 9708
I20251026 21:05:15.176450 9769 generic_service.cc:196] Checking for leaks (request via RPC)
I20251026 21:05:15.283138 9700 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskFuHAzD/build/asan/bin/kudu with pid 9708
2025-10-26T21:05:15Z chronyd exiting
I20251026 21:05:15.317569 9700 test_util.cc:183] -----------------------------------------------
I20251026 21:05:15.317653 9700 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-taskFuHAzD/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1761512707319757-9700-0
[ FAILED ] ReplaceTabletITest.ReplaceTabletsWhileWriting (7938 ms)
[----------] 1 test from ReplaceTabletITest (7938 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (7938 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] ReplaceTabletITest.ReplaceTabletsWhileWriting
1 FAILED TEST
I20251026 21:05:15.319005 9700 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/client/batcher.cc:441: suppressed but not reported on 3 messages since previous log ~2 seconds ago