[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from ReplaceTabletITest
[ RUN ] ReplaceTabletITest.ReplaceTabletsWhileWriting
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251211 08:56:18.968282 16699 test_util.cc:276] Using random seed: 1366914744
2025-12-11T08:56:18Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-12-11T08:56:18Z Disabled control of system clock
I20251211 08:56:18.998594 16699 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4FbiYc/build/asan/bin/kudu
/tmp/dist-test-task4FbiYc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.78.254:42651
--webserver_interface=127.16.78.254
--webserver_port=0
--builtin_ntp_servers=127.16.78.212:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.16.78.254:42651 with env {}
W20251211 08:56:19.274837 16707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 08:56:19.275096 16707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 08:56:19.275156 16707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 08:56:19.282315 16707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251211 08:56:19.282392 16707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 08:56:19.282438 16707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251211 08:56:19.282490 16707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251211 08:56:19.290582 16707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.78.212:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.16.78.254:42651
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.16.78.254:42651
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.16.78.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type FASTDEBUG
built by None at 11 Dec 2025 08:43:21 UTC on 24a791456cd2
build id 9460
ASAN enabled
I20251211 08:56:19.291908 16707 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 08:56:19.293423 16707 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 08:56:19.300688 16712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 08:56:19.300581 16713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 08:56:19.300997 16715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 08:56:19.301625 16707 server_base.cc:1047] running on GCE node
I20251211 08:56:19.302193 16707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 08:56:19.303267 16707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 08:56:19.304443 16707 hybrid_clock.cc:648] HybridClock initialized: now 1765443379304400 us; error 34 us; skew 500 ppm
I20251211 08:56:19.304719 16707 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251211 08:56:19.306476 16707 webserver.cc:492] Webserver started at http://127.16.78.254:38219/ using document root <none> and password file <none>
I20251211 08:56:19.307056 16707 fs_manager.cc:362] Metadata directory not provided
I20251211 08:56:19.307147 16707 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 08:56:19.307476 16707 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 08:56:19.309495 16707 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/data/instance:
uuid: "085b0c2415494271b2d25656c2bad27b"
format_stamp: "Formatted at 2025-12-11 08:56:19 on dist-test-slave-029v"
I20251211 08:56:19.310220 16707 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/wal/instance:
uuid: "085b0c2415494271b2d25656c2bad27b"
format_stamp: "Formatted at 2025-12-11 08:56:19 on dist-test-slave-029v"
I20251211 08:56:19.314637 16707 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20251211 08:56:19.317437 16721 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:19.318594 16707 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20251211 08:56:19.318744 16707 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/data,/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/wal
uuid: "085b0c2415494271b2d25656c2bad27b"
format_stamp: "Formatted at 2025-12-11 08:56:19 on dist-test-slave-029v"
I20251211 08:56:19.318912 16707 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 08:56:19.332202 16707 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 08:56:19.332859 16707 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 08:56:19.333074 16707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 08:56:19.349754 16707 rpc_server.cc:307] RPC server started. Bound to: 127.16.78.254:42651
I20251211 08:56:19.349779 16772 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.78.254:42651 every 8 connection(s)
I20251211 08:56:19.351020 16707 server_base.cc:1179] Dumped server information to /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/data/info.pb
I20251211 08:56:19.354525 16773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:19.361505 16699 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4FbiYc/build/asan/bin/kudu as pid 16707
I20251211 08:56:19.361768 16699 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/master-0/wal/instance
I20251211 08:56:19.362300 16773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b: Bootstrap starting.
I20251211 08:56:19.365113 16773 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:19.365978 16773 log.cc:826] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b: Log is configured to *not* fsync() on all Append() calls
I20251211 08:56:19.368404 16773 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b: No bootstrap required, opened a new log
I20251211 08:56:19.373167 16773 raft_consensus.cc:359] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085b0c2415494271b2d25656c2bad27b" member_type: VOTER last_known_addr { host: "127.16.78.254" port: 42651 } }
I20251211 08:56:19.373530 16773 raft_consensus.cc:385] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:19.373641 16773 raft_consensus.cc:740] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 085b0c2415494271b2d25656c2bad27b, State: Initialized, Role: FOLLOWER
I20251211 08:56:19.374262 16773 consensus_queue.cc:260] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085b0c2415494271b2d25656c2bad27b" member_type: VOTER last_known_addr { host: "127.16.78.254" port: 42651 } }
I20251211 08:56:19.374504 16773 raft_consensus.cc:399] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20251211 08:56:19.374665 16773 raft_consensus.cc:493] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20251211 08:56:19.374869 16773 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:19.377269 16773 raft_consensus.cc:515] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085b0c2415494271b2d25656c2bad27b" member_type: VOTER last_known_addr { host: "127.16.78.254" port: 42651 } }
I20251211 08:56:19.377799 16773 leader_election.cc:304] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 085b0c2415494271b2d25656c2bad27b; no voters:
I20251211 08:56:19.378417 16773 leader_election.cc:290] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [CANDIDATE]: Term 1 election: Requested vote from peers
I20251211 08:56:19.378515 16778 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 1 FOLLOWER]: Leader election won for term 1
I20251211 08:56:19.379621 16778 raft_consensus.cc:697] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [term 1 LEADER]: Becoming Leader. State: Replica: 085b0c2415494271b2d25656c2bad27b, State: Running, Role: LEADER
I20251211 08:56:19.380111 16778 consensus_queue.cc:237] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085b0c2415494271b2d25656c2bad27b" member_type: VOTER last_known_addr { host: "127.16.78.254" port: 42651 } }
I20251211 08:56:19.380539 16773 sys_catalog.cc:565] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [sys.catalog]: configured and running, proceeding with master startup.
I20251211 08:56:19.382841 16779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "085b0c2415494271b2d25656c2bad27b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085b0c2415494271b2d25656c2bad27b" member_type: VOTER last_known_addr { host: "127.16.78.254" port: 42651 } } }
I20251211 08:56:19.383172 16779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [sys.catalog]: This master's current role is: LEADER
I20251211 08:56:19.382907 16780 sys_catalog.cc:455] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 085b0c2415494271b2d25656c2bad27b. Latest consensus state: current_term: 1 leader_uuid: "085b0c2415494271b2d25656c2bad27b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085b0c2415494271b2d25656c2bad27b" member_type: VOTER last_known_addr { host: "127.16.78.254" port: 42651 } } }
I20251211 08:56:19.383487 16780 sys_catalog.cc:458] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b [sys.catalog]: This master's current role is: LEADER
I20251211 08:56:19.385058 16787 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251211 08:56:19.390400 16787 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251211 08:56:19.402089 16787 catalog_manager.cc:1357] Generated new cluster ID: 38d0e09a1fa543519e679d890eb0dc38
I20251211 08:56:19.402185 16787 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251211 08:56:19.419770 16787 catalog_manager.cc:1380] Generated new certificate authority record
I20251211 08:56:19.421175 16787 catalog_manager.cc:1514] Loading token signing keys...
I20251211 08:56:19.429723 16787 catalog_manager.cc:6027] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b: Generated new TSK 0
I20251211 08:56:19.430558 16787 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251211 08:56:19.445292 16699 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4FbiYc/build/asan/bin/kudu
/tmp/dist-test-task4FbiYc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.78.193:0
--local_ip_for_outbound_sockets=127.16.78.193
--webserver_interface=127.16.78.193
--webserver_port=0
--tserver_master_addrs=127.16.78.254:42651
--builtin_ntp_servers=127.16.78.212:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20251211 08:56:19.734872 16797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 08:56:19.735128 16797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 08:56:19.735198 16797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 08:56:19.742167 16797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 08:56:19.742285 16797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.78.193
I20251211 08:56:19.750226 16797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.78.212:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.78.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.16.78.193
--webserver_port=0
--tserver_master_addrs=127.16.78.254:42651
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.78.193
--log_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type FASTDEBUG
built by None at 11 Dec 2025 08:43:21 UTC on 24a791456cd2
build id 9460
ASAN enabled
I20251211 08:56:19.751564 16797 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 08:56:19.753278 16797 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 08:56:19.761193 16803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 08:56:19.761132 16802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 08:56:19.761431 16805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 08:56:19.762632 16797 server_base.cc:1047] running on GCE node
I20251211 08:56:19.763118 16797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 08:56:19.763921 16797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 08:56:19.765111 16797 hybrid_clock.cc:648] HybridClock initialized: now 1765443379765071 us; error 30 us; skew 500 ppm
I20251211 08:56:19.765359 16797 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251211 08:56:19.767169 16797 webserver.cc:492] Webserver started at http://127.16.78.193:42483/ using document root <none> and password file <none>
I20251211 08:56:19.767876 16797 fs_manager.cc:362] Metadata directory not provided
I20251211 08:56:19.767975 16797 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 08:56:19.768306 16797 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 08:56:19.770367 16797 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/data/instance:
uuid: "abae4200ad074260bad9b5443faf221d"
format_stamp: "Formatted at 2025-12-11 08:56:19 on dist-test-slave-029v"
I20251211 08:56:19.771010 16797 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/wal/instance:
uuid: "abae4200ad074260bad9b5443faf221d"
format_stamp: "Formatted at 2025-12-11 08:56:19 on dist-test-slave-029v"
I20251211 08:56:19.775861 16797 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20251211 08:56:19.778661 16811 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:19.779872 16797 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251211 08:56:19.780015 16797 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/data,/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/wal
uuid: "abae4200ad074260bad9b5443faf221d"
format_stamp: "Formatted at 2025-12-11 08:56:19 on dist-test-slave-029v"
I20251211 08:56:19.780200 16797 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 08:56:19.823930 16797 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 08:56:19.824703 16797 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 08:56:19.824934 16797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 08:56:19.825783 16797 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 08:56:19.827275 16797 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 08:56:19.827378 16797 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:19.827497 16797 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 08:56:19.827562 16797 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:19.855878 16797 rpc_server.cc:307] RPC server started. Bound to: 127.16.78.193:39101
I20251211 08:56:19.855928 16923 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.78.193:39101 every 8 connection(s)
I20251211 08:56:19.857010 16797 server_base.cc:1179] Dumped server information to /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/data/info.pb
I20251211 08:56:19.861213 16699 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4FbiYc/build/asan/bin/kudu as pid 16797
I20251211 08:56:19.861368 16699 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/wal/instance
I20251211 08:56:19.864437 16699 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4FbiYc/build/asan/bin/kudu
/tmp/dist-test-task4FbiYc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.78.194:0
--local_ip_for_outbound_sockets=127.16.78.194
--webserver_interface=127.16.78.194
--webserver_port=0
--tserver_master_addrs=127.16.78.254:42651
--builtin_ntp_servers=127.16.78.212:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251211 08:56:19.868512 16924 heartbeater.cc:344] Connected to a master server at 127.16.78.254:42651
I20251211 08:56:19.868778 16924 heartbeater.cc:461] Registering TS with master...
I20251211 08:56:19.869412 16924 heartbeater.cc:507] Master 127.16.78.254:42651 requested a full tablet report, sending...
I20251211 08:56:19.871142 16738 ts_manager.cc:194] Registered new tserver with Master: abae4200ad074260bad9b5443faf221d (127.16.78.193:39101)
I20251211 08:56:19.872535 16738 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.78.193:52183
W20251211 08:56:20.145459 16927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 08:56:20.145718 16927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 08:56:20.145785 16927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 08:56:20.153388 16927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 08:56:20.153519 16927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.78.194
I20251211 08:56:20.161723 16927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.78.212:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.78.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.16.78.194
--webserver_port=0
--tserver_master_addrs=127.16.78.254:42651
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.78.194
--log_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type FASTDEBUG
built by None at 11 Dec 2025 08:43:21 UTC on 24a791456cd2
build id 9460
ASAN enabled
I20251211 08:56:20.163069 16927 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 08:56:20.164640 16927 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 08:56:20.173168 16933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 08:56:20.173133 16932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 08:56:20.173200 16935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 08:56:20.173918 16927 server_base.cc:1047] running on GCE node
I20251211 08:56:20.174371 16927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 08:56:20.175122 16927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 08:56:20.176314 16927 hybrid_clock.cc:648] HybridClock initialized: now 1765443380176261 us; error 41 us; skew 500 ppm
I20251211 08:56:20.176591 16927 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251211 08:56:20.178426 16927 webserver.cc:492] Webserver started at http://127.16.78.194:38637/ using document root <none> and password file <none>
I20251211 08:56:20.179068 16927 fs_manager.cc:362] Metadata directory not provided
I20251211 08:56:20.179162 16927 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 08:56:20.179510 16927 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 08:56:20.181695 16927 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/data/instance:
uuid: "1d826daf06f24df5822713cef1bda18e"
format_stamp: "Formatted at 2025-12-11 08:56:20 on dist-test-slave-029v"
I20251211 08:56:20.182315 16927 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/wal/instance:
uuid: "1d826daf06f24df5822713cef1bda18e"
format_stamp: "Formatted at 2025-12-11 08:56:20 on dist-test-slave-029v"
I20251211 08:56:20.186707 16927 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20251211 08:56:20.189453 16941 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:20.190548 16927 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251211 08:56:20.190692 16927 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/data,/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/wal
uuid: "1d826daf06f24df5822713cef1bda18e"
format_stamp: "Formatted at 2025-12-11 08:56:20 on dist-test-slave-029v"
I20251211 08:56:20.190850 16927 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 08:56:20.207599 16927 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 08:56:20.208245 16927 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 08:56:20.208454 16927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 08:56:20.209259 16927 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 08:56:20.210618 16927 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 08:56:20.210716 16927 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:20.210811 16927 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 08:56:20.210889 16927 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:20.240052 16927 rpc_server.cc:307] RPC server started. Bound to: 127.16.78.194:37893
I20251211 08:56:20.240101 17053 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.78.194:37893 every 8 connection(s)
I20251211 08:56:20.241251 16927 server_base.cc:1179] Dumped server information to /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/data/info.pb
I20251211 08:56:20.249956 16699 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4FbiYc/build/asan/bin/kudu as pid 16927
I20251211 08:56:20.250156 16699 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/wal/instance
I20251211 08:56:20.252935 17054 heartbeater.cc:344] Connected to a master server at 127.16.78.254:42651
I20251211 08:56:20.253293 17054 heartbeater.cc:461] Registering TS with master...
I20251211 08:56:20.253330 16699 external_mini_cluster.cc:1366] Running /tmp/dist-test-task4FbiYc/build/asan/bin/kudu
/tmp/dist-test-task4FbiYc/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.16.78.195:0
--local_ip_for_outbound_sockets=127.16.78.195
--webserver_interface=127.16.78.195
--webserver_port=0
--tserver_master_addrs=127.16.78.254:42651
--builtin_ntp_servers=127.16.78.212:45283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20251211 08:56:20.254207 17054 heartbeater.cc:507] Master 127.16.78.254:42651 requested a full tablet report, sending...
I20251211 08:56:20.255694 16738 ts_manager.cc:194] Registered new tserver with Master: 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893)
I20251211 08:56:20.256676 16738 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.78.194:49887
W20251211 08:56:20.547355 17057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251211 08:56:20.547657 17057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251211 08:56:20.547772 17057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251211 08:56:20.555258 17057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251211 08:56:20.555470 17057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.16.78.195
I20251211 08:56:20.563972 17057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.16.78.212:45283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.16.78.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.16.78.195
--webserver_port=0
--tserver_master_addrs=127.16.78.254:42651
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.16.78.195
--log_dir=/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 468897755969d686fb08386f42f7835685e7953a
build type FASTDEBUG
built by None at 11 Dec 2025 08:43:21 UTC on 24a791456cd2
build id 9460
ASAN enabled
I20251211 08:56:20.565313 17057 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251211 08:56:20.566907 17057 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251211 08:56:20.574456 17062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 08:56:20.574469 17063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251211 08:56:20.574932 17065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251211 08:56:20.575438 17057 server_base.cc:1047] running on GCE node
I20251211 08:56:20.575875 17057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251211 08:56:20.576606 17057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251211 08:56:20.577798 17057 hybrid_clock.cc:648] HybridClock initialized: now 1765443380577750 us; error 35 us; skew 500 ppm
I20251211 08:56:20.578070 17057 server_base.cc:847] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20251211 08:56:20.579917 17057 webserver.cc:492] Webserver started at http://127.16.78.195:43031/ using document root <none> and password file <none>
I20251211 08:56:20.580549 17057 fs_manager.cc:362] Metadata directory not provided
I20251211 08:56:20.580637 17057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251211 08:56:20.580951 17057 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251211 08:56:20.583006 17057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/data/instance:
uuid: "4d7838e032df4c42aea1da486a5d1647"
format_stamp: "Formatted at 2025-12-11 08:56:20 on dist-test-slave-029v"
I20251211 08:56:20.583686 17057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/wal/instance:
uuid: "4d7838e032df4c42aea1da486a5d1647"
format_stamp: "Formatted at 2025-12-11 08:56:20 on dist-test-slave-029v"
I20251211 08:56:20.587992 17057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20251211 08:56:20.590721 17071 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:20.591825 17057 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251211 08:56:20.591948 17057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/data,/tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/wal
uuid: "4d7838e032df4c42aea1da486a5d1647"
format_stamp: "Formatted at 2025-12-11 08:56:20 on dist-test-slave-029v"
I20251211 08:56:20.592104 17057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251211 08:56:20.624989 17057 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251211 08:56:20.625892 17057 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251211 08:56:20.626134 17057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251211 08:56:20.627068 17057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251211 08:56:20.628727 17057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251211 08:56:20.628821 17057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:20.628907 17057 ts_tablet_manager.cc:616] Registered 0 tablets
I20251211 08:56:20.628973 17057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251211 08:56:20.662000 17057 rpc_server.cc:307] RPC server started. Bound to: 127.16.78.195:34541
I20251211 08:56:20.662058 17183 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.16.78.195:34541 every 8 connection(s)
I20251211 08:56:20.663235 17057 server_base.cc:1179] Dumped server information to /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/data/info.pb
I20251211 08:56:20.673206 16699 external_mini_cluster.cc:1428] Started /tmp/dist-test-task4FbiYc/build/asan/bin/kudu as pid 17057
I20251211 08:56:20.673379 16699 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/wal/instance
I20251211 08:56:20.674474 17184 heartbeater.cc:344] Connected to a master server at 127.16.78.254:42651
I20251211 08:56:20.674805 17184 heartbeater.cc:461] Registering TS with master...
I20251211 08:56:20.675761 17184 heartbeater.cc:507] Master 127.16.78.254:42651 requested a full tablet report, sending...
I20251211 08:56:20.677073 16738 ts_manager.cc:194] Registered new tserver with Master: 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541)
I20251211 08:56:20.677770 16738 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.16.78.195:45947
I20251211 08:56:20.689229 16699 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251211 08:56:20.713486 16699 test_util.cc:276] Using random seed: 1368659959
I20251211 08:56:20.730822 16738 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45358:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251211 08:56:20.732393 16738 catalog_manager.cc:7016] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251211 08:56:20.771704 16858 tablet_service.cc:1505] Processing CreateTablet for tablet b1d75162aeef43c789f254f93651eb9b (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 08:56:20.771714 17119 tablet_service.cc:1505] Processing CreateTablet for tablet a0710b72372646389aebae5075cf5ebe (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 08:56:20.771700 16988 tablet_service.cc:1505] Processing CreateTablet for tablet b1d75162aeef43c789f254f93651eb9b (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 08:56:20.772646 17117 tablet_service.cc:1505] Processing CreateTablet for tablet 598c1c7266214e91bedccc6bf6ad3e13 (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 08:56:20.773324 16988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d75162aeef43c789f254f93651eb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.773343 16858 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d75162aeef43c789f254f93651eb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.773352 17119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0710b72372646389aebae5075cf5ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.774192 16859 tablet_service.cc:1505] Processing CreateTablet for tablet a0710b72372646389aebae5075cf5ebe (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 08:56:20.774714 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0710b72372646389aebae5075cf5ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.775389 17116 tablet_service.cc:1505] Processing CreateTablet for tablet ec97e605e5284080ac93c3e52524267d (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 08:56:20.775841 17116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec97e605e5284080ac93c3e52524267d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.775774 16856 tablet_service.cc:1505] Processing CreateTablet for tablet ec97e605e5284080ac93c3e52524267d (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 08:56:20.776144 16856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec97e605e5284080ac93c3e52524267d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.771853 16857 tablet_service.cc:1505] Processing CreateTablet for tablet 598c1c7266214e91bedccc6bf6ad3e13 (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 08:56:20.776868 16857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598c1c7266214e91bedccc6bf6ad3e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.777194 16987 tablet_service.cc:1505] Processing CreateTablet for tablet 598c1c7266214e91bedccc6bf6ad3e13 (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20251211 08:56:20.777401 17118 tablet_service.cc:1505] Processing CreateTablet for tablet b1d75162aeef43c789f254f93651eb9b (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 08:56:20.777766 16987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598c1c7266214e91bedccc6bf6ad3e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.777930 17118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d75162aeef43c789f254f93651eb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.780273 17117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 598c1c7266214e91bedccc6bf6ad3e13. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.781698 16986 tablet_service.cc:1505] Processing CreateTablet for tablet ec97e605e5284080ac93c3e52524267d (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20251211 08:56:20.782105 16986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec97e605e5284080ac93c3e52524267d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.785172 16989 tablet_service.cc:1505] Processing CreateTablet for tablet a0710b72372646389aebae5075cf5ebe (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION VALUES < 536870911
I20251211 08:56:20.785727 16989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0710b72372646389aebae5075cf5ebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:20.808205 17213 tablet_bootstrap.cc:492] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Bootstrap starting.
I20251211 08:56:20.810228 17214 tablet_bootstrap.cc:492] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d: Bootstrap starting.
I20251211 08:56:20.811108 17213 tablet_bootstrap.cc:654] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.812429 17213 log.cc:826] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Log is configured to *not* fsync() on all Append() calls
I20251211 08:56:20.814950 17214 tablet_bootstrap.cc:654] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.816695 17214 log.cc:826] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d: Log is configured to *not* fsync() on all Append() calls
I20251211 08:56:20.821559 17214 tablet_bootstrap.cc:492] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d: No bootstrap required, opened a new log
I20251211 08:56:20.821560 17213 tablet_bootstrap.cc:492] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: No bootstrap required, opened a new log
I20251211 08:56:20.821817 17214 ts_tablet_manager.cc:1403] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s
I20251211 08:56:20.821810 17213 ts_tablet_manager.cc:1403] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.013s
I20251211 08:56:20.828462 17214 raft_consensus.cc:359] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.828801 17214 raft_consensus.cc:385] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.828886 17212 tablet_bootstrap.cc:492] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647: Bootstrap starting.
I20251211 08:56:20.828899 17214 raft_consensus.cc:740] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abae4200ad074260bad9b5443faf221d, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.829150 17213 raft_consensus.cc:359] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.829452 17213 raft_consensus.cc:385] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.829569 17213 raft_consensus.cc:740] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d826daf06f24df5822713cef1bda18e, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.829468 17214 consensus_queue.cc:260] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.830199 17213 consensus_queue.cc:260] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.831312 17054 heartbeater.cc:499] Master 127.16.78.254:42651 was elected leader, sending a full tablet report...
I20251211 08:56:20.831597 17212 tablet_bootstrap.cc:654] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.832362 17212 log.cc:826] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647: Log is configured to *not* fsync() on all Append() calls
I20251211 08:56:20.833918 17213 ts_tablet_manager.cc:1434] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Time spent starting tablet: real 0.012s user 0.005s sys 0.003s
I20251211 08:56:20.834390 17213 tablet_bootstrap.cc:492] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e: Bootstrap starting.
I20251211 08:56:20.834919 17212 tablet_bootstrap.cc:492] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647: No bootstrap required, opened a new log
I20251211 08:56:20.835224 17212 ts_tablet_manager.cc:1403] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20251211 08:56:20.836392 17213 tablet_bootstrap.cc:654] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.838829 16924 heartbeater.cc:499] Master 127.16.78.254:42651 was elected leader, sending a full tablet report...
I20251211 08:56:20.838932 17214 ts_tablet_manager.cc:1434] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d: Time spent starting tablet: real 0.017s user 0.008s sys 0.010s
I20251211 08:56:20.839249 17214 tablet_bootstrap.cc:492] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d: Bootstrap starting.
I20251211 08:56:20.840865 17214 tablet_bootstrap.cc:654] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.842293 17212 raft_consensus.cc:359] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.842599 17212 raft_consensus.cc:385] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.842700 17212 raft_consensus.cc:740] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7838e032df4c42aea1da486a5d1647, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.842953 17213 tablet_bootstrap.cc:492] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e: No bootstrap required, opened a new log
I20251211 08:56:20.843106 17213 ts_tablet_manager.cc:1403] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s
I20251211 08:56:20.843214 17212 consensus_queue.cc:260] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.844238 17213 raft_consensus.cc:359] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.844506 17213 raft_consensus.cc:385] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.844669 17213 raft_consensus.cc:740] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d826daf06f24df5822713cef1bda18e, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.844978 17213 consensus_queue.cc:260] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.845508 17213 ts_tablet_manager.cc:1434] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251211 08:56:20.845800 17213 tablet_bootstrap.cc:492] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e: Bootstrap starting.
I20251211 08:56:20.847970 17213 tablet_bootstrap.cc:654] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.852311 17184 heartbeater.cc:499] Master 127.16.78.254:42651 was elected leader, sending a full tablet report...
I20251211 08:56:20.852370 17214 tablet_bootstrap.cc:492] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d: No bootstrap required, opened a new log
I20251211 08:56:20.852500 17214 ts_tablet_manager.cc:1403] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.012s
I20251211 08:56:20.852921 17212 ts_tablet_manager.cc:1434] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647: Time spent starting tablet: real 0.018s user 0.011s sys 0.005s
I20251211 08:56:20.853287 17212 tablet_bootstrap.cc:492] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647: Bootstrap starting.
I20251211 08:56:20.853338 17214 raft_consensus.cc:359] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.853500 17214 raft_consensus.cc:385] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.853574 17214 raft_consensus.cc:740] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abae4200ad074260bad9b5443faf221d, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.853696 17213 tablet_bootstrap.cc:492] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e: No bootstrap required, opened a new log
I20251211 08:56:20.853744 17214 consensus_queue.cc:260] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.853842 17213 ts_tablet_manager.cc:1403] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20251211 08:56:20.854254 17214 ts_tablet_manager.cc:1434] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251211 08:56:20.854470 17214 tablet_bootstrap.cc:492] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d: Bootstrap starting.
I20251211 08:56:20.854525 17213 raft_consensus.cc:359] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.854701 17213 raft_consensus.cc:385] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.854763 17213 raft_consensus.cc:740] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d826daf06f24df5822713cef1bda18e, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.854867 17212 tablet_bootstrap.cc:654] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.855036 17213 consensus_queue.cc:260] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.855962 17214 tablet_bootstrap.cc:654] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.856309 17213 ts_tablet_manager.cc:1434] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251211 08:56:20.856595 17213 tablet_bootstrap.cc:492] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e: Bootstrap starting.
I20251211 08:56:20.858103 17213 tablet_bootstrap.cc:654] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e: Neither blocks nor log segments found. Creating new log.
W20251211 08:56:20.862844 16925 tablet.cc:2378] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 08:56:20.886018 17212 tablet_bootstrap.cc:492] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647: No bootstrap required, opened a new log
I20251211 08:56:20.886150 17213 tablet_bootstrap.cc:492] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e: No bootstrap required, opened a new log
I20251211 08:56:20.886157 17212 ts_tablet_manager.cc:1403] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647: Time spent bootstrapping tablet: real 0.033s user 0.009s sys 0.022s
I20251211 08:56:20.886288 17213 ts_tablet_manager.cc:1403] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.020s
I20251211 08:56:20.886858 17212 raft_consensus.cc:359] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.886994 17212 raft_consensus.cc:385] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.886945 17213 raft_consensus.cc:359] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.887079 17213 raft_consensus.cc:385] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.887074 17212 raft_consensus.cc:740] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7838e032df4c42aea1da486a5d1647, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.887153 17213 raft_consensus.cc:740] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d826daf06f24df5822713cef1bda18e, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.887282 17212 consensus_queue.cc:260] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.887718 17212 ts_tablet_manager.cc:1434] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251211 08:56:20.887684 17213 consensus_queue.cc:260] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.887960 17212 tablet_bootstrap.cc:492] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647: Bootstrap starting.
I20251211 08:56:20.888780 17214 tablet_bootstrap.cc:492] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d: No bootstrap required, opened a new log
I20251211 08:56:20.888967 17214 ts_tablet_manager.cc:1403] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.024s
I20251211 08:56:20.889065 17213 ts_tablet_manager.cc:1434] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20251211 08:56:20.889458 17212 tablet_bootstrap.cc:654] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.889801 17214 raft_consensus.cc:359] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.889971 17214 raft_consensus.cc:385] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.890049 17214 raft_consensus.cc:740] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abae4200ad074260bad9b5443faf221d, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.890594 17217 raft_consensus.cc:493] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 08:56:20.890825 17217 raft_consensus.cc:515] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.893127 17217 leader_election.cc:290] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893), 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541)
I20251211 08:56:20.895079 17214 consensus_queue.cc:260] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.895726 17214 ts_tablet_manager.cc:1434] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s
I20251211 08:56:20.896036 17214 tablet_bootstrap.cc:492] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Bootstrap starting.
I20251211 08:56:20.897087 17212 tablet_bootstrap.cc:492] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647: No bootstrap required, opened a new log
I20251211 08:56:20.897230 17212 ts_tablet_manager.cc:1403] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20251211 08:56:20.897912 17214 tablet_bootstrap.cc:654] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.897914 17212 raft_consensus.cc:359] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.898077 17212 raft_consensus.cc:385] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.898152 17212 raft_consensus.cc:740] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7838e032df4c42aea1da486a5d1647, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.898404 17212 consensus_queue.cc:260] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.898876 17212 ts_tablet_manager.cc:1434] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20251211 08:56:20.899736 17212 tablet_bootstrap.cc:492] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Bootstrap starting.
I20251211 08:56:20.901543 17212 tablet_bootstrap.cc:654] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:20.904904 17009 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0710b72372646389aebae5075cf5ebe" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d826daf06f24df5822713cef1bda18e" is_pre_election: true
I20251211 08:56:20.905472 17009 raft_consensus.cc:2468] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 0.
I20251211 08:56:20.905901 17214 tablet_bootstrap.cc:492] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: No bootstrap required, opened a new log
I20251211 08:56:20.906069 17214 ts_tablet_manager.cc:1403] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20251211 08:56:20.906280 16814 leader_election.cc:304] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d826daf06f24df5822713cef1bda18e, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:20.906755 17217 raft_consensus.cc:2804] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 08:56:20.906843 17214 raft_consensus.cc:359] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.906924 17217 raft_consensus.cc:493] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 08:56:20.907006 17214 raft_consensus.cc:385] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.907053 17217 raft_consensus.cc:3060] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:20.907110 17214 raft_consensus.cc:740] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abae4200ad074260bad9b5443faf221d, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.907352 17214 consensus_queue.cc:260] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.909649 17212 tablet_bootstrap.cc:492] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: No bootstrap required, opened a new log
I20251211 08:56:20.909775 17212 ts_tablet_manager.cc:1403] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.008s
I20251211 08:56:20.909931 17217 raft_consensus.cc:515] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.910394 17212 raft_consensus.cc:359] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.910517 17217 leader_election.cc:290] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 election: Requested vote from peers 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893), 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541)
I20251211 08:56:20.910544 17212 raft_consensus.cc:385] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:20.910619 17212 raft_consensus.cc:740] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7838e032df4c42aea1da486a5d1647, State: Initialized, Role: FOLLOWER
I20251211 08:56:20.910804 17212 consensus_queue.cc:260] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.911228 17212 ts_tablet_manager.cc:1434] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251211 08:56:20.912009 17139 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0710b72372646389aebae5075cf5ebe" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7838e032df4c42aea1da486a5d1647" is_pre_election: true
I20251211 08:56:20.912032 17138 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0710b72372646389aebae5075cf5ebe" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7838e032df4c42aea1da486a5d1647"
I20251211 08:56:20.912477 17138 raft_consensus.cc:3060] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:20.913966 17214 ts_tablet_manager.cc:1434] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20251211 08:56:20.914273 17009 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a0710b72372646389aebae5075cf5ebe" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d826daf06f24df5822713cef1bda18e"
I20251211 08:56:20.914434 17009 raft_consensus.cc:3060] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:20.915014 17138 raft_consensus.cc:2468] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 1.
W20251211 08:56:20.915385 17185 tablet.cc:2378] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 08:56:20.915443 16813 leader_election.cc:304] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7838e032df4c42aea1da486a5d1647, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:20.916422 17232 raft_consensus.cc:2804] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 08:56:20.916586 17232 raft_consensus.cc:697] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [term 1 LEADER]: Becoming Leader. State: Replica: abae4200ad074260bad9b5443faf221d, State: Running, Role: LEADER
I20251211 08:56:20.916790 17009 raft_consensus.cc:2468] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 1.
I20251211 08:56:20.917016 17232 consensus_queue.cc:237] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.920846 16738 catalog_manager.cc:5654] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d reported cstate change: term changed from 0 to 1, leader changed from <none> to abae4200ad074260bad9b5443faf221d (127.16.78.193). New cstate: current_term: 1 leader_uuid: "abae4200ad074260bad9b5443faf221d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } health_report { overall_health: UNKNOWN } } }
I20251211 08:56:20.928563 17222 raft_consensus.cc:493] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 08:56:20.928684 17222 raft_consensus.cc:515] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.929872 17222 leader_election.cc:290] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abae4200ad074260bad9b5443faf221d (127.16.78.193:39101), 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893)
I20251211 08:56:20.934907 16879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "598c1c7266214e91bedccc6bf6ad3e13" candidate_uuid: "4d7838e032df4c42aea1da486a5d1647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abae4200ad074260bad9b5443faf221d" is_pre_election: true
I20251211 08:56:20.935213 16879 raft_consensus.cc:2468] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7838e032df4c42aea1da486a5d1647 in term 0.
I20251211 08:56:20.935460 17009 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "598c1c7266214e91bedccc6bf6ad3e13" candidate_uuid: "4d7838e032df4c42aea1da486a5d1647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d826daf06f24df5822713cef1bda18e" is_pre_election: true
I20251211 08:56:20.935667 17009 raft_consensus.cc:2468] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4d7838e032df4c42aea1da486a5d1647 in term 0.
I20251211 08:56:20.935712 17073 leader_election.cc:304] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7838e032df4c42aea1da486a5d1647, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:20.936048 17222 raft_consensus.cc:2804] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 08:56:20.936153 17222 raft_consensus.cc:493] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 08:56:20.936244 17222 raft_consensus.cc:3060] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:20.937877 17222 raft_consensus.cc:515] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.938318 17222 leader_election.cc:290] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [CANDIDATE]: Term 1 election: Requested vote from peers abae4200ad074260bad9b5443faf221d (127.16.78.193:39101), 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893)
I20251211 08:56:20.938634 16879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "598c1c7266214e91bedccc6bf6ad3e13" candidate_uuid: "4d7838e032df4c42aea1da486a5d1647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abae4200ad074260bad9b5443faf221d"
I20251211 08:56:20.938699 17009 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "598c1c7266214e91bedccc6bf6ad3e13" candidate_uuid: "4d7838e032df4c42aea1da486a5d1647" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d826daf06f24df5822713cef1bda18e"
I20251211 08:56:20.938776 16879 raft_consensus.cc:3060] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:20.938846 17009 raft_consensus.cc:3060] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:20.940850 17009 raft_consensus.cc:2468] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7838e032df4c42aea1da486a5d1647 in term 1.
I20251211 08:56:20.940928 16879 raft_consensus.cc:2468] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4d7838e032df4c42aea1da486a5d1647 in term 1.
I20251211 08:56:20.941229 17073 leader_election.cc:304] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1d826daf06f24df5822713cef1bda18e, 4d7838e032df4c42aea1da486a5d1647, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:20.941483 17222 raft_consensus.cc:2804] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Leader election won for term 1
I20251211 08:56:20.941828 17222 raft_consensus.cc:697] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [term 1 LEADER]: Becoming Leader. State: Replica: 4d7838e032df4c42aea1da486a5d1647, State: Running, Role: LEADER
I20251211 08:56:20.942181 17222 consensus_queue.cc:237] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:20.946156 16738 catalog_manager.cc:5654] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195). New cstate: current_term: 1 leader_uuid: "4d7838e032df4c42aea1da486a5d1647" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } health_report { overall_health: HEALTHY } } }
W20251211 08:56:20.993029 17055 tablet.cc:2378] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251211 08:56:21.013173 17232 raft_consensus.cc:493] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 08:56:21.013356 17232 raft_consensus.cc:515] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:21.013929 17232 leader_election.cc:290] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893), 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541)
I20251211 08:56:21.014459 17138 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1d75162aeef43c789f254f93651eb9b" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7838e032df4c42aea1da486a5d1647" is_pre_election: true
I20251211 08:56:21.014447 17009 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1d75162aeef43c789f254f93651eb9b" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d826daf06f24df5822713cef1bda18e" is_pre_election: true
I20251211 08:56:21.014675 17009 raft_consensus.cc:2468] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 0.
I20251211 08:56:21.014688 17138 raft_consensus.cc:2468] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 0.
I20251211 08:56:21.015060 16814 leader_election.cc:304] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1d826daf06f24df5822713cef1bda18e, 4d7838e032df4c42aea1da486a5d1647, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:21.015319 17232 raft_consensus.cc:2804] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 08:56:21.015425 17232 raft_consensus.cc:493] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 08:56:21.015533 17232 raft_consensus.cc:3060] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:21.017345 17232 raft_consensus.cc:515] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:21.017813 17232 leader_election.cc:290] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 election: Requested vote from peers 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893), 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541)
I20251211 08:56:21.018127 17009 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1d75162aeef43c789f254f93651eb9b" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d826daf06f24df5822713cef1bda18e"
I20251211 08:56:21.018186 17138 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1d75162aeef43c789f254f93651eb9b" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7838e032df4c42aea1da486a5d1647"
I20251211 08:56:21.018268 17009 raft_consensus.cc:3060] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:21.018334 17138 raft_consensus.cc:3060] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:21.019961 17009 raft_consensus.cc:2468] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 1.
I20251211 08:56:21.019985 17138 raft_consensus.cc:2468] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 1.
I20251211 08:56:21.020303 16813 leader_election.cc:304] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4d7838e032df4c42aea1da486a5d1647, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:21.020509 17232 raft_consensus.cc:2804] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 08:56:21.020658 17232 raft_consensus.cc:697] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 1 LEADER]: Becoming Leader. State: Replica: abae4200ad074260bad9b5443faf221d, State: Running, Role: LEADER
I20251211 08:56:21.020884 17232 consensus_queue.cc:237] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:21.023126 16738 catalog_manager.cc:5654] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d reported cstate change: term changed from 0 to 1, leader changed from <none> to abae4200ad074260bad9b5443faf221d (127.16.78.193). New cstate: current_term: 1 leader_uuid: "abae4200ad074260bad9b5443faf221d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } health_report { overall_health: UNKNOWN } } }
I20251211 08:56:21.108850 17218 raft_consensus.cc:493] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 08:56:21.109011 17218 raft_consensus.cc:515] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:21.110527 17218 leader_election.cc:290] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abae4200ad074260bad9b5443faf221d (127.16.78.193:39101), 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541)
I20251211 08:56:21.116308 16879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec97e605e5284080ac93c3e52524267d" candidate_uuid: "1d826daf06f24df5822713cef1bda18e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abae4200ad074260bad9b5443faf221d" is_pre_election: true
I20251211 08:56:21.116556 16879 raft_consensus.cc:2468] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d826daf06f24df5822713cef1bda18e in term 0.
I20251211 08:56:21.116722 17138 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec97e605e5284080ac93c3e52524267d" candidate_uuid: "1d826daf06f24df5822713cef1bda18e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7838e032df4c42aea1da486a5d1647" is_pre_election: true
I20251211 08:56:21.116935 17138 raft_consensus.cc:2468] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d826daf06f24df5822713cef1bda18e in term 0.
I20251211 08:56:21.116971 16943 leader_election.cc:304] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d826daf06f24df5822713cef1bda18e, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:21.117326 17218 raft_consensus.cc:2804] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 08:56:21.117439 17218 raft_consensus.cc:493] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 08:56:21.117519 17218 raft_consensus.cc:3060] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:21.119184 17218 raft_consensus.cc:515] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:21.119668 17218 leader_election.cc:290] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [CANDIDATE]: Term 1 election: Requested vote from peers abae4200ad074260bad9b5443faf221d (127.16.78.193:39101), 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541)
I20251211 08:56:21.120052 16879 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec97e605e5284080ac93c3e52524267d" candidate_uuid: "1d826daf06f24df5822713cef1bda18e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abae4200ad074260bad9b5443faf221d"
I20251211 08:56:21.120110 17138 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ec97e605e5284080ac93c3e52524267d" candidate_uuid: "1d826daf06f24df5822713cef1bda18e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7838e032df4c42aea1da486a5d1647"
I20251211 08:56:21.120209 16879 raft_consensus.cc:3060] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:21.120247 17138 raft_consensus.cc:3060] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:21.121749 17138 raft_consensus.cc:2468] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d826daf06f24df5822713cef1bda18e in term 1.
I20251211 08:56:21.121788 16879 raft_consensus.cc:2468] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d826daf06f24df5822713cef1bda18e in term 1.
I20251211 08:56:21.122017 16943 leader_election.cc:304] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d826daf06f24df5822713cef1bda18e, 4d7838e032df4c42aea1da486a5d1647; no voters:
I20251211 08:56:21.122256 17218 raft_consensus.cc:2804] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Leader election won for term 1
I20251211 08:56:21.122578 17218 raft_consensus.cc:697] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [term 1 LEADER]: Becoming Leader. State: Replica: 1d826daf06f24df5822713cef1bda18e, State: Running, Role: LEADER
I20251211 08:56:21.122997 17218 consensus_queue.cc:237] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } }
I20251211 08:56:21.126715 16738 catalog_manager.cc:5654] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d826daf06f24df5822713cef1bda18e (127.16.78.194). New cstate: current_term: 1 leader_uuid: "1d826daf06f24df5822713cef1bda18e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } health_report { overall_health: UNKNOWN } } }
I20251211 08:56:21.261129 17138 raft_consensus.cc:1275] T ec97e605e5284080ac93c3e52524267d P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Refusing update from remote peer 1d826daf06f24df5822713cef1bda18e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 08:56:21.261188 16879 raft_consensus.cc:1275] T ec97e605e5284080ac93c3e52524267d P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Refusing update from remote peer 1d826daf06f24df5822713cef1bda18e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 08:56:21.262033 17218 consensus_queue.cc:1048] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:21.262732 17218 consensus_queue.cc:1048] T ec97e605e5284080ac93c3e52524267d P 1d826daf06f24df5822713cef1bda18e [LEADER]: Connected to new peer: Peer: permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:21.273104 17009 raft_consensus.cc:1275] T 598c1c7266214e91bedccc6bf6ad3e13 P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Refusing update from remote peer 4d7838e032df4c42aea1da486a5d1647: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 08:56:21.273806 17222 consensus_queue.cc:1048] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:21.276197 17139 raft_consensus.cc:1275] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Refusing update from remote peer abae4200ad074260bad9b5443faf221d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 08:56:21.276846 17232 consensus_queue.cc:1048] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:21.281054 16878 raft_consensus.cc:1275] T 598c1c7266214e91bedccc6bf6ad3e13 P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Refusing update from remote peer 4d7838e032df4c42aea1da486a5d1647: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 08:56:21.281781 17222 consensus_queue.cc:1048] T 598c1c7266214e91bedccc6bf6ad3e13 P 4d7838e032df4c42aea1da486a5d1647 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:21.297569 17258 mvcc.cc:204] Tried to move back new op lower bound from 7231256089685942272 to 7231256088342257664. Current Snapshot: MvccSnapshot[applied={T|T < 7231256089685942272}]
I20251211 08:56:21.297847 17253 mvcc.cc:204] Tried to move back new op lower bound from 7231256089635065856 to 7231256089083015168. Current Snapshot: MvccSnapshot[applied={T|T < 7231256089635065856}]
I20251211 08:56:21.297979 17138 raft_consensus.cc:1275] T a0710b72372646389aebae5075cf5ebe P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Refusing update from remote peer abae4200ad074260bad9b5443faf221d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 08:56:21.298624 17008 raft_consensus.cc:1275] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Refusing update from remote peer abae4200ad074260bad9b5443faf221d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 08:56:21.298702 17007 raft_consensus.cc:1275] T a0710b72372646389aebae5075cf5ebe P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Refusing update from remote peer abae4200ad074260bad9b5443faf221d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251211 08:56:21.299293 17217 consensus_queue.cc:1048] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:21.300175 17217 consensus_queue.cc:1048] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:21.300640 17217 consensus_queue.cc:1048] T a0710b72372646389aebae5075cf5ebe P abae4200ad074260bad9b5443faf221d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:21.313520 17259 mvcc.cc:204] Tried to move back new op lower bound from 7231256089635065856 to 7231256089083015168. Current Snapshot: MvccSnapshot[applied={T|T < 7231256089635065856}]
I20251211 08:56:23.741806 16730 master_service.cc:954] ReplaceTablet: received request to replace tablet b1d75162aeef43c789f254f93651eb9b from {username='slave'} at 127.0.0.1:45350
I20251211 08:56:23.862200 16730 catalog_manager.cc:5941] T 00000000000000000000000000000000 P 085b0c2415494271b2d25656c2bad27b: Sending DeleteTablet for 3 replicas of tablet b1d75162aeef43c789f254f93651eb9b
I20251211 08:56:23.862946 16730 catalog_manager.cc:6724] ReplaceTablet: tablet b1d75162aeef43c789f254f93651eb9b deleted and replaced by tablet 64fd372b44034ad88a69d5739ef18040
I20251211 08:56:23.866490 16858 tablet_service.cc:1552] Processing DeleteTablet for tablet b1d75162aeef43c789f254f93651eb9b with delete_type TABLET_DATA_DELETED (replaced by tablet 64fd372b44034ad88a69d5739ef18040) from {username='slave'} at 127.0.0.1:51632
I20251211 08:56:23.872866 16859 tablet_service.cc:1505] Processing CreateTablet for tablet 64fd372b44034ad88a69d5739ef18040 (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 08:56:23.873273 16859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64fd372b44034ad88a69d5739ef18040. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:23.875710 16988 tablet_service.cc:1505] Processing CreateTablet for tablet 64fd372b44034ad88a69d5739ef18040 (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 08:56:23.876119 16988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64fd372b44034ad88a69d5739ef18040. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:23.876969 16987 tablet_service.cc:1552] Processing DeleteTablet for tablet b1d75162aeef43c789f254f93651eb9b with delete_type TABLET_DATA_DELETED (replaced by tablet 64fd372b44034ad88a69d5739ef18040) from {username='slave'} at 127.0.0.1:49588
I20251211 08:56:23.879340 17119 tablet_service.cc:1552] Processing DeleteTablet for tablet b1d75162aeef43c789f254f93651eb9b with delete_type TABLET_DATA_DELETED (replaced by tablet 64fd372b44034ad88a69d5739ef18040) from {username='slave'} at 127.0.0.1:59782
I20251211 08:56:23.883836 17118 tablet_service.cc:1505] Processing CreateTablet for tablet 64fd372b44034ad88a69d5739ef18040 (DEFAULT_TABLE table=test-workload [id=3453a9de047c49f2ab3abe04dd19236a]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20251211 08:56:23.884217 17118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64fd372b44034ad88a69d5739ef18040. 1 dirs total, 0 dirs full, 0 dirs failed
I20251211 08:56:23.893260 17302 tablet_bootstrap.cc:492] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647: Bootstrap starting.
I20251211 08:56:23.896173 17298 tablet_replica.cc:333] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: stopping tablet replica
I20251211 08:56:23.896663 17298 raft_consensus.cc:2243] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 1 LEADER]: Raft consensus shutting down.
I20251211 08:56:23.899260 17303 tablet_bootstrap.cc:492] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d: Bootstrap starting.
I20251211 08:56:23.899426 17298 pending_rounds.cc:70] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Trying to abort 2 pending ops.
I20251211 08:56:23.900960 17298 pending_rounds.cc:77] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Aborting op as it isn't in flight: id { term: 1 index: 220 } timestamp: 7231256100364845056 op_type: WRITE_OP write_request { tablet_id: "b1d75162aeef43c789f254f93651eb9b" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000W\022\024?\314\016\023\273\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000x7\033;\237\273F5\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000+\276%?n,\336/ \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000}\356\360\'\257\314\227\3410\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\334\032\177&\262r\266B@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\317R@,#\365,\352P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\033\270\247*z\312\310\303`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000`%m;\343\tIrp\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000U{~,b\244\353\371\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\305\255\345+bf\013u\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\213q\013!e\036\n\322\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\355\337\3475\227\264:\317\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000x\205\034!\225\321\301\270\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\222\363\377.s\010^\376\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\2175\2357\302\214\374\265\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""0a4c337b218fab0afe02547615ee5d90783c514c7ffae2d7edb3d387f208f8aa96a861d4115d61d6e68b0352e10e622c9c6666890dab75e052e512567a2dab956204bb74c95ddde4c51f7401a7f22236a4d108c9af2fefa969ea14ad8de7405c30fba3d23180923b0a98a15c551348e62df531a8f91e89fb" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7231256100219781120 authz_token { token_data: "\010\341\220\352\311\006\"3\n\005slave\022*\n 3453a9de047c49f2ab3abe04dd19236a\020\001\030\001 \001(\001" signature: "<redacted>""\006\363\037O\365%\002\272\346[_\336%f\305\302\360\2148\314\035\005SX\206\005Uw\021e\017V\201_\370\024\363\356\304\257\377\025~\3320\210\350\3241\357\352B\244C\004uG\265\006\237\232\275\317\002" signing_key_seq_num: 0 } } request_id { client_id: "5f8b777edda84983be407b5c0d20528e" seq_no: 875 first_incomplete_seq_no: 863 attempt_no: 0 }
W20251211 08:56:23.901803 17298 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51634: Aborted: Op aborted
I20251211 08:56:23.902356 17298 pending_rounds.cc:77] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Aborting op as it isn't in flight: id { term: 1 index: 219 } timestamp: 7231256100359626752 op_type: WRITE_OP write_request { tablet_id: "b1d75162aeef43c789f254f93651eb9b" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\357\001\255*\316P\270\311\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000Z6\301)\306\227\356)\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000)\202\0240\277\371\353z \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\244\267\0232I\323\267\3400\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000N\\\226?.\252F\330@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\013\025o$\241\027\207+P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000-\244\206>\307:\312s`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\263\202}6\307{\221\264p\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000/hj?^*h\336\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000wp\0255\216\211\351\223\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\010\251k3!V\323\324\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000K\344\252\'\036\251\203\233\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\255\370\347&\260it\344\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""44086be489c6d142f152f14778bd0b3a73343b9dd46bf7037755a600300accc328af90b03c884f5c75ebbab58e5dfb1d3a23bf0d81a85a413122639f91752b80e9a554eecad616e3e28b8156e9b0cf4a2b9af91c16b167433efac1958176bca89b33a5c537906ced" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7231256100219781120 authz_token { token_data: "\010\341\220\352\311\006\"3\n\005slave\022*\n 3453a9de047c49f2ab3abe04dd19236a\020\001\030\001 \001(\001" signature: "<redacted>""\006\363\037O\365%\002\272\346[_\336%f\305\302\360\2148\314\035\005SX\206\005Uw\021e\017V\201_\370\024\363\356\304\257\377\025~\3320\210\350\3241\357\352B\244C\004uG\265\006\237\232\275\317\002" signing_key_seq_num: 0 } } request_id { client_id: "5f8b777edda84983be407b5c0d20528e" seq_no: 871 first_incomplete_seq_no: 863 attempt_no: 0 }
W20251211 08:56:23.902848 17298 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:51634: Aborted: Op aborted
I20251211 08:56:23.903141 17298 raft_consensus.cc:2272] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 08:56:23.905350 17298 ts_tablet_manager.cc:1916] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 08:56:23.907785 17300 tablet_replica.cc:333] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: stopping tablet replica
I20251211 08:56:23.906699 17303 tablet_bootstrap.cc:654] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d: Neither blocks nor log segments found. Creating new log.
W20251211 08:56:23.916548 16967 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49604: Illegal state: replica 1d826daf06f24df5822713cef1bda18e is not leader of this config: current role FOLLOWER
I20251211 08:56:23.918110 17299 tablet_replica.cc:333] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: stopping tablet replica
W20251211 08:56:23.918291 16968 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:49604: Illegal state: replica 1d826daf06f24df5822713cef1bda18e is not leader of this config: current role FOLLOWER
I20251211 08:56:23.919713 17299 raft_consensus.cc:2243] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 08:56:23.920010 17299 pending_rounds.cc:70] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Trying to abort 1 pending ops.
I20251211 08:56:23.925014 17300 raft_consensus.cc:2243] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251211 08:56:23.924922 17299 pending_rounds.cc:77] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Aborting op as it isn't in flight: id { term: 1 index: 220 } timestamp: 7231256100364845056 op_type: WRITE_OP write_request { tablet_id: "b1d75162aeef43c789f254f93651eb9b" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000W\022\024?\314\016\023\273\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000x7\033;\237\273F5\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000+\276%?n,\336/ \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000}\356\360\'\257\314\227\3410\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\334\032\177&\262r\266B@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\317R@,#\365,\352P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\033\270\247*z\312\310\303`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000`%m;\343\tIrp\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000U{~,b\244\353\371\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\305\255\345+bf\013u\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\213q\013!e\036\n\322\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\355\337\3475\227\264:\317\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000x\205\034!\225\321\301\270\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\222\363\377.s\010^\376\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\2175\2357\302\214\374\265\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""0a4c337b218fab0afe02547615ee5d90783c514c7ffae2d7edb3d387f208f8aa96a861d4115d61d6e68b0352e10e622c9c6666890dab75e052e512567a2dab956204bb74c95ddde4c51f7401a7f22236a4d108c9af2fefa969ea14ad8de7405c30fba3d23180923b0a98a15c551348e62df531a8f91e89fb" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7231256100219781120 authz_token { token_data: "\010\341\220\352\311\006\"3\n\005slave\022*\n 3453a9de047c49f2ab3abe04dd19236a\020\001\030\001 \001(\001" signature: "<redacted>""\006\363\037O\365%\002\272\346[_\336%f\305\302\360\2148\314\035\005SX\206\005Uw\021e\017V\201_\370\024\363\356\304\257\377\025~\3320\210\350\3241\357\352B\244C\004uG\265\006\237\232\275\317\002" signing_key_seq_num: 0 } } request_id { client_id: "5f8b777edda84983be407b5c0d20528e" seq_no: 875 first_incomplete_seq_no: 863 attempt_no: 0 }
I20251211 08:56:23.925771 17300 pending_rounds.cc:70] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Trying to abort 2 pending ops.
I20251211 08:56:23.925932 17300 pending_rounds.cc:77] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Aborting op as it isn't in flight: id { term: 1 index: 220 } timestamp: 7231256100364845056 op_type: WRITE_OP write_request { tablet_id: "b1d75162aeef43c789f254f93651eb9b" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000W\022\024?\314\016\023\273\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000x7\033;\237\273F5\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000+\276%?n,\336/ \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000}\356\360\'\257\314\227\3410\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\334\032\177&\262r\266B@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\317R@,#\365,\352P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\033\270\247*z\312\310\303`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000`%m;\343\tIrp\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000U{~,b\244\353\371\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\305\255\345+bf\013u\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\213q\013!e\036\n\322\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\355\337\3475\227\264:\317\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000x\205\034!\225\321\301\270\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\222\363\377.s\010^\376\320\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\2175\2357\302\214\374\265\340\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""0a4c337b218fab0afe02547615ee5d90783c514c7ffae2d7edb3d387f208f8aa96a861d4115d61d6e68b0352e10e622c9c6666890dab75e052e512567a2dab956204bb74c95ddde4c51f7401a7f22236a4d108c9af2fefa969ea14ad8de7405c30fba3d23180923b0a98a15c551348e62df531a8f91e89fb" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7231256100219781120 authz_token { token_data: "\010\341\220\352\311\006\"3\n\005slave\022*\n 3453a9de047c49f2ab3abe04dd19236a\020\001\030\001 \001(\001" signature: "<redacted>""\006\363\037O\365%\002\272\346[_\336%f\305\302\360\2148\314\035\005SX\206\005Uw\021e\017V\201_\370\024\363\356\304\257\377\025~\3320\210\350\3241\357\352B\244C\004uG\265\006\237\232\275\317\002" signing_key_seq_num: 0 } } request_id { client_id: "5f8b777edda84983be407b5c0d20528e" seq_no: 875 first_incomplete_seq_no: 863 attempt_no: 0 }
I20251211 08:56:23.927481 17300 pending_rounds.cc:77] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Aborting op as it isn't in flight: id { term: 1 index: 219 } timestamp: 7231256100359626752 op_type: WRITE_OP write_request { tablet_id: "b1d75162aeef43c789f254f93651eb9b" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\357\001\255*\316P\270\311\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000Z6\301)\306\227\356)\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000)\202\0240\277\371\353z \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\244\267\0232I\323\267\3400\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000N\\\226?.\252F\330@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\013\025o$\241\027\207+P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000-\244\206>\307:\312s`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\263\202}6\307{\221\264p\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000/hj?^*h\336\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000wp\0255\216\211\351\223\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\010\251k3!V\323\324\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000K\344\252\'\036\251\203\233\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\255\370\347&\260it\344\300\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""44086be489c6d142f152f14778bd0b3a73343b9dd46bf7037755a600300accc328af90b03c884f5c75ebbab58e5dfb1d3a23bf0d81a85a413122639f91752b80e9a554eecad616e3e28b8156e9b0cf4a2b9af91c16b167433efac1958176bca89b33a5c537906ced" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7231256100219781120 authz_token { token_data: "\010\341\220\352\311\006\"3\n\005slave\022*\n 3453a9de047c49f2ab3abe04dd19236a\020\001\030\001 \001(\001" signature: "<redacted>""\006\363\037O\365%\002\272\346[_\336%f\305\302\360\2148\314\035\005SX\206\005Uw\021e\017V\201_\370\024\363\356\304\257\377\025~\3320\210\350\3241\357\352B\244C\004uG\265\006\237\232\275\317\002" signing_key_seq_num: 0 } } request_id { client_id: "5f8b777edda84983be407b5c0d20528e" seq_no: 871 first_incomplete_seq_no: 863 attempt_no: 0 }
I20251211 08:56:23.931641 17300 raft_consensus.cc:2272] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 08:56:23.925191 17302 tablet_bootstrap.cc:654] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:23.940557 17302 tablet_bootstrap.cc:492] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647: No bootstrap required, opened a new log
I20251211 08:56:23.940726 17302 ts_tablet_manager.cc:1403] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.006s
I20251211 08:56:23.941464 17302 raft_consensus.cc:359] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:23.942239 17298 ts_tablet_manager.cc:1929] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.220
I20251211 08:56:23.942391 17302 raft_consensus.cc:385] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:23.942571 17298 log.cc:1199] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Deleting WAL directory at /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-0/wal/wals/b1d75162aeef43c789f254f93651eb9b
I20251211 08:56:23.942724 17302 raft_consensus.cc:740] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7838e032df4c42aea1da486a5d1647, State: Initialized, Role: FOLLOWER
I20251211 08:56:23.943349 17298 ts_tablet_manager.cc:1950] T b1d75162aeef43c789f254f93651eb9b P abae4200ad074260bad9b5443faf221d: Deleting consensus metadata
I20251211 08:56:23.944826 17302 consensus_queue.cc:260] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:23.945048 17300 ts_tablet_manager.cc:1916] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 08:56:23.945411 17302 ts_tablet_manager.cc:1434] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20251211 08:56:23.947011 16723 catalog_manager.cc:4985] TS abae4200ad074260bad9b5443faf221d (127.16.78.193:39101): tablet b1d75162aeef43c789f254f93651eb9b (table test-workload [id=3453a9de047c49f2ab3abe04dd19236a]) successfully deleted
I20251211 08:56:23.950996 17300 ts_tablet_manager.cc:1929] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.220
I20251211 08:56:23.951164 17300 log.cc:1199] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Deleting WAL directory at /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-2/wal/wals/b1d75162aeef43c789f254f93651eb9b
I20251211 08:56:23.951748 17300 ts_tablet_manager.cc:1950] T b1d75162aeef43c789f254f93651eb9b P 4d7838e032df4c42aea1da486a5d1647: Deleting consensus metadata
I20251211 08:56:23.952615 17301 tablet_bootstrap.cc:492] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e: Bootstrap starting.
I20251211 08:56:23.960465 17299 raft_consensus.cc:2272] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251211 08:56:23.959381 16723 catalog_manager.cc:4985] TS 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541): tablet b1d75162aeef43c789f254f93651eb9b (table test-workload [id=3453a9de047c49f2ab3abe04dd19236a]) successfully deleted
I20251211 08:56:23.963485 17301 tablet_bootstrap.cc:654] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e: Neither blocks nor log segments found. Creating new log.
I20251211 08:56:23.965445 17303 tablet_bootstrap.cc:492] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d: No bootstrap required, opened a new log
I20251211 08:56:23.965581 17303 ts_tablet_manager.cc:1403] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d: Time spent bootstrapping tablet: real 0.069s user 0.003s sys 0.013s
I20251211 08:56:23.966332 17303 raft_consensus.cc:359] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:23.966612 17303 raft_consensus.cc:385] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:23.966758 17303 raft_consensus.cc:740] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abae4200ad074260bad9b5443faf221d, State: Initialized, Role: FOLLOWER
I20251211 08:56:23.967036 17303 consensus_queue.cc:260] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:23.967635 17303 ts_tablet_manager.cc:1434] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251211 08:56:23.967916 17299 ts_tablet_manager.cc:1916] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251211 08:56:23.969974 16733 master_service.cc:954] ReplaceTablet: received request to replace tablet b1d75162aeef43c789f254f93651eb9b from {username='slave'} at 127.0.0.1:45350
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/replace_tablet-itest.cc:133: Failure
Failed
Bad status: Not found: Tablet b1d75162aeef43c789f254f93651eb9b already deleted
I20251211 08:56:23.972039 17301 tablet_bootstrap.cc:492] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e: No bootstrap required, opened a new log
I20251211 08:56:23.972227 17301 ts_tablet_manager.cc:1403] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.003s
I20251211 08:56:23.973065 17301 raft_consensus.cc:359] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:23.973276 17301 raft_consensus.cc:385] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251211 08:56:23.973402 17301 raft_consensus.cc:740] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d826daf06f24df5822713cef1bda18e, State: Initialized, Role: FOLLOWER
I20251211 08:56:23.973657 17299 ts_tablet_manager.cc:1929] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.220
I20251211 08:56:23.973687 17301 consensus_queue.cc:260] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:23.973840 17299 log.cc:1199] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Deleting WAL directory at /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0/minicluster-data/ts-1/wal/wals/b1d75162aeef43c789f254f93651eb9b
I20251211 08:56:23.974236 17301 ts_tablet_manager.cc:1434] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251211 08:56:23.975003 17299 ts_tablet_manager.cc:1950] T b1d75162aeef43c789f254f93651eb9b P 1d826daf06f24df5822713cef1bda18e: Deleting consensus metadata
I20251211 08:56:23.976460 16724 catalog_manager.cc:4985] TS 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893): tablet b1d75162aeef43c789f254f93651eb9b (table test-workload [id=3453a9de047c49f2ab3abe04dd19236a]) successfully deleted
I20251211 08:56:24.025497 17278 raft_consensus.cc:493] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251211 08:56:24.025638 17278 raft_consensus.cc:515] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:24.026260 17278 leader_election.cc:290] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541), 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893)
I20251211 08:56:24.026666 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64fd372b44034ad88a69d5739ef18040" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7838e032df4c42aea1da486a5d1647" is_pre_election: true
I20251211 08:56:24.026726 17008 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64fd372b44034ad88a69d5739ef18040" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d826daf06f24df5822713cef1bda18e" is_pre_election: true
I20251211 08:56:24.026875 17137 raft_consensus.cc:2468] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 0.
I20251211 08:56:24.026902 17008 raft_consensus.cc:2468] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 0.
I20251211 08:56:24.027307 16813 leader_election.cc:304] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1d826daf06f24df5822713cef1bda18e, 4d7838e032df4c42aea1da486a5d1647, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:24.027595 17278 raft_consensus.cc:2804] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251211 08:56:24.027717 17278 raft_consensus.cc:493] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251211 08:56:24.027817 17278 raft_consensus.cc:3060] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:24.029604 17278 raft_consensus.cc:515] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:24.030102 17278 leader_election.cc:290] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 election: Requested vote from peers 4d7838e032df4c42aea1da486a5d1647 (127.16.78.195:34541), 1d826daf06f24df5822713cef1bda18e (127.16.78.194:37893)
I20251211 08:56:24.030484 17008 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64fd372b44034ad88a69d5739ef18040" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d826daf06f24df5822713cef1bda18e"
I20251211 08:56:24.030491 17137 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64fd372b44034ad88a69d5739ef18040" candidate_uuid: "abae4200ad074260bad9b5443faf221d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4d7838e032df4c42aea1da486a5d1647"
I20251211 08:56:24.030629 17137 raft_consensus.cc:3060] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647 [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:24.030625 17008 raft_consensus.cc:3060] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e [term 0 FOLLOWER]: Advancing to term 1
I20251211 08:56:24.032815 17137 raft_consensus.cc:2468] T 64fd372b44034ad88a69d5739ef18040 P 4d7838e032df4c42aea1da486a5d1647 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 1.
I20251211 08:56:24.032824 17008 raft_consensus.cc:2468] T 64fd372b44034ad88a69d5739ef18040 P 1d826daf06f24df5822713cef1bda18e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abae4200ad074260bad9b5443faf221d in term 1.
I20251211 08:56:24.033152 16814 leader_election.cc:304] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d826daf06f24df5822713cef1bda18e, abae4200ad074260bad9b5443faf221d; no voters:
I20251211 08:56:24.033387 17278 raft_consensus.cc:2804] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 1 FOLLOWER]: Leader election won for term 1
I20251211 08:56:24.033524 17278 raft_consensus.cc:697] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [term 1 LEADER]: Becoming Leader. State: Replica: abae4200ad074260bad9b5443faf221d, State: Running, Role: LEADER
I20251211 08:56:24.033792 17278 consensus_queue.cc:237] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } }
I20251211 08:56:24.035914 16730 catalog_manager.cc:5654] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d reported cstate change: term changed from 0 to 1, leader changed from <none> to abae4200ad074260bad9b5443faf221d (127.16.78.193). New cstate: current_term: 1 leader_uuid: "abae4200ad074260bad9b5443faf221d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "abae4200ad074260bad9b5443faf221d" member_type: VOTER last_known_addr { host: "127.16.78.193" port: 39101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 } health_report { overall_health: UNKNOWN } } }
I20251211 08:56:24.042618 17200 meta_cache.cc:557] tablet seems to be replaced: former ID b1d75162aeef43c789f254f93651eb9b, new ID 64fd372b44034ad88a69d5739ef18040 (table test-workload)
W20251211 08:56:24.042797 17200 batcher.cc:441] Invalid argument: Failed to write batch of 16 ops to tablet b1d75162aeef43c789f254f93651eb9b after 1 attempt(s): tablet ID b1d75162aeef43c789f254f93651eb9b is not valid
I20251211 08:56:24.044442 17200 meta_cache.cc:557] tablet seems to be replaced: former ID b1d75162aeef43c789f254f93651eb9b, new ID 64fd372b44034ad88a69d5739ef18040 (table test-workload)
I20251211 08:56:24.045867 17200 meta_cache.cc:557] tablet seems to be replaced: former ID b1d75162aeef43c789f254f93651eb9b, new ID 64fd372b44034ad88a69d5739ef18040 (table test-workload)
I20251211 08:56:24.046125 17200 meta_cache.cc:557] tablet seems to be replaced: former ID b1d75162aeef43c789f254f93651eb9b, new ID 64fd372b44034ad88a69d5739ef18040 (table test-workload)
I20251211 08:56:24.047979 16699 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20251211 08:56:24.048143 16699 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID abae4200ad074260bad9b5443faf221d and pid 16797
************************ BEGIN STACKS **************************
I20251211 08:56:24.464529 17278 consensus_queue.cc:1048] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4d7838e032df4c42aea1da486a5d1647" member_type: VOTER last_known_addr { host: "127.16.78.195" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251211 08:56:24.469794 17278 consensus_queue.cc:1048] T 64fd372b44034ad88a69d5739ef18040 P abae4200ad074260bad9b5443faf221d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d826daf06f24df5822713cef1bda18e" member_type: VOTER last_known_addr { host: "127.16.78.194" port: 37893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
[New LWP 16798]
[New LWP 16799]
[New LWP 16800]
[New LWP 16801]
[New LWP 16807]
[New LWP 16808]
[New LWP 16809]
[New LWP 16812]
[New LWP 16813]
[New LWP 16814]
[New LWP 16815]
[New LWP 16816]
[New LWP 16817]
[New LWP 16818]
[New LWP 16819]
[New LWP 16820]
[New LWP 16821]
[New LWP 16822]
[New LWP 16823]
[New LWP 16824]
[New LWP 16825]
[New LWP 16826]
[New LWP 16827]
[New LWP 16828]
[New LWP 16829]
[New LWP 16830]
[New LWP 16831]
[New LWP 16832]
[New LWP 16833]
[New LWP 16834]
[New LWP 16835]
[New LWP 16836]
[New LWP 16837]
[New LWP 16838]
[New LWP 16839]
[New LWP 16840]
[New LWP 16841]
[New LWP 16842]
[New LWP 16843]
[New LWP 16844]
[New LWP 16845]
[New LWP 16846]
[New LWP 16847]
[New LWP 16848]
[New LWP 16849]
[New LWP 16850]
[New LWP 16851]
[New LWP 16852]
[New LWP 16853]
[New LWP 16854]
[New LWP 16855]
[New LWP 16856]
[New LWP 16857]
[New LWP 16858]
[New LWP 16859]
[New LWP 16860]
[New LWP 16861]
[New LWP 16862]
[New LWP 16863]
[New LWP 16864]
[New LWP 16865]
[New LWP 16866]
[New LWP 16867]
[New LWP 16868]
[New LWP 16869]
[New LWP 16870]
[New LWP 16871]
[New LWP 16872]
[New LWP 16873]
[New LWP 16874]
[New LWP 16875]
[New LWP 16876]
[New LWP 16877]
[New LWP 16878]
[New LWP 16879]
[New LWP 16880]
[New LWP 16881]
[New LWP 16882]
[New LWP 16883]
[New LWP 16884]
[New LWP 16885]
[New LWP 16886]
[New LWP 16887]
[New LWP 16888]
[New LWP 16889]
[New LWP 16890]
[New LWP 16891]
[New LWP 16892]
[New LWP 16893]
[New LWP 16894]
[New LWP 16895]
[New LWP 16896]
[New LWP 16897]
[New LWP 16898]
[New LWP 16899]
[New LWP 16900]
[New LWP 16901]
[New LWP 16902]
[New LWP 16903]
[New LWP 16904]
[New LWP 16905]
[New LWP 16906]
[New LWP 16907]
[New LWP 16908]
[New LWP 16909]
[New LWP 16910]
[New LWP 16911]
[New LWP 16912]
[New LWP 16913]
[New LWP 16914]
[New LWP 16915]
[New LWP 16916]
[New LWP 16917]
[New LWP 16918]
[New LWP 16919]
[New LWP 16920]
[New LWP 16921]
[New LWP 16922]
[New LWP 16923]
[New LWP 16924]
[New LWP 16925]
[New LWP 17233]
[New LWP 17256]
[New LWP 17269]
[New LWP 17278]
[New LWP 17287]
[New LWP 17307]
[New LWP 17314]
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f545245454545
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f545245454545
0x00007f576ae10d50 in ?? ()
Id Target Id Frame
* 1 LWP 16797 "kudu" 0x00007f576ae10d50 in ?? ()
2 LWP 16798 "kudu" 0x00007f576ae0cfb9 in ?? ()
3 LWP 16799 "kudu" 0x00007f576ae0cfb9 in ?? ()
4 LWP 16800 "kudu" 0x00007f576ae0cfb9 in ?? ()
5 LWP 16801 "kernel-watcher-" 0x00007f576ae0cfb9 in ?? ()
6 LWP 16807 "ntp client-1680" 0x00007f576ae109e2 in ?? ()
7 LWP 16808 "file cache-evic" 0x00007f576ae0cfb9 in ?? ()
8 LWP 16809 "sq_acceptor" 0x00007f576392acb9 in ?? ()
9 LWP 16812 "rpc reactor-168" 0x00007f5763937a47 in ?? ()
10 LWP 16813 "rpc reactor-168" 0x00007f5763937a47 in ?? ()
11 LWP 16814 "rpc reactor-168" 0x00007f5763937a47 in ?? ()
12 LWP 16815 "rpc reactor-168" 0x00007f5763937a47 in ?? ()
13 LWP 16816 "MaintenanceMgr " 0x00007f576ae0cad3 in ?? ()
14 LWP 16817 "txn-status-mana" 0x00007f576ae0cfb9 in ?? ()
15 LWP 16818 "collect_and_rem" 0x00007f576ae0cfb9 in ?? ()
16 LWP 16819 "tc-session-exp-" 0x00007f576ae0cfb9 in ?? ()
17 LWP 16820 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
18 LWP 16821 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
19 LWP 16822 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
20 LWP 16823 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
21 LWP 16824 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
22 LWP 16825 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
23 LWP 16826 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
24 LWP 16827 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
25 LWP 16828 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
26 LWP 16829 "rpc worker-1682" 0x00007f576ae0cad3 in ?? ()
27 LWP 16830 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
28 LWP 16831 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
29 LWP 16832 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
30 LWP 16833 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
31 LWP 16834 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
32 LWP 16835 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
33 LWP 16836 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
34 LWP 16837 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
35 LWP 16838 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
36 LWP 16839 "rpc worker-1683" 0x00007f576ae0cad3 in ?? ()
37 LWP 16840 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
38 LWP 16841 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
39 LWP 16842 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
40 LWP 16843 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
41 LWP 16844 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
42 LWP 16845 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
43 LWP 16846 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
44 LWP 16847 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
45 LWP 16848 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
46 LWP 16849 "rpc worker-1684" 0x00007f576ae0cad3 in ?? ()
47 LWP 16850 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
48 LWP 16851 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
49 LWP 16852 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
50 LWP 16853 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
51 LWP 16854 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
52 LWP 16855 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
53 LWP 16856 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
54 LWP 16857 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
55 LWP 16858 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
56 LWP 16859 "rpc worker-1685" 0x00007f576ae0cad3 in ?? ()
57 LWP 16860 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
58 LWP 16861 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
59 LWP 16862 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
60 LWP 16863 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
61 LWP 16864 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
62 LWP 16865 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
63 LWP 16866 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
64 LWP 16867 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
65 LWP 16868 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
66 LWP 16869 "rpc worker-1686" 0x00007f576ae0cad3 in ?? ()
67 LWP 16870 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
68 LWP 16871 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
69 LWP 16872 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
70 LWP 16873 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
71 LWP 16874 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
72 LWP 16875 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
73 LWP 16876 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
74 LWP 16877 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
75 LWP 16878 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
76 LWP 16879 "rpc worker-1687" 0x00007f576ae0cad3 in ?? ()
77 LWP 16880 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
78 LWP 16881 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
79 LWP 16882 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
80 LWP 16883 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
81 LWP 16884 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
82 LWP 16885 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
83 LWP 16886 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
84 LWP 16887 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
85 LWP 16888 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
86 LWP 16889 "rpc worker-1688" 0x00007f576ae0cad3 in ?? ()
87 LWP 16890 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
88 LWP 16891 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
89 LWP 16892 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
90 LWP 16893 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
91 LWP 16894 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
92 LWP 16895 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
93 LWP 16896 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
94 LWP 16897 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
95 LWP 16898 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
96 LWP 16899 "rpc worker-1689" 0x00007f576ae0cad3 in ?? ()
97 LWP 16900 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
98 LWP 16901 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
99 LWP 16902 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
100 LWP 16903 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
101 LWP 16904 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
102 LWP 16905 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
103 LWP 16906 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
104 LWP 16907 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
105 LWP 16908 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
106 LWP 16909 "rpc worker-1690" 0x00007f576ae0cad3 in ?? ()
107 LWP 16910 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
108 LWP 16911 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
109 LWP 16912 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
110 LWP 16913 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
111 LWP 16914 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
112 LWP 16915 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
113 LWP 16916 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
114 LWP 16917 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
115 LWP 16918 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
116 LWP 16919 "rpc worker-1691" 0x00007f576ae0cad3 in ?? ()
117 LWP 16920 "diag-logger-169" 0x00007f576ae0cfb9 in ?? ()
118 LWP 16921 "result-tracker-" 0x00007f576ae0cfb9 in ?? ()
119 LWP 16922 "excess-log-dele" 0x00007f576ae0cfb9 in ?? ()
120 LWP 16923 "acceptor-16923" 0x00007f57639390c7 in ?? ()
121 LWP 16924 "heartbeat-16924" 0x00007f576ae0cfb9 in ?? ()
122 LWP 16925 "maintenance_sch" 0x00007f576ae0cfb9 in ?? ()
123 LWP 17233 "wal-append [wor" 0x00007f576ae0cfb9 in ?? ()
124 LWP 17256 "wal-append [wor" 0x00007f576ae0cfb9 in ?? ()
125 LWP 17269 "wal-append [wor" 0x00007f576ae0cfb9 in ?? ()
126 LWP 17278 "raft [worker]-1" 0x00007f576ae0cfb9 in ?? ()
127 LWP 17287 "raft [worker]-1" 0x00007f576ae0cfb9 in ?? ()
128 LWP 17307 "wal-append [wor" 0x00007f576ae0cfb9 in ?? ()
129 LWP 17314 "prepare [worker" 0x00007f576ae0cfb9 in ?? ()
Thread 129 (LWP 17314):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 128 (LWP 17307):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00006020001ebf58 in ?? ()
#2 0x0000000000000001 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a000034fb4 in ?? ()
#5 0x00007f575c9b7130 in ?? ()
#6 0x0000000000000003 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f575c9b7150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 127 (LWP 17287):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x00000000000000ce in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007f571f44ebc0 in ?? ()
#5 0x00007f571f44e850 in ?? ()
#6 0x000000000000019c in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 126 (LWP 17278):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000110 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007f5715971bc0 in ?? ()
#5 0x00007f5715971850 in ?? ()
#6 0x0000000000000220 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 125 (LWP 17269):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00006020001c3860 in ?? ()
#2 0x000000000000015a in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061a000051db0 in ?? ()
#5 0x00007f57169a9130 in ?? ()
#6 0x00000000000002b4 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 124 (LWP 17256):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00006030004c7d88 in ?? ()
#2 0x000000000000015b in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a0000529b4 in ?? ()
#5 0x00007f5718201130 in ?? ()
#6 0x00000000000002b7 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f5718201150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 123 (LWP 17233):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00006020001d1d38 in ?? ()
#2 0x0000000000000191 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a00004ffb4 in ?? ()
#5 0x00007f571aa92130 in ?? ()
#6 0x0000000000000323 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f571aa92150 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 16925):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00007f571fc66700 in ?? ()
#2 0x0000000000000012 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f571fc66750 in ?? ()
#6 0x0000000000000024 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 16924):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0xd5f3969d04e6a079 in ?? ()
#2 0x000000000000000c in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019b00 in ?? ()
#5 0x00007f572047e610 in ?? ()
#6 0x0000000000000018 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 16923):
#0 0x00007f57639390c7 in ?? ()
#1 0x00006140000418a8 in ?? ()
#2 0x00007f5720ca5d70 in ?? ()
#3 0x00007f5720ca5da0 in ?? ()
#4 0x00007f5720ca5ea0 in ?? ()
#5 0x00007f5720ca5d90 in ?? ()
#6 0x00007f5720ca5e00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c485b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f5720ca5f20 in ?? ()
#11 0x00007f5720ca565c in ?? ()
#12 0x0000003220ca55d0 in ?? ()
#13 0x00007f57204a9000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 16922):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00007f57214bff60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 16921):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00007f5721cd8120 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008a930 in ?? ()
#5 0x00007f5721cd8110 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 16920):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 16919):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 16918):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 16917):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 16916):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 16915):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 16914):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 16913):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 16912):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 16911):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 16910):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 16909):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 16908):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 16907):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 16906):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 16905):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 16904):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 16903):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 16902):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 16901):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 16900):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 16899):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 16898):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 16897):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 16896):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 16895):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 16894):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 16893):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 16892):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 16891):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 16890):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 16889):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 16888):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 16887):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 16886):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 16885):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 16884):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 16883):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 16882):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 16881):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 16880):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 16879):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x00000000000000cb in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a688c in ?? ()
#4 0x00007f57370d8eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f57370d8ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a6840 in ?? ()
#9 0x00007f576ae0c770 in ?? ()
#10 0x00007f57370d8ed0 in ?? ()
#11 0x00007f57370d8e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 16878):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000017 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007f57378f0eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f57378f0ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007f576ae0c770 in ?? ()
#10 0x00007f57378f0ed0 in ?? ()
#11 0x00007f57378f0e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 16877):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x00000000000000e6 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001967c8 in ?? ()
#4 0x00007f5738108eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f5738108ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 16876):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 16875):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 16874):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 16873):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 16872):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 16871):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 16870):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 16869):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 16868):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 16867):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 16866):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 16865):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 16864):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 16863):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 16862):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 16861):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 16860):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 16859):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000120038 in ?? ()
#4 0x00007f57412b9eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f57412b9ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 16858):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00011d048 in ?? ()
#4 0x00007f5741ad1eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f5741ad1ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 54 (LWP 16857):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007f57422e9eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f57422e9ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007f576ae0c770 in ?? ()
#10 0x00007f57422e9ed0 in ?? ()
#11 0x00007f57422e9e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 53 (LWP 16856):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011004c in ?? ()
#4 0x00007f5742b01eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f5742b01ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000110000 in ?? ()
#9 0x00007f576ae0c770 in ?? ()
#10 0x00007f5742b01ed0 in ?? ()
#11 0x00007f5742b01e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 52 (LWP 16855):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 16854):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 16853):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 16852):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 16851):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 16850):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 16849):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 16848):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 16847):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 16846):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 16845):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 16844):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 16843):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 16842):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 16841):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 16840):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 16839):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000018 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00009ffe8 in ?? ()
#4 0x00007f574b49aeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f574b49aed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 16838):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x000000000000001a in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000967f8 in ?? ()
#4 0x00007f574bcb2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f574bcb2ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 16837):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000066 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00008fff8 in ?? ()
#4 0x00007f574c4caeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f574c4caed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 33 (LWP 16836):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000041 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008d00c in ?? ()
#4 0x00007f574cce2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f574cce2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008cfc0 in ?? ()
#9 0x00007f576ae0c770 in ?? ()
#10 0x00007f574cce2ed0 in ?? ()
#11 0x00007f574cce2e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 32 (LWP 16835):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x000000000000004b in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008680c in ?? ()
#4 0x00007f574d4faeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f574d4faed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000867c0 in ?? ()
#9 0x00007f576ae0c770 in ?? ()
#10 0x00007f574d4faed0 in ?? ()
#11 0x00007f574d4fae90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 31 (LWP 16834):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x000000000000006c in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000080008 in ?? ()
#4 0x00007f574dd12eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f574dd12ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 30 (LWP 16833):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x000000000000002b in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00007681c in ?? ()
#4 0x00007f574e52aeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f574e52aed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000767d0 in ?? ()
#9 0x00007f576ae0c770 in ?? ()
#10 0x00007f574e52aed0 in ?? ()
#11 0x00007f574e52ae90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 29 (LWP 16832):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 16831):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 16830):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 16829):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 16828):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 16827):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 16826):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 16825):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 16824):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 16823):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 16822):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 16821):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 16820):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 16819):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00007f575569ece0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 16818):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 14 (LWP 16817):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00007f57566dc260 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 16816):
#0 0x00007f576ae0cad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 16815):
#0 0x00007f5763937a47 in ?? ()
#1 0x00007f575772b340 in ?? ()
#2 0x000061a00000cc80 in ?? ()
#3 0x00007f575772b330 in ?? ()
#4 0x00007f575772b540 in ?? ()
#5 0x00007f575772b380 in ?? ()
#6 0x0000614000041c98 in ?? ()
#7 0x00007f575772b400 in ?? ()
#8 0x00007f5765faa25d in ?? ()
#9 0x3fb95e850a6d0000 in ?? ()
#10 0x000061a00000cc80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000cc80 in ?? ()
#13 0x00000000e0000000 in ?? ()
#14 0x00007f5700000000 in ?? ()
#15 0x41da4e9ceb1eae96 in ?? ()
#16 0x00000feb6aedd680 in ?? ()
#17 0x00007f575772b3e0 in ?? ()
#18 0x00007f5765faeba3 in ?? ()
#19 0x00007f575772b3b0 in ?? ()
#20 0x3fb95e850a6d0000 in ?? ()
#21 0x000000005772b400 in ?? ()
#22 0x000061a00000cc80 in ?? ()
#23 0x0000614000041c98 in ?? ()
#24 0x3fb95e850a6d0000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 16814):
#0 0x00007f5763937a47 in ?? ()
#1 0x00007f5757f42340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f5757f42330 in ?? ()
#4 0x00007f5757f42540 in ?? ()
#5 0x00007f5757f42380 in ?? ()
#6 0x0000614000041a98 in ?? ()
#7 0x00007f5757f42400 in ?? ()
#8 0x00007f5765faa25d in ?? ()
#9 0x3fb138d80dc80000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x000000006e000000 in ?? ()
#14 0x00007f5700000000 in ?? ()
#15 0x41da4e9ceb1eae99 in ?? ()
#16 0x00000feb6afe0480 in ?? ()
#17 0x00007f5757f423e0 in ?? ()
#18 0x00007f5765faeba3 in ?? ()
#19 0x00007f5757f423b0 in ?? ()
#20 0x3fb138d80dc80000 in ?? ()
#21 0x0000000057f42400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000041a98 in ?? ()
#24 0x3fb138d80dc80000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 16813):
#0 0x00007f5763937a47 in ?? ()
#1 0x00007f5758759340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f5758759330 in ?? ()
#4 0x00007f5758759540 in ?? ()
#5 0x00007f5758759380 in ?? ()
#6 0x0000614000041898 in ?? ()
#7 0x00007f5758759400 in ?? ()
#8 0x00007f5765faa25d in ?? ()
#9 0x3fb613b3887b0000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x0000000066000000 in ?? ()
#14 0x00007f5700000000 in ?? ()
#15 0x41da4e9ceb1eae97 in ?? ()
#16 0x00000feb6b0e3280 in ?? ()
#17 0x00007f57587593e0 in ?? ()
#18 0x00007f5765faeba3 in ?? ()
#19 0x00007f57587593b0 in ?? ()
#20 0x3fb613b3887b0000 in ?? ()
#21 0x0000000058759400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000041898 in ?? ()
#24 0x3fb613b3887b0000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 16812):
#0 0x00007f5763937a47 in ?? ()
#1 0x00007f575a77f340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f575a77f330 in ?? ()
#4 0x00007f575a77f540 in ?? ()
#5 0x00007f575a77f380 in ?? ()
#6 0x0000614000041698 in ?? ()
#7 0x00007f575a77f400 in ?? ()
#8 0x00007f5765faa25d in ?? ()
#9 0x3fb95eaf44dd0000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x0000000031000000 in ?? ()
#14 0x00007f5700000000 in ?? ()
#15 0x41da4e9ceb1eae95 in ?? ()
#16 0x00000feb6b4e7e80 in ?? ()
#17 0x00007f575a77f3e0 in ?? ()
#18 0x00007f5765faeba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 16809):
#0 0x00007f576392acb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f575c1b77b8 in ?? ()
#3 0x000060200001c750 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bc4a1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 16808):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00007f575b9b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 16807):
#0 0x00007f576ae109e2 in ?? ()
#1 0x00007f575b1b3bc0 in ?? ()
#2 0x00007f575b1b3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f575b1b3c10 in ?? ()
#6 0x00000000017ab3a0 in ?? ()
#7 0x00007f575b1b3c70 in ?? ()
#8 0x000061100008b290 in ?? ()
#9 0x00007f575b1b3c60 in ?? ()
#10 0x00000000008b6997 in __sanitizer::theDepot ()
#11 0x00007f577073a61c in ?? ()
#12 0x00007f5770729c29 in ?? ()
#13 0x00007f577072e216 in ?? ()
#14 0x00007f5770732c50 in ?? ()
#15 0x00007f5770732a79 in ?? ()
#16 0x0000000000a8970d in __sanitizer::theDepot ()
#17 0x00007f57677fb3f9 in ?? ()
#18 0x00007f576ae066db in ?? ()
#19 0x00000feb6b62e688 in ?? ()
#20 0x00007f575b1b3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 16801):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x00007f575d1b8ca0 in ?? ()
#2 0x0000000000000017 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007f575d1b8c90 in ?? ()
#6 0x000000000000002e in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 16800):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 16799):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 16798):
#0 0x00007f576ae0cfb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007f575e9bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 16797):
#0 0x00007f576ae10d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20251211 08:56:24.567536 16699 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID 1d826daf06f24df5822713cef1bda18e and pid 16927
************************ BEGIN STACKS **************************
[New LWP 16928]
[New LWP 16929]
[New LWP 16930]
[New LWP 16931]
[New LWP 16937]
[New LWP 16938]
[New LWP 16939]
[New LWP 16942]
[New LWP 16943]
[New LWP 16944]
[New LWP 16945]
[New LWP 16946]
[New LWP 16947]
[New LWP 16948]
[New LWP 16949]
[New LWP 16950]
[New LWP 16951]
[New LWP 16952]
[New LWP 16953]
[New LWP 16954]
[New LWP 16955]
[New LWP 16956]
[New LWP 16957]
[New LWP 16958]
[New LWP 16959]
[New LWP 16960]
[New LWP 16961]
[New LWP 16962]
[New LWP 16963]
[New LWP 16964]
[New LWP 16965]
[New LWP 16966]
[New LWP 16967]
[New LWP 16968]
[New LWP 16969]
[New LWP 16970]
[New LWP 16971]
[New LWP 16972]
[New LWP 16973]
[New LWP 16974]
[New LWP 16975]
[New LWP 16976]
[New LWP 16977]
[New LWP 16978]
[New LWP 16979]
[New LWP 16980]
[New LWP 16981]
[New LWP 16982]
[New LWP 16983]
[New LWP 16984]
[New LWP 16985]
[New LWP 16986]
[New LWP 16987]
[New LWP 16988]
[New LWP 16989]
[New LWP 16990]
[New LWP 16991]
[New LWP 16992]
[New LWP 16993]
[New LWP 16994]
[New LWP 16995]
[New LWP 16996]
[New LWP 16997]
[New LWP 16998]
[New LWP 16999]
[New LWP 17000]
[New LWP 17001]
[New LWP 17002]
[New LWP 17003]
[New LWP 17004]
[New LWP 17005]
[New LWP 17006]
[New LWP 17007]
[New LWP 17008]
[New LWP 17009]
[New LWP 17010]
[New LWP 17011]
[New LWP 17012]
[New LWP 17013]
[New LWP 17014]
[New LWP 17015]
[New LWP 17016]
[New LWP 17017]
[New LWP 17018]
[New LWP 17019]
[New LWP 17020]
[New LWP 17021]
[New LWP 17022]
[New LWP 17023]
[New LWP 17024]
[New LWP 17025]
[New LWP 17026]
[New LWP 17027]
[New LWP 17028]
[New LWP 17029]
[New LWP 17030]
[New LWP 17031]
[New LWP 17032]
[New LWP 17033]
[New LWP 17034]
[New LWP 17035]
[New LWP 17036]
[New LWP 17037]
[New LWP 17038]
[New LWP 17039]
[New LWP 17040]
[New LWP 17041]
[New LWP 17042]
[New LWP 17043]
[New LWP 17044]
[New LWP 17045]
[New LWP 17046]
[New LWP 17047]
[New LWP 17048]
[New LWP 17049]
[New LWP 17050]
[New LWP 17051]
[New LWP 17052]
[New LWP 17053]
[New LWP 17054]
[New LWP 17055]
[New LWP 17240]
[New LWP 17316]
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f545245454545
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f545245454545
0x00007f509da18d50 in ?? ()
Id Target Id Frame
* 1 LWP 16927 "kudu" 0x00007f509da18d50 in ?? ()
2 LWP 16928 "kudu" 0x00007f509da14fb9 in ?? ()
3 LWP 16929 "kudu" 0x00007f509da14fb9 in ?? ()
4 LWP 16930 "kudu" 0x00007f509da14fb9 in ?? ()
5 LWP 16931 "kernel-watcher-" 0x00007f509da14fb9 in ?? ()
6 LWP 16937 "ntp client-1693" 0x00007f509da189e2 in ?? ()
7 LWP 16938 "file cache-evic" 0x00007f509da14fb9 in ?? ()
8 LWP 16939 "sq_acceptor" 0x00007f5096532cb9 in ?? ()
9 LWP 16942 "rpc reactor-169" 0x00007f509653fa47 in ?? ()
10 LWP 16943 "rpc reactor-169" 0x00007f509653fa47 in ?? ()
11 LWP 16944 "rpc reactor-169" 0x00007f509653fa47 in ?? ()
12 LWP 16945 "rpc reactor-169" 0x00007f509653fa47 in ?? ()
13 LWP 16946 "MaintenanceMgr " 0x00007f509da14ad3 in ?? ()
14 LWP 16947 "txn-status-mana" 0x00007f509da14fb9 in ?? ()
15 LWP 16948 "collect_and_rem" 0x00007f509da14fb9 in ?? ()
16 LWP 16949 "tc-session-exp-" 0x00007f509da14fb9 in ?? ()
17 LWP 16950 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
18 LWP 16951 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
19 LWP 16952 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
20 LWP 16953 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
21 LWP 16954 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
22 LWP 16955 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
23 LWP 16956 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
24 LWP 16957 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
25 LWP 16958 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
26 LWP 16959 "rpc worker-1695" 0x00007f509da14ad3 in ?? ()
27 LWP 16960 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
28 LWP 16961 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
29 LWP 16962 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
30 LWP 16963 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
31 LWP 16964 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
32 LWP 16965 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
33 LWP 16966 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
34 LWP 16967 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
35 LWP 16968 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
36 LWP 16969 "rpc worker-1696" 0x00007f509da14ad3 in ?? ()
37 LWP 16970 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
38 LWP 16971 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
39 LWP 16972 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
40 LWP 16973 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
41 LWP 16974 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
42 LWP 16975 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
43 LWP 16976 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
44 LWP 16977 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
45 LWP 16978 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
46 LWP 16979 "rpc worker-1697" 0x00007f509da14ad3 in ?? ()
47 LWP 16980 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
48 LWP 16981 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
49 LWP 16982 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
50 LWP 16983 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
51 LWP 16984 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
52 LWP 16985 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
53 LWP 16986 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
54 LWP 16987 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
55 LWP 16988 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
56 LWP 16989 "rpc worker-1698" 0x00007f509da14ad3 in ?? ()
57 LWP 16990 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
58 LWP 16991 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
59 LWP 16992 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
60 LWP 16993 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
61 LWP 16994 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
62 LWP 16995 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
63 LWP 16996 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
64 LWP 16997 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
65 LWP 16998 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
66 LWP 16999 "rpc worker-1699" 0x00007f509da14ad3 in ?? ()
67 LWP 17000 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
68 LWP 17001 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
69 LWP 17002 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
70 LWP 17003 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
71 LWP 17004 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
72 LWP 17005 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
73 LWP 17006 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
74 LWP 17007 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
75 LWP 17008 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
76 LWP 17009 "rpc worker-1700" 0x00007f509da14ad3 in ?? ()
77 LWP 17010 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
78 LWP 17011 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
79 LWP 17012 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
80 LWP 17013 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
81 LWP 17014 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
82 LWP 17015 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
83 LWP 17016 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
84 LWP 17017 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
85 LWP 17018 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
86 LWP 17019 "rpc worker-1701" 0x00007f509da14ad3 in ?? ()
87 LWP 17020 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
88 LWP 17021 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
89 LWP 17022 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
90 LWP 17023 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
91 LWP 17024 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
92 LWP 17025 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
93 LWP 17026 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
94 LWP 17027 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
95 LWP 17028 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
96 LWP 17029 "rpc worker-1702" 0x00007f509da14ad3 in ?? ()
97 LWP 17030 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
98 LWP 17031 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
99 LWP 17032 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
100 LWP 17033 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
101 LWP 17034 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
102 LWP 17035 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
103 LWP 17036 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
104 LWP 17037 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
105 LWP 17038 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
106 LWP 17039 "rpc worker-1703" 0x00007f509da14ad3 in ?? ()
107 LWP 17040 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
108 LWP 17041 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
109 LWP 17042 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
110 LWP 17043 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
111 LWP 17044 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
112 LWP 17045 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
113 LWP 17046 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
114 LWP 17047 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
115 LWP 17048 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
116 LWP 17049 "rpc worker-1704" 0x00007f509da14ad3 in ?? ()
117 LWP 17050 "diag-logger-170" 0x00007f509da14fb9 in ?? ()
118 LWP 17051 "result-tracker-" 0x00007f509da14fb9 in ?? ()
119 LWP 17052 "excess-log-dele" 0x00007f509da14fb9 in ?? ()
120 LWP 17053 "acceptor-17053" 0x00007f50965410c7 in ?? ()
121 LWP 17054 "heartbeat-17054" 0x00007f509da14fb9 in ?? ()
122 LWP 17055 "maintenance_sch" 0x00007f509da14fb9 in ?? ()
123 LWP 17240 "raft [worker]-1" 0x00007f509da14fb9 in ?? ()
124 LWP 17316 "wal-append [wor" 0x00007f509da14fb9 in ?? ()
Thread 124 (LWP 17316):
#0 0x00007f509da14fb9 in ?? ()
#1 0x00006020001c8138 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 123 (LWP 17240):
#0 0x00007f509da14fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000140 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007f504ded6bc0 in ?? ()
#5 0x00007f504ded6850 in ?? ()
#6 0x0000000000000280 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 122 (LWP 17055):
#0 0x00007f509da14fb9 in ?? ()
#1 0x00007f505286e700 in ?? ()
#2 0x0000000000000013 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007f505286e750 in ?? ()
#6 0x0000000000000026 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 17054):
#0 0x00007f509da14fb9 in ?? ()
#1 0xd5f3969d04e6a079 in ?? ()
#2 0x000000000000000d in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x0000613000019b04 in ?? ()
#5 0x00007f5053086610 in ?? ()
#6 0x000000000000001b in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007f5053086630 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007f50530866b0 in ?? ()
#12 0x00000fea0a610cd8 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 17053):
#0 0x00007f50965410c7 in ?? ()
#1 0x0000614000041aa8 in ?? ()
#2 0x00007f50538add70 in ?? ()
#3 0x00007f50538adda0 in ?? ()
#4 0x00007f50538adea0 in ?? ()
#5 0x00007f50538add90 in ?? ()
#6 0x00007f50538ade00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c485b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f50538adf20 in ?? ()
#11 0x00007f50538ad65c in ?? ()
#12 0x00000032538ad5d0 in ?? ()
#13 0x00007f50530b1000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 17052):
#0 0x00007f509da14fb9 in ?? ()
#1 0x00007f50540c7f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 17051):
#0 0x00007f509da14fb9 in ?? ()
#1 0x00007f50548e0120 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008a930 in ?? ()
#5 0x00007f50548e0110 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 17050):
#0 0x00007f509da14fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 17049):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 17048):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 17047):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 17046):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 17045):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 17044):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 17043):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 17042):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 17041):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 17040):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 17039):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 17038):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 17037):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 17036):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 17035):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 17034):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 17033):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 17032):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 17031):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 17030):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 17029):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 17028):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 17027):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 17026):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 17025):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 17024):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 17023):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 17022):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 17021):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 17020):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 17019):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 17018):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 17017):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 17016):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 17015):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 17014):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 17013):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 17012):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 17011):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 17010):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 17009):
#0 0x00007f509da14ad3 in ?? ()
#1 0x00000000000000dc in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007f5069ce0eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f5069ce0ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 17008):
#0 0x00007f509da14ad3 in ?? ()
#1 0x00000000000000e2 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007f506a4f8eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f506a4f8ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 17007):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000081 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001967cc in ?? ()
#4 0x00007f506ad10eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f506ad10ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000196780 in ?? ()
#9 0x00007f509da14770 in ?? ()
#10 0x00007f506ad10ed0 in ?? ()
#11 0x00007f506ad10e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 17006):
#0 0x00007f509da14ad3 in ?? ()
#1 0x00000000000000b5 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00018ffcc in ?? ()
#4 0x00007f506b528eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f506b528ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00018ff80 in ?? ()
#9 0x00007f509da14770 in ?? ()
#10 0x00007f506b528ed0 in ?? ()
#11 0x00007f506b528e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 72 (LWP 17005):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 17004):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 17003):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 17002):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 17001):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 17000):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 16999):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 16998):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 16997):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 16996):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 16995):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 16994):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 16993):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 16992):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 16991):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 16990):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 16989):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012003c in ?? ()
#4 0x00007f5073ec1eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f5073ec1ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00011fff0 in ?? ()
#9 0x00007f509da14770 in ?? ()
#10 0x00007f5073ec1ed0 in ?? ()
#11 0x00007f5073ec1e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 16988):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00011d048 in ?? ()
#4 0x00007f50746d9eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f50746d9ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 54 (LWP 16987):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000116848 in ?? ()
#4 0x00007f5074ef1eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f5074ef1ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 53 (LWP 16986):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011004c in ?? ()
#4 0x00007f5075709eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f5075709ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000110000 in ?? ()
#9 0x00007f509da14770 in ?? ()
#10 0x00007f5075709ed0 in ?? ()
#11 0x00007f5075709e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 52 (LWP 16985):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 16984):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 16983):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 16982):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 16981):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 16980):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 16979):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 16978):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 16977):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 16976):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 16975):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 16974):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 16973):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 16972):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 16971):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 16970):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 16969):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f507e0a2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f507e0a2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f509da14770 in ?? ()
#10 0x00007f507e0a2ed0 in ?? ()
#11 0x00007f507e0a2e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 16968):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000080 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000967f8 in ?? ()
#4 0x00007f507e8baeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f507e8baed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 34 (LWP 16967):
#0 0x00007f509da14ad3 in ?? ()
#1 0x000000000000003f in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008fffc in ?? ()
#4 0x00007f507f0d2eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f507f0d2ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008ffb0 in ?? ()
#9 0x00007f509da14770 in ?? ()
#10 0x00007f507f0d2ed0 in ?? ()
#11 0x00007f507f0d2e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 16966):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000024 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00008d008 in ?? ()
#4 0x00007f507f8eaeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f507f8eaed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 32 (LWP 16965):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 16964):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 16963):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 16962):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 16961):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 16960):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 16959):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 16958):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 16957):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 16956):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 16955):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 16954):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 16953):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 16952):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 16951):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 16950):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 16949):
#0 0x00007f509da14fb9 in ?? ()
#1 0x00007f50882a6ce0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 16948):
#0 0x00007f509da14fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 14 (LWP 16947):
#0 0x00007f509da14fb9 in ?? ()
#1 0x00007f50892e4260 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 16946):
#0 0x00007f509da14ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 16945):
#0 0x00007f509653fa47 in ?? ()
#1 0x00007f508a333340 in ?? ()
#2 0x000061a00000cc80 in ?? ()
#3 0x00007f508a333330 in ?? ()
#4 0x00007f508a333540 in ?? ()
#5 0x00007f508a333380 in ?? ()
#6 0x0000614000041c98 in ?? ()
#7 0x00007f508a333400 in ?? ()
#8 0x00007f5098bb225d in ?? ()
#9 0x3fb96e4571d20000 in ?? ()
#10 0x000061a00000cc80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000cc80 in ?? ()
#13 0x0000000004000000 in ?? ()
#14 0x00007f5000000000 in ?? ()
#15 0x41da4e9ceb1eae9a in ?? ()
#16 0x00000fea9145e680 in ?? ()
#17 0x00007f508a3333e0 in ?? ()
#18 0x00007f5098bb6ba3 in ?? ()
#19 0x00007f508a3333b0 in ?? ()
#20 0x3fb96e4571d20000 in ?? ()
#21 0x000000008a333400 in ?? ()
#22 0x000061a00000cc80 in ?? ()
#23 0x0000614000041c98 in ?? ()
#24 0x3fb96e4571d20000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 16944):
#0 0x00007f509653fa47 in ?? ()
#1 0x00007f508ab4a340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007f508ab4a330 in ?? ()
#4 0x00007f508ab4a540 in ?? ()
#5 0x00007f508ab4a380 in ?? ()
#6 0x0000614000041a98 in ?? ()
#7 0x00007f508ab4a400 in ?? ()
#8 0x00007f5098bb225d in ?? ()
#9 0x3fb97b08fdf20000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x0000000010000000 in ?? ()
#14 0x00007f5000000000 in ?? ()
#15 0x41da4e9ceb1eae97 in ?? ()
#16 0x00000fea91561480 in ?? ()
#17 0x00007f508ab4a3e0 in ?? ()
#18 0x00007f5098bb6ba3 in ?? ()
#19 0x00007f508ab4a3b0 in ?? ()
#20 0x3fb97b08fdf20000 in ?? ()
#21 0x000000008ab4a400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000041a98 in ?? ()
#24 0x3fb97b08fdf20000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 16943):
#0 0x00007f509653fa47 in ?? ()
#1 0x00007f508b361340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007f508b361330 in ?? ()
#4 0x00007f508b361540 in ?? ()
#5 0x00007f508b361380 in ?? ()
#6 0x0000614000041898 in ?? ()
#7 0x00007f508b361400 in ?? ()
#8 0x00007f5098bb225d in ?? ()
#9 0x3fb95b07a76c0000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x000000001c000000 in ?? ()
#14 0x00007f5000000000 in ?? ()
#15 0x41da4e9ceb1eae97 in ?? ()
#16 0x00000fea91664280 in ?? ()
#17 0x00007f508b3613e0 in ?? ()
#18 0x00007f5098bb6ba3 in ?? ()
#19 0x00007f508b3613b0 in ?? ()
#20 0x3fb95b07a76c0000 in ?? ()
#21 0x000000008b361400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000041898 in ?? ()
#24 0x3fb95b07a76c0000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 16942):
#0 0x00007f509653fa47 in ?? ()
#1 0x00007f508d387340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007f508d387330 in ?? ()
#4 0x00007f508d387540 in ?? ()
#5 0x00007f508d387380 in ?? ()
#6 0x0000614000041698 in ?? ()
#7 0x00007f508d387400 in ?? ()
#8 0x00007f5098bb225d in ?? ()
#9 0x3fb983349b840000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x000000001e000000 in ?? ()
#14 0x00007f5000000000 in ?? ()
#15 0x41da4e9ceb1eae98 in ?? ()
#16 0x00000fea91a68e80 in ?? ()
#17 0x00007f508d3873e0 in ?? ()
#18 0x00007f5098bb6ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 16939):
#0 0x00007f5096532cb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f508edb77b8 in ?? ()
#3 0x000060200001d750 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bc4a1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 16938):
#0 0x00007f509da14fb9 in ?? ()
#1 0x00007f508e5b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 16937):
#0 0x00007f509da189e2 in ?? ()
#1 0x00007f508ddb3bc0 in ?? ()
#2 0x00007f508ddb3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f508ddb3c10 in ?? ()
#6 0x00000000017ab3a0 in ?? ()
#7 0x00007f508ddb3c70 in ?? ()
#8 0x000061100008b290 in ?? ()
#9 0x00007f508ddb3c60 in ?? ()
#10 0x00000000008b6997 in __sanitizer::theDepot ()
#11 0x00007f50a334261c in ?? ()
#12 0x00007f50a3331c29 in ?? ()
#13 0x00007f50a3336216 in ?? ()
#14 0x00007f50a333ac50 in ?? ()
#15 0x00007f50a333aa79 in ?? ()
#16 0x0000000000a8970d in __sanitizer::theDepot ()
#17 0x00007f509a4033f9 in ?? ()
#18 0x00007f509da0e6db in ?? ()
#19 0x00000fea91bae688 in ?? ()
#20 0x00007f508ddb3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 16931):
#0 0x00007f509da14fb9 in ?? ()
#1 0x00007f508fdb8ca0 in ?? ()
#2 0x0000000000000018 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007f508fdb8c90 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 16930):
#0 0x00007f509da14fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 16929):
#0 0x00007f509da14fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 16928):
#0 0x00007f509da14fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007f50915bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 16927):
#0 0x00007f509da18d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20251211 08:56:25.074883 16699 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID 4d7838e032df4c42aea1da486a5d1647 and pid 17057
************************ BEGIN STACKS **************************
[New LWP 17058]
[New LWP 17059]
[New LWP 17060]
[New LWP 17061]
[New LWP 17067]
[New LWP 17068]
[New LWP 17069]
[New LWP 17072]
[New LWP 17073]
[New LWP 17074]
[New LWP 17075]
[New LWP 17076]
[New LWP 17077]
[New LWP 17078]
[New LWP 17079]
[New LWP 17080]
[New LWP 17081]
[New LWP 17082]
[New LWP 17083]
[New LWP 17084]
[New LWP 17085]
[New LWP 17086]
[New LWP 17087]
[New LWP 17088]
[New LWP 17089]
[New LWP 17090]
[New LWP 17091]
[New LWP 17092]
[New LWP 17093]
[New LWP 17094]
[New LWP 17095]
[New LWP 17096]
[New LWP 17097]
[New LWP 17098]
[New LWP 17099]
[New LWP 17100]
[New LWP 17101]
[New LWP 17102]
[New LWP 17103]
[New LWP 17104]
[New LWP 17105]
[New LWP 17106]
[New LWP 17107]
[New LWP 17108]
[New LWP 17109]
[New LWP 17110]
[New LWP 17111]
[New LWP 17112]
[New LWP 17113]
[New LWP 17114]
[New LWP 17115]
[New LWP 17116]
[New LWP 17117]
[New LWP 17118]
[New LWP 17119]
[New LWP 17120]
[New LWP 17121]
[New LWP 17122]
[New LWP 17123]
[New LWP 17124]
[New LWP 17125]
[New LWP 17126]
[New LWP 17127]
[New LWP 17128]
[New LWP 17129]
[New LWP 17130]
[New LWP 17131]
[New LWP 17132]
[New LWP 17133]
[New LWP 17134]
[New LWP 17135]
[New LWP 17136]
[New LWP 17137]
[New LWP 17138]
[New LWP 17139]
[New LWP 17140]
[New LWP 17141]
[New LWP 17142]
[New LWP 17143]
[New LWP 17144]
[New LWP 17145]
[New LWP 17146]
[New LWP 17147]
[New LWP 17148]
[New LWP 17149]
[New LWP 17150]
[New LWP 17151]
[New LWP 17152]
[New LWP 17153]
[New LWP 17154]
[New LWP 17155]
[New LWP 17156]
[New LWP 17157]
[New LWP 17158]
[New LWP 17159]
[New LWP 17160]
[New LWP 17161]
[New LWP 17162]
[New LWP 17163]
[New LWP 17164]
[New LWP 17165]
[New LWP 17166]
[New LWP 17167]
[New LWP 17168]
[New LWP 17169]
[New LWP 17170]
[New LWP 17171]
[New LWP 17172]
[New LWP 17173]
[New LWP 17174]
[New LWP 17175]
[New LWP 17176]
[New LWP 17177]
[New LWP 17178]
[New LWP 17179]
[New LWP 17180]
[New LWP 17181]
[New LWP 17182]
[New LWP 17183]
[New LWP 17184]
[New LWP 17185]
[New LWP 17291]
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f545245454545
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f54524545454d
Cannot access memory at address 0x765f545245454545
0x00007ff8349f6d50 in ?? ()
Id Target Id Frame
* 1 LWP 17057 "kudu" 0x00007ff8349f6d50 in ?? ()
2 LWP 17058 "kudu" 0x00007ff8349f2fb9 in ?? ()
3 LWP 17059 "kudu" 0x00007ff8349f2fb9 in ?? ()
4 LWP 17060 "kudu" 0x00007ff8349f2fb9 in ?? ()
5 LWP 17061 "kernel-watcher-" 0x00007ff8349f2fb9 in ?? ()
6 LWP 17067 "ntp client-1706" 0x00007ff8349f69e2 in ?? ()
7 LWP 17068 "file cache-evic" 0x00007ff8349f2fb9 in ?? ()
8 LWP 17069 "sq_acceptor" 0x00007ff82d510cb9 in ?? ()
9 LWP 17072 "rpc reactor-170" 0x00007ff82d51da47 in ?? ()
10 LWP 17073 "rpc reactor-170" 0x00007ff82d51da47 in ?? ()
11 LWP 17074 "rpc reactor-170" 0x00007ff82d51da47 in ?? ()
12 LWP 17075 "rpc reactor-170" 0x00007ff82d51da47 in ?? ()
13 LWP 17076 "MaintenanceMgr " 0x00007ff8349f2ad3 in ?? ()
14 LWP 17077 "txn-status-mana" 0x00007ff8349f2fb9 in ?? ()
15 LWP 17078 "collect_and_rem" 0x00007ff8349f2fb9 in ?? ()
16 LWP 17079 "tc-session-exp-" 0x00007ff8349f2fb9 in ?? ()
17 LWP 17080 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
18 LWP 17081 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
19 LWP 17082 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
20 LWP 17083 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
21 LWP 17084 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
22 LWP 17085 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
23 LWP 17086 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
24 LWP 17087 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
25 LWP 17088 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
26 LWP 17089 "rpc worker-1708" 0x00007ff8349f2ad3 in ?? ()
27 LWP 17090 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
28 LWP 17091 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
29 LWP 17092 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
30 LWP 17093 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
31 LWP 17094 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
32 LWP 17095 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
33 LWP 17096 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
34 LWP 17097 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
35 LWP 17098 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
36 LWP 17099 "rpc worker-1709" 0x00007ff8349f2ad3 in ?? ()
37 LWP 17100 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
38 LWP 17101 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
39 LWP 17102 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
40 LWP 17103 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
41 LWP 17104 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
42 LWP 17105 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
43 LWP 17106 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
44 LWP 17107 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
45 LWP 17108 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
46 LWP 17109 "rpc worker-1710" 0x00007ff8349f2ad3 in ?? ()
47 LWP 17110 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
48 LWP 17111 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
49 LWP 17112 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
50 LWP 17113 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
51 LWP 17114 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
52 LWP 17115 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
53 LWP 17116 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
54 LWP 17117 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
55 LWP 17118 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
56 LWP 17119 "rpc worker-1711" 0x00007ff8349f2ad3 in ?? ()
57 LWP 17120 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
58 LWP 17121 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
59 LWP 17122 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
60 LWP 17123 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
61 LWP 17124 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
62 LWP 17125 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
63 LWP 17126 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
64 LWP 17127 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
65 LWP 17128 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
66 LWP 17129 "rpc worker-1712" 0x00007ff8349f2ad3 in ?? ()
67 LWP 17130 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
68 LWP 17131 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
69 LWP 17132 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
70 LWP 17133 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
71 LWP 17134 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
72 LWP 17135 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
73 LWP 17136 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
74 LWP 17137 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
75 LWP 17138 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
76 LWP 17139 "rpc worker-1713" 0x00007ff8349f2ad3 in ?? ()
77 LWP 17140 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
78 LWP 17141 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
79 LWP 17142 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
80 LWP 17143 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
81 LWP 17144 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
82 LWP 17145 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
83 LWP 17146 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
84 LWP 17147 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
85 LWP 17148 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
86 LWP 17149 "rpc worker-1714" 0x00007ff8349f2ad3 in ?? ()
87 LWP 17150 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
88 LWP 17151 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
89 LWP 17152 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
90 LWP 17153 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
91 LWP 17154 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
92 LWP 17155 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
93 LWP 17156 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
94 LWP 17157 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
95 LWP 17158 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
96 LWP 17159 "rpc worker-1715" 0x00007ff8349f2ad3 in ?? ()
97 LWP 17160 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
98 LWP 17161 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
99 LWP 17162 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
100 LWP 17163 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
101 LWP 17164 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
102 LWP 17165 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
103 LWP 17166 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
104 LWP 17167 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
105 LWP 17168 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
106 LWP 17169 "rpc worker-1716" 0x00007ff8349f2ad3 in ?? ()
107 LWP 17170 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
108 LWP 17171 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
109 LWP 17172 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
110 LWP 17173 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
111 LWP 17174 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
112 LWP 17175 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
113 LWP 17176 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
114 LWP 17177 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
115 LWP 17178 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
116 LWP 17179 "rpc worker-1717" 0x00007ff8349f2ad3 in ?? ()
117 LWP 17180 "diag-logger-171" 0x00007ff8349f2fb9 in ?? ()
118 LWP 17181 "result-tracker-" 0x00007ff8349f2fb9 in ?? ()
119 LWP 17182 "excess-log-dele" 0x00007ff8349f2fb9 in ?? ()
120 LWP 17183 "acceptor-17183" 0x00007ff82d51f0c7 in ?? ()
121 LWP 17184 "heartbeat-17184" 0x00007ff8349f2fb9 in ?? ()
122 LWP 17185 "maintenance_sch" 0x00007ff8349f2fb9 in ?? ()
123 LWP 17291 "raft [worker]-1" 0x00007ff8349f2fb9 in ?? ()
Thread 123 (LWP 17291):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x000000000000002b in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007ff7e9034bc4 in ?? ()
#5 0x00007ff7e9034850 in ?? ()
#6 0x0000000000000057 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007ff7e9034870 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 17185):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x00007ff7e984c700 in ?? ()
#2 0x0000000000000013 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000016ca0 in ?? ()
#5 0x00007ff7e984c750 in ?? ()
#6 0x0000000000000026 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 17184):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0xd5f3969d04e6a079 in ?? ()
#2 0x000000000000000c in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x0000613000019b04 in ?? ()
#5 0x00007ff7ea064610 in ?? ()
#6 0x0000000000000019 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007ff7ea064630 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x00007ff7ea0646b0 in ?? ()
#12 0x00000ffefd40c8d8 in ?? ()
#13 0x0000000000000000 in ?? ()
Thread 120 (LWP 17183):
#0 0x00007ff82d51f0c7 in ?? ()
#1 0x0000614000041ca8 in ?? ()
#2 0x00007ff7ea88bd70 in ?? ()
#3 0x00007ff7ea88bda0 in ?? ()
#4 0x00007ff7ea88bea0 in ?? ()
#5 0x00007ff7ea88bd90 in ?? ()
#6 0x00007ff7ea88be00 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008c485b in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007ff7ea88bf20 in ?? ()
#11 0x00007ff7ea88b65c in ?? ()
#12 0x00000032ea88b5d0 in ?? ()
#13 0x00007ff7ea08f000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 17182):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x00007ff7eb0a5f60 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 17181):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x00007ff7eb8be120 in ?? ()
#2 0x0000000000000004 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061100008a930 in ?? ()
#5 0x00007ff7eb8be110 in ?? ()
#6 0x0000000000000008 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 17180):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 17179):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 17178):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 17177):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 17176):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 17175):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 17174):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 17173):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 17172):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 17171):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 17170):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 17169):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 17168):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 17167):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 17166):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 17165):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 17164):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 17163):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 17162):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 17161):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 17160):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 17159):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 17158):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 17157):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 17156):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 17155):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 17154):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 17153):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 17152):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 17151):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 17150):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 17149):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 17148):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 17147):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 17146):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 17145):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 17144):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 17143):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 17142):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 17141):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 17140):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 17139):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x00000000000000e2 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007ff800cbeeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff800cbeed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 17138):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000013 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007ff8014d6eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff8014d6ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff8014d6ed0 in ?? ()
#11 0x00007ff8014d6e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 74 (LWP 17137):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x000000000000010b in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001967cc in ?? ()
#4 0x00007ff801ceeeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff801ceeed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000196780 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff801ceeed0 in ?? ()
#11 0x00007ff801ceee90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 17136):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x00000000000000cf in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00018ffcc in ?? ()
#4 0x00007ff802506eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff802506ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00018ff80 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff802506ed0 in ?? ()
#11 0x00007ff802506e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 72 (LWP 17135):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 17134):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 17133):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 17132):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 17131):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 17130):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 17129):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 17128):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 17127):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 17126):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 17125):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 17124):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 17123):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 17122):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 17121):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 17120):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 17119):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000120038 in ?? ()
#4 0x00007ff80ae9feb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff80ae9fed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 55 (LWP 17118):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00011d048 in ?? ()
#4 0x00007ff80b6b7eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff80b6b7ed0 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 54 (LWP 17117):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007ff80becfeb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff80becfed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff80becfed0 in ?? ()
#11 0x00007ff80becfe90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 53 (LWP 17116):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011004c in ?? ()
#4 0x00007ff80c6e7eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff80c6e7ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000110000 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff80c6e7ed0 in ?? ()
#11 0x00007ff80c6e7e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 52 (LWP 17115):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 17114):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 17113):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 17112):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 17111):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 17110):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 17109):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 17108):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 17107):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 17106):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 17105):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 17104):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 17103):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 17102):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 17101):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 17100):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 17099):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000005 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007ff815080eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff815080ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff815080ed0 in ?? ()
#11 0x00007ff815080e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 17098):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000033 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000967fc in ?? ()
#4 0x00007ff815898eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff815898ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000967b0 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff815898ed0 in ?? ()
#11 0x00007ff815898e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 17097):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000059 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008fffc in ?? ()
#4 0x00007ff8160b0eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff8160b0ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008ffb0 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff8160b0ed0 in ?? ()
#11 0x00007ff8160b0e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 17096):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x000000000000004d in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008d00c in ?? ()
#4 0x00007ff8168c8eb0 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff8168c8ed0 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008cfc0 in ?? ()
#9 0x00007ff8349f2770 in ?? ()
#10 0x00007ff8168c8ed0 in ?? ()
#11 0x00007ff8168c8e90 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 32 (LWP 17095):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 17094):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 17093):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 17092):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 17091):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 17090):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 17089):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 17088):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 17087):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 17086):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 17085):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 17084):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 17083):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 17082):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 17081):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 17080):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 17079):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x00007ff81f27fce0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 17078):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x4008000000000000 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 14 (LWP 17077):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x00007ff8202af260 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 17076):
#0 0x00007ff8349f2ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 17075):
#0 0x00007ff82d51da47 in ?? ()
#1 0x00007ff8212b2340 in ?? ()
#2 0x000061a00000cc80 in ?? ()
#3 0x00007ff8212b2330 in ?? ()
#4 0x00007ff8212b2540 in ?? ()
#5 0x00007ff8212b2380 in ?? ()
#6 0x0000614000041c98 in ?? ()
#7 0x00007ff8212b2400 in ?? ()
#8 0x00007ff82fb9025d in ?? ()
#9 0x3fb97773d4f80000 in ?? ()
#10 0x000061a00000cc80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000cc80 in ?? ()
#13 0x0000000063000000 in ?? ()
#14 0x00007ff800000000 in ?? ()
#15 0x41da4e9ceb1eae98 in ?? ()
#16 0x00000fff8424e480 in ?? ()
#17 0x00007ff8212b23e0 in ?? ()
#18 0x00007ff82fb94ba3 in ?? ()
#19 0x00007ff8212b23b0 in ?? ()
#20 0x3fb97773d4f80000 in ?? ()
#21 0x00000000212b2400 in ?? ()
#22 0x000061a00000cc80 in ?? ()
#23 0x0000614000041c98 in ?? ()
#24 0x3fb97773d4f80000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 17074):
#0 0x00007ff82d51da47 in ?? ()
#1 0x00007ff821ab3340 in ?? ()
#2 0x000061a00000c680 in ?? ()
#3 0x00007ff821ab3330 in ?? ()
#4 0x00007ff821ab3540 in ?? ()
#5 0x00007ff821ab3380 in ?? ()
#6 0x0000614000041a98 in ?? ()
#7 0x00007ff821ab3400 in ?? ()
#8 0x00007ff82fb9025d in ?? ()
#9 0x3fb37e6e5a7b0000 in ?? ()
#10 0x000061a00000c680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c680 in ?? ()
#13 0x00000000b0000000 in ?? ()
#14 0x00007ff800000000 in ?? ()
#15 0x41da4e9ceb1eae9a in ?? ()
#16 0x00000fff8434e680 in ?? ()
#17 0x00007ff821ab33e0 in ?? ()
#18 0x00007ff82fb94ba3 in ?? ()
#19 0x00007ff821ab33b0 in ?? ()
#20 0x3fb37e6e5a7b0000 in ?? ()
#21 0x0000000021ab3400 in ?? ()
#22 0x000061a00000c680 in ?? ()
#23 0x0000614000041a98 in ?? ()
#24 0x3fb37e6e5a7b0000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 17073):
#0 0x00007ff82d51da47 in ?? ()
#1 0x00007ff8222b4340 in ?? ()
#2 0x000061a00000c080 in ?? ()
#3 0x00007ff8222b4330 in ?? ()
#4 0x00007ff8222b4540 in ?? ()
#5 0x00007ff8222b4380 in ?? ()
#6 0x0000614000041898 in ?? ()
#7 0x00007ff8222b4400 in ?? ()
#8 0x00007ff82fb9025d in ?? ()
#9 0x3fa1829b14320000 in ?? ()
#10 0x000061a00000c080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000c080 in ?? ()
#13 0x00000000de000000 in ?? ()
#14 0x00007ff800000000 in ?? ()
#15 0x41da4e9ceb1eae96 in ?? ()
#16 0x00000fff8444e880 in ?? ()
#17 0x00007ff8222b43e0 in ?? ()
#18 0x00007ff82fb94ba3 in ?? ()
#19 0x00007ff8222b43b0 in ?? ()
#20 0x3fa1829b14320000 in ?? ()
#21 0x00000000222b4400 in ?? ()
#22 0x000061a00000c080 in ?? ()
#23 0x0000614000041898 in ?? ()
#24 0x3fa1829b14320000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 17072):
#0 0x00007ff82d51da47 in ?? ()
#1 0x00007ff8242ad340 in ?? ()
#2 0x000061a00000ba80 in ?? ()
#3 0x00007ff8242ad330 in ?? ()
#4 0x00007ff8242ad540 in ?? ()
#5 0x00007ff8242ad380 in ?? ()
#6 0x0000614000041698 in ?? ()
#7 0x00007ff8242ad400 in ?? ()
#8 0x00007ff82fb9025d in ?? ()
#9 0x3fb9890460a10000 in ?? ()
#10 0x000061a00000ba80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ba80 in ?? ()
#13 0x00000000c6000000 in ?? ()
#14 0x00007ff800000000 in ?? ()
#15 0x41da4e9ceb1eae96 in ?? ()
#16 0x00000fff8484da80 in ?? ()
#17 0x00007ff8242ad3e0 in ?? ()
#18 0x00007ff82fb94ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 17069):
#0 0x00007ff82d510cb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007ff825cb77b8 in ?? ()
#3 0x000060200001d790 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008bc4a1 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 17068):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x00007ff8254b60e0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 17067):
#0 0x00007ff8349f69e2 in ?? ()
#1 0x00007ff824cb3bc0 in ?? ()
#2 0x00007ff824cb3c60 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007ff824cb3c10 in ?? ()
#6 0x00000000017ab3a0 in ?? ()
#7 0x00007ff824cb3c70 in ?? ()
#8 0x000061100008b290 in ?? ()
#9 0x00007ff824cb3c60 in ?? ()
#10 0x00000000008b6997 in __sanitizer::theDepot ()
#11 0x00007ff83a32061c in ?? ()
#12 0x00007ff83a30fc29 in ?? ()
#13 0x00007ff83a314216 in ?? ()
#14 0x00007ff83a318c50 in ?? ()
#15 0x00007ff83a318a79 in ?? ()
#16 0x0000000000a8970d in __sanitizer::theDepot ()
#17 0x00007ff8313e13f9 in ?? ()
#18 0x00007ff8349ec6db in ?? ()
#19 0x00000fff8498e688 in ?? ()
#20 0x00007ff824cb3460 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 17061):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x00007ff826cb8ca0 in ?? ()
#2 0x0000000000000018 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200001e728 in ?? ()
#5 0x00007ff826cb8c90 in ?? ()
#6 0x0000000000000030 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 17060):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 17059):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 17058):
#0 0x00007ff8349f2fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006120000126b8 in ?? ()
#5 0x00007ff8284bc450 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 17057):
#0 0x00007ff8349f6d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20251211 08:56:25.589776 16699 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4FbiYc/build/asan/bin/kudu pid 16797
I20251211 08:56:25.596750 16919 generic_service.cc:196] Checking for leaks (request via RPC)
I20251211 08:56:25.719656 16699 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4FbiYc/build/asan/bin/kudu with pid 16797
W20251211 08:56:25.740865 17072 connection.cc:537] server connection from 127.16.78.193:40635 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251211 08:56:25.741317 16699 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4FbiYc/build/asan/bin/kudu pid 16927
I20251211 08:56:25.742287 17049 generic_service.cc:196] Checking for leaks (request via RPC)
I20251211 08:56:25.863828 16699 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4FbiYc/build/asan/bin/kudu with pid 16927
I20251211 08:56:25.886189 16699 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4FbiYc/build/asan/bin/kudu pid 17057
I20251211 08:56:25.892409 17179 generic_service.cc:196] Checking for leaks (request via RPC)
I20251211 08:56:26.017710 16699 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4FbiYc/build/asan/bin/kudu with pid 17057
I20251211 08:56:26.039196 16699 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-task4FbiYc/build/asan/bin/kudu pid 16707
I20251211 08:56:26.040333 16768 generic_service.cc:196] Checking for leaks (request via RPC)
I20251211 08:56:26.140599 16699 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task4FbiYc/build/asan/bin/kudu with pid 16707
2025-12-11T08:56:26Z chronyd exiting
I20251211 08:56:26.173870 16699 test_util.cc:183] -----------------------------------------------
I20251211 08:56:26.173943 16699 test_util.cc:184] Had failures, leaving test files at /tmp/dist-test-task4FbiYc/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1765443378912887-16699-0
[ FAILED ] ReplaceTabletITest.ReplaceTabletsWhileWriting (7208 ms)
[----------] 1 test from ReplaceTabletITest (7208 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (7208 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] ReplaceTabletITest.ReplaceTabletsWhileWriting
1 FAILED TEST
I20251211 08:56:26.175239 16699 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/client/batcher.cc:441: suppressed but not reported on 3 messages since previous log ~2 seconds ago