[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from ReplaceTabletITest
[ RUN ] ReplaceTabletITest.ReplaceTabletsWhileWriting
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250115 14:55:37.756142 9711 test_util.cc:274] Using random seed: -556223049
2025-01-15T14:55:37Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-01-15T14:55:37Z Disabled control of system clock
I20250115 14:55:37.790689 9711 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu
/tmp/dist-test-taskf3gU9X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.123.254:46817
--webserver_interface=127.9.123.254
--webserver_port=0
--builtin_ntp_servers=127.9.123.212:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.9.123.254:46817 with env {}
W20250115 14:55:38.115581 9719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 14:55:38.115906 9719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 14:55:38.116053 9719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 14:55:38.124526 9719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20250115 14:55:38.124653 9719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 14:55:38.124702 9719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20250115 14:55:38.124802 9719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20250115 14:55:38.134430 9719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.123.212:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.9.123.254:46817
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.9.123.254:46817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.9.123.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type FASTDEBUG
built by None at 15 Jan 2025 14:43:22 UTC on 24a791456cd2
build id 4191
ASAN enabled
I20250115 14:55:38.136082 9719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 14:55:38.137761 9719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 14:55:38.148705 9727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 14:55:38.149230 9725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 14:55:38.149660 9724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 14:55:38.150899 9719 server_base.cc:1034] running on GCE node
I20250115 14:55:38.151787 9719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 14:55:38.153247 9719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 14:55:38.154512 9719 hybrid_clock.cc:648] HybridClock initialized: now 1736952938154433 us; error 38 us; skew 500 ppm
I20250115 14:55:38.154851 9719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250115 14:55:38.162436 9719 webserver.cc:458] Webserver started at http://127.9.123.254:44697/ using document root <none> and password file <none>
I20250115 14:55:38.163250 9719 fs_manager.cc:362] Metadata directory not provided
I20250115 14:55:38.163362 9719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 14:55:38.163630 9719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 14:55:38.166422 9719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/data/instance:
uuid: "ef47843d08f24972aeb7e60c7ac3c91e"
format_stamp: "Formatted at 2025-01-15 14:55:38 on dist-test-slave-nhbt"
I20250115 14:55:38.167444 9719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/wal/instance:
uuid: "ef47843d08f24972aeb7e60c7ac3c91e"
format_stamp: "Formatted at 2025-01-15 14:55:38 on dist-test-slave-nhbt"
I20250115 14:55:38.172996 9719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20250115 14:55:38.176407 9733 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:38.177820 9719 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20250115 14:55:38.177978 9719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/data,/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/wal
uuid: "ef47843d08f24972aeb7e60c7ac3c91e"
format_stamp: "Formatted at 2025-01-15 14:55:38 on dist-test-slave-nhbt"
I20250115 14:55:38.178144 9719 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 14:55:38.200187 9719 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 14:55:38.201045 9719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 14:55:38.201304 9719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 14:55:38.221064 9719 rpc_server.cc:307] RPC server started. Bound to: 127.9.123.254:46817
I20250115 14:55:38.221086 9784 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.123.254:46817 every 8 connection(s)
I20250115 14:55:38.222445 9719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/data/info.pb
I20250115 14:55:38.226608 9785 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:38.227926 9711 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu as pid 9719
I20250115 14:55:38.228192 9711 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/master-0/wal/instance
I20250115 14:55:38.236346 9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e: Bootstrap starting.
I20250115 14:55:38.239428 9785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:38.240525 9785 log.cc:826] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e: Log is configured to *not* fsync() on all Append() calls
I20250115 14:55:38.243409 9785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e: No bootstrap required, opened a new log
I20250115 14:55:38.251637 9785 raft_consensus.cc:357] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef47843d08f24972aeb7e60c7ac3c91e" member_type: VOTER last_known_addr { host: "127.9.123.254" port: 46817 } }
I20250115 14:55:38.251992 9785 raft_consensus.cc:383] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:38.252097 9785 raft_consensus.cc:738] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef47843d08f24972aeb7e60c7ac3c91e, State: Initialized, Role: FOLLOWER
I20250115 14:55:38.252894 9785 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef47843d08f24972aeb7e60c7ac3c91e" member_type: VOTER last_known_addr { host: "127.9.123.254" port: 46817 } }
I20250115 14:55:38.253167 9785 raft_consensus.cc:397] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250115 14:55:38.253311 9785 raft_consensus.cc:491] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250115 14:55:38.253468 9785 raft_consensus.cc:3054] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:38.255832 9785 raft_consensus.cc:513] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef47843d08f24972aeb7e60c7ac3c91e" member_type: VOTER last_known_addr { host: "127.9.123.254" port: 46817 } }
I20250115 14:55:38.256296 9785 leader_election.cc:304] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef47843d08f24972aeb7e60c7ac3c91e; no voters:
I20250115 14:55:38.256947 9785 leader_election.cc:290] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [CANDIDATE]: Term 1 election: Requested vote from peers
I20250115 14:55:38.257095 9790 raft_consensus.cc:2798] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 1 FOLLOWER]: Leader election won for term 1
I20250115 14:55:38.258203 9790 raft_consensus.cc:695] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [term 1 LEADER]: Becoming Leader. State: Replica: ef47843d08f24972aeb7e60c7ac3c91e, State: Running, Role: LEADER
I20250115 14:55:38.258819 9790 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef47843d08f24972aeb7e60c7ac3c91e" member_type: VOTER last_known_addr { host: "127.9.123.254" port: 46817 } }
I20250115 14:55:38.259413 9785 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [sys.catalog]: configured and running, proceeding with master startup.
I20250115 14:55:38.261874 9791 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef47843d08f24972aeb7e60c7ac3c91e. Latest consensus state: current_term: 1 leader_uuid: "ef47843d08f24972aeb7e60c7ac3c91e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef47843d08f24972aeb7e60c7ac3c91e" member_type: VOTER last_known_addr { host: "127.9.123.254" port: 46817 } } }
I20250115 14:55:38.262255 9791 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [sys.catalog]: This master's current role is: LEADER
I20250115 14:55:38.263036 9792 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef47843d08f24972aeb7e60c7ac3c91e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef47843d08f24972aeb7e60c7ac3c91e" member_type: VOTER last_known_addr { host: "127.9.123.254" port: 46817 } } }
I20250115 14:55:38.263374 9792 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e [sys.catalog]: This master's current role is: LEADER
I20250115 14:55:38.263876 9795 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250115 14:55:38.269462 9795 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250115 14:55:38.279320 9795 catalog_manager.cc:1348] Generated new cluster ID: 3e17fe0dadf34270993514c375e3eace
I20250115 14:55:38.279453 9795 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250115 14:55:38.290972 9795 catalog_manager.cc:1371] Generated new certificate authority record
I20250115 14:55:38.292225 9795 catalog_manager.cc:1505] Loading token signing keys...
I20250115 14:55:38.307624 9795 catalog_manager.cc:5899] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e: Generated new TSK 0
I20250115 14:55:38.308524 9795 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250115 14:55:38.320760 9711 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu
/tmp/dist-test-taskf3gU9X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.123.193:0
--local_ip_for_outbound_sockets=127.9.123.193
--webserver_interface=127.9.123.193
--webserver_port=0
--tserver_master_addrs=127.9.123.254:46817
--builtin_ntp_servers=127.9.123.212:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20250115 14:55:38.682852 9809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 14:55:38.683251 9809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 14:55:38.683411 9809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 14:55:38.691378 9809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 14:55:38.691588 9809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.123.193
I20250115 14:55:38.701054 9809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.123.212:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.123.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.9.123.193
--webserver_port=0
--tserver_master_addrs=127.9.123.254:46817
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.123.193
--log_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type FASTDEBUG
built by None at 15 Jan 2025 14:43:22 UTC on 24a791456cd2
build id 4191
ASAN enabled
I20250115 14:55:38.702610 9809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 14:55:38.704342 9809 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 14:55:38.716264 9814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 14:55:38.716861 9817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 14:55:38.717691 9815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 14:55:38.719115 9809 server_base.cc:1034] running on GCE node
I20250115 14:55:38.719830 9809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 14:55:38.720800 9809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 14:55:38.722023 9809 hybrid_clock.cc:648] HybridClock initialized: now 1736952938721944 us; error 55 us; skew 500 ppm
I20250115 14:55:38.722352 9809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250115 14:55:38.724790 9809 webserver.cc:458] Webserver started at http://127.9.123.193:41239/ using document root <none> and password file <none>
I20250115 14:55:38.725556 9809 fs_manager.cc:362] Metadata directory not provided
I20250115 14:55:38.725695 9809 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 14:55:38.726022 9809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 14:55:38.728806 9809 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/data/instance:
uuid: "95747bbef14947678f5d61f5c3acd1aa"
format_stamp: "Formatted at 2025-01-15 14:55:38 on dist-test-slave-nhbt"
I20250115 14:55:38.729624 9809 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/wal/instance:
uuid: "95747bbef14947678f5d61f5c3acd1aa"
format_stamp: "Formatted at 2025-01-15 14:55:38 on dist-test-slave-nhbt"
I20250115 14:55:38.735117 9809 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20250115 14:55:38.738484 9823 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:38.739938 9809 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20250115 14:55:38.740097 9809 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/data,/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/wal
uuid: "95747bbef14947678f5d61f5c3acd1aa"
format_stamp: "Formatted at 2025-01-15 14:55:38 on dist-test-slave-nhbt"
I20250115 14:55:38.740279 9809 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 14:55:38.758669 9809 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 14:55:38.759603 9809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 14:55:38.759934 9809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 14:55:38.760995 9809 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250115 14:55:38.762487 9809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250115 14:55:38.762569 9809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:38.762699 9809 ts_tablet_manager.cc:610] Registered 0 tablets
I20250115 14:55:38.762761 9809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:38.795531 9809 rpc_server.cc:307] RPC server started. Bound to: 127.9.123.193:33197
I20250115 14:55:38.795606 9935 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.123.193:33197 every 8 connection(s)
I20250115 14:55:38.796877 9809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/data/info.pb
I20250115 14:55:38.801075 9711 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu as pid 9809
I20250115 14:55:38.801294 9711 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/wal/instance
I20250115 14:55:38.804600 9711 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu
/tmp/dist-test-taskf3gU9X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.123.194:0
--local_ip_for_outbound_sockets=127.9.123.194
--webserver_interface=127.9.123.194
--webserver_port=0
--tserver_master_addrs=127.9.123.254:46817
--builtin_ntp_servers=127.9.123.212:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20250115 14:55:38.810168 9936 heartbeater.cc:346] Connected to a master server at 127.9.123.254:46817
I20250115 14:55:38.810516 9936 heartbeater.cc:463] Registering TS with master...
I20250115 14:55:38.811419 9936 heartbeater.cc:509] Master 127.9.123.254:46817 requested a full tablet report, sending...
I20250115 14:55:38.813704 9750 ts_manager.cc:194] Registered new tserver with Master: 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197)
I20250115 14:55:38.815296 9750 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.123.193:55003
W20250115 14:55:39.137099 9940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 14:55:39.137423 9940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 14:55:39.137570 9940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 14:55:39.145573 9940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 14:55:39.145845 9940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.123.194
I20250115 14:55:39.155534 9940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.123.212:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.123.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.9.123.194
--webserver_port=0
--tserver_master_addrs=127.9.123.254:46817
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.123.194
--log_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type FASTDEBUG
built by None at 15 Jan 2025 14:43:22 UTC on 24a791456cd2
build id 4191
ASAN enabled
I20250115 14:55:39.157972 9940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 14:55:39.160404 9940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 14:55:39.172977 9945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 14:55:39.173709 9946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 14:55:39.174285 9948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 14:55:39.174724 9940 server_base.cc:1034] running on GCE node
I20250115 14:55:39.175398 9940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 14:55:39.176376 9940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 14:55:39.177595 9940 hybrid_clock.cc:648] HybridClock initialized: now 1736952939177533 us; error 45 us; skew 500 ppm
I20250115 14:55:39.177948 9940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250115 14:55:39.180316 9940 webserver.cc:458] Webserver started at http://127.9.123.194:33039/ using document root <none> and password file <none>
I20250115 14:55:39.181100 9940 fs_manager.cc:362] Metadata directory not provided
I20250115 14:55:39.181226 9940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 14:55:39.181533 9940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 14:55:39.184373 9940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/data/instance:
uuid: "0c2a19eb9fcf43bc927b1059bee4483e"
format_stamp: "Formatted at 2025-01-15 14:55:39 on dist-test-slave-nhbt"
I20250115 14:55:39.185184 9940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/wal/instance:
uuid: "0c2a19eb9fcf43bc927b1059bee4483e"
format_stamp: "Formatted at 2025-01-15 14:55:39 on dist-test-slave-nhbt"
I20250115 14:55:39.190519 9940 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20250115 14:55:39.194031 9954 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:39.195569 9940 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20250115 14:55:39.195741 9940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/data,/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/wal
uuid: "0c2a19eb9fcf43bc927b1059bee4483e"
format_stamp: "Formatted at 2025-01-15 14:55:39 on dist-test-slave-nhbt"
I20250115 14:55:39.195945 9940 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 14:55:39.230321 9940 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 14:55:39.231272 9940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 14:55:39.231564 9940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 14:55:39.232555 9940 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250115 14:55:39.234236 9940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250115 14:55:39.234323 9940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:39.234462 9940 ts_tablet_manager.cc:610] Registered 0 tablets
I20250115 14:55:39.234517 9940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:39.267549 9940 rpc_server.cc:307] RPC server started. Bound to: 127.9.123.194:39509
I20250115 14:55:39.267592 10066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.123.194:39509 every 8 connection(s)
I20250115 14:55:39.268884 9940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/data/info.pb
I20250115 14:55:39.274159 9711 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu as pid 9940
I20250115 14:55:39.274343 9711 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/wal/instance
I20250115 14:55:39.277321 9711 external_mini_cluster.cc:1351] Running /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu
/tmp/dist-test-taskf3gU9X/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.9.123.195:0
--local_ip_for_outbound_sockets=127.9.123.195
--webserver_interface=127.9.123.195
--webserver_port=0
--tserver_master_addrs=127.9.123.254:46817
--builtin_ntp_servers=127.9.123.212:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20250115 14:55:39.282055 10067 heartbeater.cc:346] Connected to a master server at 127.9.123.254:46817
I20250115 14:55:39.282438 10067 heartbeater.cc:463] Registering TS with master...
I20250115 14:55:39.283537 10067 heartbeater.cc:509] Master 127.9.123.254:46817 requested a full tablet report, sending...
I20250115 14:55:39.285192 9750 ts_manager.cc:194] Registered new tserver with Master: 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194:39509)
I20250115 14:55:39.285991 9750 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.123.194:52659
W20250115 14:55:39.608604 10070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20250115 14:55:39.608924 10070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20250115 14:55:39.609046 10070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20250115 14:55:39.616936 10070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20250115 14:55:39.617187 10070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.123.195
I20250115 14:55:39.626639 10070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.9.123.212:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.9.123.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.9.123.195
--webserver_port=0
--tserver_master_addrs=127.9.123.254:46817
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.9.123.195
--log_dir=/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision 75b75ca2f58f1a5aba69207830e3558011033d99
build type FASTDEBUG
built by None at 15 Jan 2025 14:43:22 UTC on 24a791456cd2
build id 4191
ASAN enabled
I20250115 14:55:39.628342 10070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250115 14:55:39.630103 10070 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250115 14:55:39.642006 10075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 14:55:39.642577 10076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250115 14:55:39.643406 10078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250115 14:55:39.644685 10070 server_base.cc:1034] running on GCE node
I20250115 14:55:39.645352 10070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20250115 14:55:39.646407 10070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20250115 14:55:39.647635 10070 hybrid_clock.cc:648] HybridClock initialized: now 1736952939647570 us; error 42 us; skew 500 ppm
I20250115 14:55:39.647974 10070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250115 14:55:39.650292 10070 webserver.cc:458] Webserver started at http://127.9.123.195:34143/ using document root <none> and password file <none>
I20250115 14:55:39.651110 10070 fs_manager.cc:362] Metadata directory not provided
I20250115 14:55:39.651254 10070 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250115 14:55:39.651564 10070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250115 14:55:39.654201 10070 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/data/instance:
uuid: "2f62359bebfe4f4599589ebc9fe0aa98"
format_stamp: "Formatted at 2025-01-15 14:55:39 on dist-test-slave-nhbt"
I20250115 14:55:39.655061 10070 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/wal/instance:
uuid: "2f62359bebfe4f4599589ebc9fe0aa98"
format_stamp: "Formatted at 2025-01-15 14:55:39 on dist-test-slave-nhbt"
I20250115 14:55:39.660432 10070 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20250115 14:55:39.663832 10084 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:39.665202 10070 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20250115 14:55:39.665370 10070 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/data,/tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/wal
uuid: "2f62359bebfe4f4599589ebc9fe0aa98"
format_stamp: "Formatted at 2025-01-15 14:55:39 on dist-test-slave-nhbt"
I20250115 14:55:39.665565 10070 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250115 14:55:39.687886 10070 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250115 14:55:39.688777 10070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250115 14:55:39.689062 10070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250115 14:55:39.690062 10070 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250115 14:55:39.691669 10070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250115 14:55:39.691753 10070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:39.691887 10070 ts_tablet_manager.cc:610] Registered 0 tablets
I20250115 14:55:39.691947 10070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250115 14:55:39.722929 10070 rpc_server.cc:307] RPC server started. Bound to: 127.9.123.195:37203
I20250115 14:55:39.723014 10196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.9.123.195:37203 every 8 connection(s)
I20250115 14:55:39.724346 10070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/data/info.pb
I20250115 14:55:39.726305 9711 external_mini_cluster.cc:1413] Started /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu as pid 10070
I20250115 14:55:39.726502 9711 external_mini_cluster.cc:1427] Reading /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/wal/instance
I20250115 14:55:39.737030 10197 heartbeater.cc:346] Connected to a master server at 127.9.123.254:46817
I20250115 14:55:39.737314 10197 heartbeater.cc:463] Registering TS with master...
I20250115 14:55:39.738080 10197 heartbeater.cc:509] Master 127.9.123.254:46817 requested a full tablet report, sending...
I20250115 14:55:39.739451 9750 ts_manager.cc:194] Registered new tserver with Master: 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203)
I20250115 14:55:39.740195 9750 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.123.195:33295
I20250115 14:55:39.742818 9711 external_mini_cluster.cc:934] 3 TS(s) registered with all masters
I20250115 14:55:39.771798 9711 test_util.cc:274] Using random seed: -554207357
I20250115 14:55:39.793454 9750 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43392:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\004\001\000\377\377\377\037\004\001\000\376\377\377?\004\001\000\375\377\377_"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250115 14:55:39.795431 9750 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250115 14:55:39.818461 9936 heartbeater.cc:501] Master 127.9.123.254:46817 was elected leader, sending a full tablet report...
I20250115 14:55:39.826009 10000 tablet_service.cc:1467] Processing CreateTablet for tablet 1e7c35eac2934abf8fa426adea769f7e (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20250115 14:55:39.827790 9999 tablet_service.cc:1467] Processing CreateTablet for tablet c0ef474794c84988b0746f7e9971d28d (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20250115 14:55:39.828086 10000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7c35eac2934abf8fa426adea769f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.827491 10130 tablet_service.cc:1467] Processing CreateTablet for tablet 1e7c35eac2934abf8fa426adea769f7e (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20250115 14:55:39.828622 10129 tablet_service.cc:1467] Processing CreateTablet for tablet c0ef474794c84988b0746f7e9971d28d (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20250115 14:55:39.827912 9869 tablet_service.cc:1467] Processing CreateTablet for tablet 1e7c35eac2934abf8fa426adea769f7e (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20250115 14:55:39.829360 10132 tablet_service.cc:1467] Processing CreateTablet for tablet df6d241d40044c5fb4b38623a11c031d (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION VALUES < 536870911
I20250115 14:55:39.829510 9869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7c35eac2934abf8fa426adea769f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.829840 9870 tablet_service.cc:1467] Processing CreateTablet for tablet bcf91a0bb8af49bbb2b7b121a31cc59f (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20250115 14:55:39.830029 10001 tablet_service.cc:1467] Processing CreateTablet for tablet bcf91a0bb8af49bbb2b7b121a31cc59f (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20250115 14:55:39.830327 9870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf91a0bb8af49bbb2b7b121a31cc59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.830534 10001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf91a0bb8af49bbb2b7b121a31cc59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.830966 9871 tablet_service.cc:1467] Processing CreateTablet for tablet df6d241d40044c5fb4b38623a11c031d (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION VALUES < 536870911
I20250115 14:55:39.831238 9999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ef474794c84988b0746f7e9971d28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.831542 9871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df6d241d40044c5fb4b38623a11c031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.831781 10002 tablet_service.cc:1467] Processing CreateTablet for tablet df6d241d40044c5fb4b38623a11c031d (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION VALUES < 536870911
I20250115 14:55:39.831873 10131 tablet_service.cc:1467] Processing CreateTablet for tablet bcf91a0bb8af49bbb2b7b121a31cc59f (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 536870911 <= VALUES < 1073741822
I20250115 14:55:39.832283 10002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df6d241d40044c5fb4b38623a11c031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.832234 9868 tablet_service.cc:1467] Processing CreateTablet for tablet c0ef474794c84988b0746f7e9971d28d (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1610612733 <= VALUES
I20250115 14:55:39.829367 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e7c35eac2934abf8fa426adea769f7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.832644 9868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ef474794c84988b0746f7e9971d28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.834208 10129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0ef474794c84988b0746f7e9971d28d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.834908 10132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df6d241d40044c5fb4b38623a11c031d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.843462 10131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf91a0bb8af49bbb2b7b121a31cc59f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:39.858563 10227 tablet_bootstrap.cc:492] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa: Bootstrap starting.
I20250115 14:55:39.861097 10225 tablet_bootstrap.cc:492] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98: Bootstrap starting.
I20250115 14:55:39.863487 10227 tablet_bootstrap.cc:654] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.864250 10225 tablet_bootstrap.cc:654] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.864578 10227 log.cc:826] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa: Log is configured to *not* fsync() on all Append() calls
I20250115 14:55:39.865105 10226 tablet_bootstrap.cc:492] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e: Bootstrap starting.
I20250115 14:55:39.865365 10225 log.cc:826] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98: Log is configured to *not* fsync() on all Append() calls
I20250115 14:55:39.869994 10226 tablet_bootstrap.cc:654] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.871559 10226 log.cc:826] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e: Log is configured to *not* fsync() on all Append() calls
I20250115 14:55:39.872855 10225 tablet_bootstrap.cc:492] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98: No bootstrap required, opened a new log
I20250115 14:55:39.872865 10227 tablet_bootstrap.cc:492] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa: No bootstrap required, opened a new log
I20250115 14:55:39.873119 10225 ts_tablet_manager.cc:1397] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20250115 14:55:39.873142 10227 ts_tablet_manager.cc:1397] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20250115 14:55:39.874231 10226 tablet_bootstrap.cc:492] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e: No bootstrap required, opened a new log
I20250115 14:55:39.874500 10226 ts_tablet_manager.cc:1397] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20250115 14:55:39.879864 10225 raft_consensus.cc:357] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.880259 10225 raft_consensus.cc:383] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.880359 10225 raft_consensus.cc:738] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f62359bebfe4f4599589ebc9fe0aa98, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.881036 10225 consensus_queue.cc:260] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.882195 10197 heartbeater.cc:501] Master 127.9.123.254:46817 was elected leader, sending a full tablet report...
I20250115 14:55:39.882157 10227 raft_consensus.cc:357] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:39.882620 10227 raft_consensus.cc:383] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.882731 10227 raft_consensus.cc:738] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95747bbef14947678f5d61f5c3acd1aa, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.882723 10225 ts_tablet_manager.cc:1428] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20250115 14:55:39.883281 10225 tablet_bootstrap.cc:492] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98: Bootstrap starting.
I20250115 14:55:39.883512 10227 consensus_queue.cc:260] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:39.884534 10226 raft_consensus.cc:357] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.885052 10226 raft_consensus.cc:383] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.885203 10226 raft_consensus.cc:738] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a19eb9fcf43bc927b1059bee4483e, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.885300 10225 tablet_bootstrap.cc:654] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.886157 10226 consensus_queue.cc:260] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.893266 10227 ts_tablet_manager.cc:1428] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa: Time spent starting tablet: real 0.020s user 0.016s sys 0.004s
I20250115 14:55:39.893682 10225 tablet_bootstrap.cc:492] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98: No bootstrap required, opened a new log
I20250115 14:55:39.893782 10067 heartbeater.cc:501] Master 127.9.123.254:46817 was elected leader, sending a full tablet report...
I20250115 14:55:39.893821 10226 ts_tablet_manager.cc:1428] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent starting tablet: real 0.019s user 0.016s sys 0.000s
I20250115 14:55:39.893858 10225 ts_tablet_manager.cc:1397] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20250115 14:55:39.894042 10227 tablet_bootstrap.cc:492] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa: Bootstrap starting.
I20250115 14:55:39.894415 10226 tablet_bootstrap.cc:492] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e: Bootstrap starting.
I20250115 14:55:39.895694 10225 raft_consensus.cc:357] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:39.895912 10227 tablet_bootstrap.cc:654] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.895910 10225 raft_consensus.cc:383] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.896122 10225 raft_consensus.cc:738] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f62359bebfe4f4599589ebc9fe0aa98, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.896219 10234 raft_consensus.cc:491] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 14:55:39.896431 10225 consensus_queue.cc:260] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:39.896533 10234 raft_consensus.cc:513] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.897652 10225 ts_tablet_manager.cc:1428] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20250115 14:55:39.897982 10225 tablet_bootstrap.cc:492] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98: Bootstrap starting.
I20250115 14:55:39.900081 10226 tablet_bootstrap.cc:654] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.900063 10225 tablet_bootstrap.cc:654] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.908439 10234 leader_election.cc:290] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197), 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203)
I20250115 14:55:39.908550 10225 tablet_bootstrap.cc:492] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98: No bootstrap required, opened a new log
I20250115 14:55:39.908731 10225 ts_tablet_manager.cc:1397] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.008s
I20250115 14:55:39.909886 10225 raft_consensus.cc:357] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.910229 10225 raft_consensus.cc:383] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.910326 10225 raft_consensus.cc:738] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f62359bebfe4f4599589ebc9fe0aa98, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.910742 10225 consensus_queue.cc:260] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.911624 10225 ts_tablet_manager.cc:1428] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20250115 14:55:39.912084 10225 tablet_bootstrap.cc:492] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: Bootstrap starting.
I20250115 14:55:39.914496 10225 tablet_bootstrap.cc:654] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.916559 10226 tablet_bootstrap.cc:492] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e: No bootstrap required, opened a new log
I20250115 14:55:39.918675 10226 ts_tablet_manager.cc:1397] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.000s
I20250115 14:55:39.919973 10226 raft_consensus.cc:357] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:39.920316 10226 raft_consensus.cc:383] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.920375 10227 tablet_bootstrap.cc:492] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa: No bootstrap required, opened a new log
I20250115 14:55:39.920519 10226 raft_consensus.cc:738] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a19eb9fcf43bc927b1059bee4483e, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.920635 10227 ts_tablet_manager.cc:1397] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa: Time spent bootstrapping tablet: real 0.027s user 0.018s sys 0.007s
I20250115 14:55:39.920934 10226 consensus_queue.cc:260] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:39.921792 10227 raft_consensus.cc:357] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.921989 10225 tablet_bootstrap.cc:492] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: No bootstrap required, opened a new log
I20250115 14:55:39.922037 10227 raft_consensus.cc:383] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.922166 10227 raft_consensus.cc:738] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95747bbef14947678f5d61f5c3acd1aa, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.922180 10225 ts_tablet_manager.cc:1397] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.000s
I20250115 14:55:39.922432 10227 consensus_queue.cc:260] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.923003 10227 ts_tablet_manager.cc:1428] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20250115 14:55:39.923044 10225 raft_consensus.cc:357] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.923260 10225 raft_consensus.cc:383] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.923369 10225 raft_consensus.cc:738] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f62359bebfe4f4599589ebc9fe0aa98, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.924597 10226 ts_tablet_manager.cc:1428] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20250115 14:55:39.924458 10225 consensus_queue.cc:260] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.925871 10227 tablet_bootstrap.cc:492] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa: Bootstrap starting.
I20250115 14:55:39.926862 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcf91a0bb8af49bbb2b7b121a31cc59f" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95747bbef14947678f5d61f5c3acd1aa" is_pre_election: true
I20250115 14:55:39.927553 10225 ts_tablet_manager.cc:1428] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20250115 14:55:39.927969 10227 tablet_bootstrap.cc:654] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.928812 10232 raft_consensus.cc:491] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 14:55:39.929100 10232 raft_consensus.cc:513] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.929860 10152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcf91a0bb8af49bbb2b7b121a31cc59f" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" is_pre_election: true
W20250115 14:55:39.930145 9956 leader_election.cc:343] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197): Illegal state: must be running to vote when last-logged opid is not known
I20250115 14:55:39.930440 10152 raft_consensus.cc:2463] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 0.
I20250115 14:55:39.930572 10226 tablet_bootstrap.cc:492] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e: Bootstrap starting.
I20250115 14:55:39.931248 10232 leader_election.cc:290] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194:39509), 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203)
I20250115 14:55:39.931190 9957 leader_election.cc:304] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 2f62359bebfe4f4599589ebc9fe0aa98; no voters: 95747bbef14947678f5d61f5c3acd1aa
I20250115 14:55:39.932206 10234 raft_consensus.cc:2798] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 14:55:39.932394 10234 raft_consensus.cc:491] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 14:55:39.932523 10234 raft_consensus.cc:3054] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.932657 10226 tablet_bootstrap.cc:654] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.933903 10227 tablet_bootstrap.cc:492] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa: No bootstrap required, opened a new log
I20250115 14:55:39.934129 10227 ts_tablet_manager.cc:1397] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s
I20250115 14:55:39.935106 10227 raft_consensus.cc:357] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.935398 10227 raft_consensus.cc:383] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.935518 10227 raft_consensus.cc:738] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95747bbef14947678f5d61f5c3acd1aa, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.935858 10234 raft_consensus.cc:513] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.935945 10227 consensus_queue.cc:260] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.936652 10227 ts_tablet_manager.cc:1428] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250115 14:55:39.937469 10152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcf91a0bb8af49bbb2b7b121a31cc59f" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f62359bebfe4f4599589ebc9fe0aa98"
I20250115 14:55:39.937711 10152 raft_consensus.cc:3054] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.939431 10227 tablet_bootstrap.cc:492] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: Bootstrap starting.
I20250115 14:55:39.941112 10152 raft_consensus.cc:2463] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 1.
I20250115 14:55:39.942014 9957 leader_election.cc:304] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 2f62359bebfe4f4599589ebc9fe0aa98; no voters:
I20250115 14:55:39.942689 10234 leader_election.cc:290] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 election: Requested vote from peers 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197), 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203)
I20250115 14:55:39.942850 10245 raft_consensus.cc:2798] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Leader election won for term 1
I20250115 14:55:39.944118 10245 raft_consensus.cc:695] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 LEADER]: Becoming Leader. State: Replica: 0c2a19eb9fcf43bc927b1059bee4483e, State: Running, Role: LEADER
I20250115 14:55:39.945094 10227 tablet_bootstrap.cc:654] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.945281 10226 tablet_bootstrap.cc:492] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e: No bootstrap required, opened a new log
I20250115 14:55:39.944840 10245 consensus_queue.cc:237] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.945485 10226 ts_tablet_manager.cc:1397] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent bootstrapping tablet: real 0.015s user 0.007s sys 0.006s
I20250115 14:55:39.946671 10226 raft_consensus.cc:357] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.947072 10226 raft_consensus.cc:383] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.947211 10226 raft_consensus.cc:738] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a19eb9fcf43bc927b1059bee4483e, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.947714 10226 consensus_queue.cc:260] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.948688 10226 ts_tablet_manager.cc:1428] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20250115 14:55:39.950093 10226 tablet_bootstrap.cc:492] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Bootstrap starting.
I20250115 14:55:39.952626 10226 tablet_bootstrap.cc:654] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:39.953415 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcf91a0bb8af49bbb2b7b121a31cc59f" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95747bbef14947678f5d61f5c3acd1aa"
I20250115 14:55:39.953717 9891 raft_consensus.cc:3054] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.955271 10227 tablet_bootstrap.cc:492] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: No bootstrap required, opened a new log
I20250115 14:55:39.955494 10227 ts_tablet_manager.cc:1397] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.005s
I20250115 14:55:39.956422 10227 raft_consensus.cc:357] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.956673 10227 raft_consensus.cc:383] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.956797 10227 raft_consensus.cc:738] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95747bbef14947678f5d61f5c3acd1aa, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.957149 9891 raft_consensus.cc:2463] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 1.
I20250115 14:55:39.957120 10227 consensus_queue.cc:260] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.957785 10227 ts_tablet_manager.cc:1428] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250115 14:55:39.959096 10231 raft_consensus.cc:491] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 14:55:39.959267 10152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ef474794c84988b0746f7e9971d28d" candidate_uuid: "95747bbef14947678f5d61f5c3acd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" is_pre_election: true
I20250115 14:55:39.959308 10231 raft_consensus.cc:513] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.959519 10152 raft_consensus.cc:2463] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95747bbef14947678f5d61f5c3acd1aa in term 0.
I20250115 14:55:39.961371 10231 leader_election.cc:290] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197), 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194:39509)
I20250115 14:55:39.962373 9826 leader_election.cc:304] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f62359bebfe4f4599589ebc9fe0aa98, 95747bbef14947678f5d61f5c3acd1aa; no voters:
I20250115 14:55:39.962841 10232 raft_consensus.cc:2798] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 14:55:39.963028 10232 raft_consensus.cc:491] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 14:55:39.963148 10232 raft_consensus.cc:3054] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.958739 10022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ef474794c84988b0746f7e9971d28d" candidate_uuid: "95747bbef14947678f5d61f5c3acd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" is_pre_election: true
I20250115 14:55:39.965003 10022 raft_consensus.cc:2463] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95747bbef14947678f5d61f5c3acd1aa in term 0.
I20250115 14:55:39.966324 10232 raft_consensus.cc:513] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.967139 10232 leader_election.cc:290] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [CANDIDATE]: Term 1 election: Requested vote from peers 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194:39509), 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203)
I20250115 14:55:39.967870 10022 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ef474794c84988b0746f7e9971d28d" candidate_uuid: "95747bbef14947678f5d61f5c3acd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a19eb9fcf43bc927b1059bee4483e"
I20250115 14:55:39.968072 10022 raft_consensus.cc:3054] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.971150 10226 tablet_bootstrap.cc:492] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: No bootstrap required, opened a new log
I20250115 14:55:39.971298 10226 ts_tablet_manager.cc:1397] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent bootstrapping tablet: real 0.021s user 0.005s sys 0.009s
I20250115 14:55:39.971660 9750 catalog_manager.cc:5526] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194). New cstate: current_term: 1 leader_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } health_report { overall_health: UNKNOWN } } }
I20250115 14:55:39.972112 10226 raft_consensus.cc:357] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.972287 10226 raft_consensus.cc:383] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:39.972373 10226 raft_consensus.cc:738] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a19eb9fcf43bc927b1059bee4483e, State: Initialized, Role: FOLLOWER
I20250115 14:55:39.972676 10226 consensus_queue.cc:260] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.973497 10226 ts_tablet_manager.cc:1428] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250115 14:55:39.974625 10152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0ef474794c84988b0746f7e9971d28d" candidate_uuid: "95747bbef14947678f5d61f5c3acd1aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f62359bebfe4f4599589ebc9fe0aa98"
I20250115 14:55:39.974656 10021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e7c35eac2934abf8fa426adea769f7e" candidate_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" is_pre_election: true
I20250115 14:55:39.974874 10152 raft_consensus.cc:3054] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.974884 10022 raft_consensus.cc:2463] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95747bbef14947678f5d61f5c3acd1aa in term 1.
I20250115 14:55:39.975028 10021 raft_consensus.cc:2463] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f62359bebfe4f4599589ebc9fe0aa98 in term 0.
W20250115 14:55:39.975993 10198 tablet.cc:2367] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250115 14:55:39.976447 10087 leader_election.cc:304] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 2f62359bebfe4f4599589ebc9fe0aa98; no voters:
I20250115 14:55:39.976881 10231 raft_consensus.cc:2798] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 14:55:39.977010 10231 raft_consensus.cc:491] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 14:55:39.977125 10231 raft_consensus.cc:3054] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.977331 9826 leader_election.cc:304] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 95747bbef14947678f5d61f5c3acd1aa; no voters:
I20250115 14:55:39.977675 10152 raft_consensus.cc:2463] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95747bbef14947678f5d61f5c3acd1aa in term 1.
I20250115 14:55:39.977715 10232 raft_consensus.cc:2798] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Leader election won for term 1
I20250115 14:55:39.977994 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e7c35eac2934abf8fa426adea769f7e" candidate_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95747bbef14947678f5d61f5c3acd1aa" is_pre_election: true
I20250115 14:55:39.978291 9891 raft_consensus.cc:2463] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2f62359bebfe4f4599589ebc9fe0aa98 in term 0.
I20250115 14:55:39.979861 10231 raft_consensus.cc:513] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.980052 10232 raft_consensus.cc:695] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [term 1 LEADER]: Becoming Leader. State: Replica: 95747bbef14947678f5d61f5c3acd1aa, State: Running, Role: LEADER
I20250115 14:55:39.980566 10231 leader_election.cc:290] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [CANDIDATE]: Term 1 election: Requested vote from peers 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197), 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194:39509)
I20250115 14:55:39.980909 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e7c35eac2934abf8fa426adea769f7e" candidate_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95747bbef14947678f5d61f5c3acd1aa"
I20250115 14:55:39.980585 10232 consensus_queue.cc:237] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.981019 10021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e7c35eac2934abf8fa426adea769f7e" candidate_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c2a19eb9fcf43bc927b1059bee4483e"
I20250115 14:55:39.981099 9891 raft_consensus.cc:3054] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.981220 10021 raft_consensus.cc:3054] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:39.983212 10021 raft_consensus.cc:2463] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f62359bebfe4f4599589ebc9fe0aa98 in term 1.
I20250115 14:55:39.983594 10087 leader_election.cc:304] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 2f62359bebfe4f4599589ebc9fe0aa98; no voters:
I20250115 14:55:39.983894 10231 raft_consensus.cc:2798] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Leader election won for term 1
I20250115 14:55:39.984103 9891 raft_consensus.cc:2463] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2f62359bebfe4f4599589ebc9fe0aa98 in term 1.
I20250115 14:55:39.984599 10231 raft_consensus.cc:695] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 LEADER]: Becoming Leader. State: Replica: 2f62359bebfe4f4599589ebc9fe0aa98, State: Running, Role: LEADER
I20250115 14:55:39.985080 10231 consensus_queue.cc:237] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:39.988696 9750 catalog_manager.cc:5526] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193). New cstate: current_term: 1 leader_uuid: "95747bbef14947678f5d61f5c3acd1aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } health_report { overall_health: UNKNOWN } } }
I20250115 14:55:39.989171 9748 catalog_manager.cc:5526] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195). New cstate: current_term: 1 leader_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } health_report { overall_health: HEALTHY } } }
W20250115 14:55:40.020921 10068 tablet.cc:2367] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250115 14:55:40.047791 10245 raft_consensus.cc:491] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 14:55:40.048022 10245 raft_consensus.cc:513] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:40.048673 10245 leader_election.cc:290] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203), 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197)
W20250115 14:55:40.049232 9937 tablet.cc:2367] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250115 14:55:40.049347 10152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d241d40044c5fb4b38623a11c031d" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" is_pre_election: true
I20250115 14:55:40.049329 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d241d40044c5fb4b38623a11c031d" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95747bbef14947678f5d61f5c3acd1aa" is_pre_election: true
I20250115 14:55:40.049569 10152 raft_consensus.cc:2463] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 0.
I20250115 14:55:40.049597 9891 raft_consensus.cc:2463] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 0.
I20250115 14:55:40.049986 9956 leader_election.cc:304] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 95747bbef14947678f5d61f5c3acd1aa; no voters:
I20250115 14:55:40.050275 10245 raft_consensus.cc:2798] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 14:55:40.050357 10245 raft_consensus.cc:491] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 14:55:40.050458 10245 raft_consensus.cc:3054] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:40.052367 10245 raft_consensus.cc:513] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:40.052934 10245 leader_election.cc:290] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 election: Requested vote from peers 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203), 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197)
I20250115 14:55:40.053443 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d241d40044c5fb4b38623a11c031d" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95747bbef14947678f5d61f5c3acd1aa"
I20250115 14:55:40.053463 10152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df6d241d40044c5fb4b38623a11c031d" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f62359bebfe4f4599589ebc9fe0aa98"
I20250115 14:55:40.053637 10152 raft_consensus.cc:3054] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:40.053638 9891 raft_consensus.cc:3054] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:40.055559 10152 raft_consensus.cc:2463] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 1.
I20250115 14:55:40.055590 9891 raft_consensus.cc:2463] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 1.
I20250115 14:55:40.056012 9957 leader_election.cc:304] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 2f62359bebfe4f4599589ebc9fe0aa98, 95747bbef14947678f5d61f5c3acd1aa; no voters:
I20250115 14:55:40.056301 10245 raft_consensus.cc:2798] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Leader election won for term 1
I20250115 14:55:40.056468 10245 raft_consensus.cc:695] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 LEADER]: Becoming Leader. State: Replica: 0c2a19eb9fcf43bc927b1059bee4483e, State: Running, Role: LEADER
I20250115 14:55:40.056759 10245 consensus_queue.cc:237] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } }
I20250115 14:55:40.059562 9750 catalog_manager.cc:5526] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194). New cstate: current_term: 1 leader_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } health_report { overall_health: UNKNOWN } } }
I20250115 14:55:40.190730 10021 raft_consensus.cc:1270] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Refusing update from remote peer 2f62359bebfe4f4599589ebc9fe0aa98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:40.191988 10231 consensus_queue.cc:1035] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:40.197235 10152 raft_consensus.cc:1270] T c0ef474794c84988b0746f7e9971d28d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Refusing update from remote peer 95747bbef14947678f5d61f5c3acd1aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:40.198115 10232 consensus_queue.cc:1035] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:40.199604 9891 raft_consensus.cc:1270] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Refusing update from remote peer 2f62359bebfe4f4599589ebc9fe0aa98: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:40.200346 10231 consensus_queue.cc:1035] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:40.204330 10022 raft_consensus.cc:1270] T c0ef474794c84988b0746f7e9971d28d P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Refusing update from remote peer 95747bbef14947678f5d61f5c3acd1aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:40.205003 10232 consensus_queue.cc:1035] T c0ef474794c84988b0746f7e9971d28d P 95747bbef14947678f5d61f5c3acd1aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:40.212445 10151 raft_consensus.cc:1270] T bcf91a0bb8af49bbb2b7b121a31cc59f P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Refusing update from remote peer 0c2a19eb9fcf43bc927b1059bee4483e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:40.213343 10245 consensus_queue.cc:1035] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:40.221344 9890 raft_consensus.cc:1270] T bcf91a0bb8af49bbb2b7b121a31cc59f P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Refusing update from remote peer 0c2a19eb9fcf43bc927b1059bee4483e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:40.222157 10245 consensus_queue.cc:1035] T bcf91a0bb8af49bbb2b7b121a31cc59f P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:40.238226 9889 raft_consensus.cc:1270] T df6d241d40044c5fb4b38623a11c031d P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Refusing update from remote peer 0c2a19eb9fcf43bc927b1059bee4483e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:40.239568 10150 raft_consensus.cc:1270] T df6d241d40044c5fb4b38623a11c031d P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Refusing update from remote peer 0c2a19eb9fcf43bc927b1059bee4483e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:40.241494 10234 consensus_queue.cc:1035] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:40.242070 10234 consensus_queue.cc:1035] T df6d241d40044c5fb4b38623a11c031d P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:40.242719 10264 mvcc.cc:204] Tried to move back new op lower bound from 7114559243006853120 to 7114559242183397376. Current Snapshot: MvccSnapshot[applied={T|T < 7114559243006853120}]
I20250115 14:55:40.255071 10270 mvcc.cc:204] Tried to move back new op lower bound from 7114559243032629248 to 7114559242166386688. Current Snapshot: MvccSnapshot[applied={T|T < 7114559243032629248}]
I20250115 14:55:40.355104 10263 mvcc.cc:204] Tried to move back new op lower bound from 7114559243206098944 to 7114559242166386688. Current Snapshot: MvccSnapshot[applied={T|T < 7114559243096940544}]
I20250115 14:55:43.234768 9748 master_service.cc:946] ReplaceTablet: received request to replace tablet 1e7c35eac2934abf8fa426adea769f7e from {username='slave'} at 127.0.0.1:43380
I20250115 14:55:43.250208 9748 catalog_manager.cc:5813] T 00000000000000000000000000000000 P ef47843d08f24972aeb7e60c7ac3c91e: Sending DeleteTablet for 3 replicas of tablet 1e7c35eac2934abf8fa426adea769f7e
I20250115 14:55:43.251078 9748 catalog_manager.cc:6596] ReplaceTablet: tablet 1e7c35eac2934abf8fa426adea769f7e deleted and replaced by tablet 762f038a4568448a8f357aee336f7fd5
I20250115 14:55:43.253506 10001 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e7c35eac2934abf8fa426adea769f7e with delete_type TABLET_DATA_DELETED (replaced by tablet 762f038a4568448a8f357aee336f7fd5) from {username='slave'} at 127.0.0.1:58502
I20250115 14:55:43.254101 9869 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e7c35eac2934abf8fa426adea769f7e with delete_type TABLET_DATA_DELETED (replaced by tablet 762f038a4568448a8f357aee336f7fd5) from {username='slave'} at 127.0.0.1:35666
I20250115 14:55:43.254187 10131 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e7c35eac2934abf8fa426adea769f7e with delete_type TABLET_DATA_DELETED (replaced by tablet 762f038a4568448a8f357aee336f7fd5) from {username='slave'} at 127.0.0.1:56260
I20250115 14:55:43.286850 10000 tablet_service.cc:1467] Processing CreateTablet for tablet 762f038a4568448a8f357aee336f7fd5 (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20250115 14:55:43.287418 10000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762f038a4568448a8f357aee336f7fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:43.288455 9870 tablet_service.cc:1467] Processing CreateTablet for tablet 762f038a4568448a8f357aee336f7fd5 (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20250115 14:55:43.288857 9870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762f038a4568448a8f357aee336f7fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:43.291847 10130 tablet_service.cc:1467] Processing CreateTablet for tablet 762f038a4568448a8f357aee336f7fd5 (DEFAULT_TABLE table=test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]), partition=RANGE (key) PARTITION 1073741822 <= VALUES < 1610612733
I20250115 14:55:43.292341 10130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 762f038a4568448a8f357aee336f7fd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250115 14:55:43.313546 10317 tablet_bootstrap.cc:492] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa: Bootstrap starting.
I20250115 14:55:43.315809 10317 tablet_bootstrap.cc:654] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:43.316275 10319 tablet_bootstrap.cc:492] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98: Bootstrap starting.
I20250115 14:55:43.318251 10315 tablet_replica.cc:331] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: stopping tablet replica
I20250115 14:55:43.318885 10315 raft_consensus.cc:2238] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 14:55:43.319727 10315 raft_consensus.cc:2267] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 14:55:43.321787 10319 tablet_bootstrap.cc:654] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:43.322706 10313 tablet_replica.cc:331] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: stopping tablet replica
I20250115 14:55:43.323263 10313 raft_consensus.cc:2238] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Raft consensus shutting down.
I20250115 14:55:43.323625 10313 pending_rounds.cc:62] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Trying to abort 1 pending ops.
I20250115 14:55:43.323870 10313 pending_rounds.cc:69] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Aborting op as it isn't in flight: id { term: 1 index: 213 } timestamp: 7114559255675195392 op_type: WRITE_OP write_request { tablet_id: "1e7c35eac2934abf8fa426adea769f7e" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } } row_operations { rows: "<redacted>""\001\007\000\024\232\222[[+\257\204\000\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\311\326\224Z\237\362\267&\020\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\0002DNO\367\n\\\220 \000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\361b\222Xb\255\303\3130\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000a3\223F\025\013\245\317@\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\236\333\205O\233_O\261P\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\002\260\332Y\016\343\037]`\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000b\003\346P|\211\335Cp\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\177\253\314@d/vY\200\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000k\305\224Lf\334L\016\220\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000\265\230\002XYd\354\363\240\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000\001\007\000)x\216K\231\254\216\364\260\000\000\000\000\000\000\000\020\000\000\000\000\000\000\000" indirect_data: "<redacted>""03b5158dcb33fd6a73129cb015da0204eee195a83850c147e130d87b9ba94a2dfe750f616e89929f44b84923bd9378283a65b5b956fb4545e5a4e646da146398742de2ece11a5f157fb811541af384f518f619768a037f36fa5307e842585c84" } external_consistency_mode: CLIENT_PROPAGATED propagated_timestamp: 7114559255565299712 authz_token { token_data: "\010\230\233\237\274\006\"3\n\005slave\022*\n ce9f0158a2194e3b8aef7370f364ed52\020\001\030\001 \001(\001" signature: "<redacted>""O\214\254\346(@G\275\252M\370>G\013\311\346\265\007\343\244x\'\316\001\244/\032\257B\206\346&\251\237S7\023:\224\204\201\024\006\322\276\224\037T\305\235\260\245\350\2420wa\346?\350\037\234}8" signing_key_seq_num: 0 } } request_id { client_id: "5ec2b32057b24c1ab77ea22afb5ec918" seq_no: 846 first_incomplete_seq_no: 841 attempt_no: 0 }
I20250115 14:55:43.325083 10313 raft_consensus.cc:2267] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 14:55:43.325639 10314 tablet_replica.cc:331] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: stopping tablet replica
I20250115 14:55:43.326112 10314 raft_consensus.cc:2238] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 LEADER]: Raft consensus shutting down.
I20250115 14:55:43.326839 10314 raft_consensus.cc:2267] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250115 14:55:43.328887 10314 ts_tablet_manager.cc:1905] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 14:55:43.339098 10315 ts_tablet_manager.cc:1905] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 14:55:43.345549 10313 ts_tablet_manager.cc:1905] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20250115 14:55:43.350544 10317 tablet_bootstrap.cc:492] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa: No bootstrap required, opened a new log
I20250115 14:55:43.350817 10317 ts_tablet_manager.cc:1397] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.000s
I20250115 14:55:43.351763 10317 raft_consensus.cc:357] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.352135 10317 raft_consensus.cc:383] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:43.352290 10317 raft_consensus.cc:738] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95747bbef14947678f5d61f5c3acd1aa, State: Initialized, Role: FOLLOWER
I20250115 14:55:43.352595 10317 consensus_queue.cc:260] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.353299 10317 ts_tablet_manager.cc:1428] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250115 14:55:43.364899 10319 tablet_bootstrap.cc:492] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98: No bootstrap required, opened a new log
I20250115 14:55:43.365264 10319 ts_tablet_manager.cc:1397] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.019s
I20250115 14:55:43.366190 10319 raft_consensus.cc:357] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.366482 10319 raft_consensus.cc:383] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:43.366591 10319 raft_consensus.cc:738] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f62359bebfe4f4599589ebc9fe0aa98, State: Initialized, Role: FOLLOWER
I20250115 14:55:43.366814 10319 consensus_queue.cc:260] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.367614 10319 ts_tablet_manager.cc:1428] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20250115 14:55:43.370553 10315 ts_tablet_manager.cc:1918] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.215
I20250115 14:55:43.370791 10315 log.cc:1198] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: Deleting WAL directory at /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-0/wal/wals/1e7c35eac2934abf8fa426adea769f7e
I20250115 14:55:43.371265 9748 master_service.cc:946] ReplaceTablet: received request to replace tablet 1e7c35eac2934abf8fa426adea769f7e from {username='slave'} at 127.0.0.1:43380
I20250115 14:55:43.371683 10315 ts_tablet_manager.cc:1939] T 1e7c35eac2934abf8fa426adea769f7e P 95747bbef14947678f5d61f5c3acd1aa: Deleting consensus metadata
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/replace_tablet-itest.cc:133: Failure
Failed
Bad status: Not found: Tablet 1e7c35eac2934abf8fa426adea769f7e already deleted
I20250115 14:55:43.374380 10314 ts_tablet_manager.cc:1918] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.215
I20250115 14:55:43.374670 10314 log.cc:1198] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: Deleting WAL directory at /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-2/wal/wals/1e7c35eac2934abf8fa426adea769f7e
I20250115 14:55:43.374902 9735 catalog_manager.cc:4872] TS 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197): tablet 1e7c35eac2934abf8fa426adea769f7e (table test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]) successfully deleted
I20250115 14:55:43.375442 10314 ts_tablet_manager.cc:1939] T 1e7c35eac2934abf8fa426adea769f7e P 2f62359bebfe4f4599589ebc9fe0aa98: Deleting consensus metadata
I20250115 14:55:43.377238 9736 catalog_manager.cc:4872] TS 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203): tablet 1e7c35eac2934abf8fa426adea769f7e (table test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]) successfully deleted
I20250115 14:55:43.382997 10318 tablet_bootstrap.cc:492] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e: Bootstrap starting.
I20250115 14:55:43.384491 10313 ts_tablet_manager.cc:1918] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.213
I20250115 14:55:43.384701 10313 log.cc:1198] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Deleting WAL directory at /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0/minicluster-data/ts-1/wal/wals/1e7c35eac2934abf8fa426adea769f7e
I20250115 14:55:43.385275 10318 tablet_bootstrap.cc:654] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e: Neither blocks nor log segments found. Creating new log.
I20250115 14:55:43.385351 10313 ts_tablet_manager.cc:1939] T 1e7c35eac2934abf8fa426adea769f7e P 0c2a19eb9fcf43bc927b1059bee4483e: Deleting consensus metadata
I20250115 14:55:43.387326 9736 catalog_manager.cc:4872] TS 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194:39509): tablet 1e7c35eac2934abf8fa426adea769f7e (table test-workload [id=ce9f0158a2194e3b8aef7370f364ed52]) successfully deleted
I20250115 14:55:43.388585 10318 tablet_bootstrap.cc:492] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e: No bootstrap required, opened a new log
I20250115 14:55:43.388726 10318 ts_tablet_manager.cc:1397] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent bootstrapping tablet: real 0.023s user 0.004s sys 0.000s
I20250115 14:55:43.389484 10318 raft_consensus.cc:357] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.390311 10318 raft_consensus.cc:383] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250115 14:55:43.390424 10318 raft_consensus.cc:738] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c2a19eb9fcf43bc927b1059bee4483e, State: Initialized, Role: FOLLOWER
I20250115 14:55:43.390692 10318 consensus_queue.cc:260] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.391319 10318 ts_tablet_manager.cc:1428] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20250115 14:55:43.470017 10305 raft_consensus.cc:491] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250115 14:55:43.470263 10305 raft_consensus.cc:513] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.471259 10305 leader_election.cc:290] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197), 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203)
I20250115 14:55:43.471705 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762f038a4568448a8f357aee336f7fd5" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95747bbef14947678f5d61f5c3acd1aa" is_pre_election: true
I20250115 14:55:43.471757 10150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762f038a4568448a8f357aee336f7fd5" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" is_pre_election: true
I20250115 14:55:43.471998 10150 raft_consensus.cc:2463] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 0.
I20250115 14:55:43.471997 9891 raft_consensus.cc:2463] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 0.
I20250115 14:55:43.472477 9957 leader_election.cc:304] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 2f62359bebfe4f4599589ebc9fe0aa98; no voters:
I20250115 14:55:43.472764 10305 raft_consensus.cc:2798] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250115 14:55:43.472867 10305 raft_consensus.cc:491] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250115 14:55:43.472991 10305 raft_consensus.cc:3054] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:43.475330 10305 raft_consensus.cc:513] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.475859 10305 leader_election.cc:290] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 election: Requested vote from peers 95747bbef14947678f5d61f5c3acd1aa (127.9.123.193:33197), 2f62359bebfe4f4599589ebc9fe0aa98 (127.9.123.195:37203)
I20250115 14:55:43.476342 10150 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762f038a4568448a8f357aee336f7fd5" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f62359bebfe4f4599589ebc9fe0aa98"
I20250115 14:55:43.476431 9891 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "762f038a4568448a8f357aee336f7fd5" candidate_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95747bbef14947678f5d61f5c3acd1aa"
I20250115 14:55:43.476572 10150 raft_consensus.cc:3054] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98 [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:43.476661 9891 raft_consensus.cc:3054] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa [term 0 FOLLOWER]: Advancing to term 1
I20250115 14:55:43.478801 10150 raft_consensus.cc:2463] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 1.
I20250115 14:55:43.478994 9891 raft_consensus.cc:2463] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c2a19eb9fcf43bc927b1059bee4483e in term 1.
I20250115 14:55:43.479343 9957 leader_election.cc:304] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c2a19eb9fcf43bc927b1059bee4483e, 2f62359bebfe4f4599589ebc9fe0aa98; no voters:
I20250115 14:55:43.479743 10305 raft_consensus.cc:2798] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 FOLLOWER]: Leader election won for term 1
I20250115 14:55:43.479929 10305 raft_consensus.cc:695] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [term 1 LEADER]: Becoming Leader. State: Replica: 0c2a19eb9fcf43bc927b1059bee4483e, State: Running, Role: LEADER
I20250115 14:55:43.480221 10305 consensus_queue.cc:237] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } }
I20250115 14:55:43.483331 9742 catalog_manager.cc:5526] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c2a19eb9fcf43bc927b1059bee4483e (127.9.123.194). New cstate: current_term: 1 leader_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c2a19eb9fcf43bc927b1059bee4483e" member_type: VOTER last_known_addr { host: "127.9.123.194" port: 39509 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 } health_report { overall_health: UNKNOWN } } }
I20250115 14:55:43.494592 10212 meta_cache.cc:557] tablet seems to be replaced: former ID 1e7c35eac2934abf8fa426adea769f7e, new ID 762f038a4568448a8f357aee336f7fd5 (table test-workload)
W20250115 14:55:43.494827 10212 batcher.cc:441] Invalid argument: Failed to write batch of 13 ops to tablet 1e7c35eac2934abf8fa426adea769f7e after 2 attempt(s): tablet ID 1e7c35eac2934abf8fa426adea769f7e is not valid
I20250115 14:55:43.503626 10149 raft_consensus.cc:1270] T 762f038a4568448a8f357aee336f7fd5 P 2f62359bebfe4f4599589ebc9fe0aa98 [term 1 FOLLOWER]: Refusing update from remote peer 0c2a19eb9fcf43bc927b1059bee4483e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:43.503957 9889 raft_consensus.cc:1270] T 762f038a4568448a8f357aee336f7fd5 P 95747bbef14947678f5d61f5c3acd1aa [term 1 FOLLOWER]: Refusing update from remote peer 0c2a19eb9fcf43bc927b1059bee4483e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250115 14:55:43.505344 10306 consensus_queue.cc:1035] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "95747bbef14947678f5d61f5c3acd1aa" member_type: VOTER last_known_addr { host: "127.9.123.193" port: 33197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:43.506080 10306 consensus_queue.cc:1035] T 762f038a4568448a8f357aee336f7fd5 P 0c2a19eb9fcf43bc927b1059bee4483e [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f62359bebfe4f4599589ebc9fe0aa98" member_type: VOTER last_known_addr { host: "127.9.123.195" port: 37203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250115 14:55:43.521878 9711 external_mini_cluster-itest-base.cc:80] Found fatal failure
I20250115 14:55:43.522073 9711 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID 95747bbef14947678f5d61f5c3acd1aa and pid 9809
************************ BEGIN STACKS **************************
[New LWP 9810]
[New LWP 9811]
[New LWP 9812]
[New LWP 9813]
[New LWP 9819]
[New LWP 9820]
[New LWP 9821]
[New LWP 9824]
[New LWP 9825]
[New LWP 9826]
[New LWP 9827]
[New LWP 9828]
[New LWP 9829]
[New LWP 9830]
[New LWP 9831]
[New LWP 9832]
[New LWP 9833]
[New LWP 9834]
[New LWP 9835]
[New LWP 9836]
[New LWP 9837]
[New LWP 9838]
[New LWP 9839]
[New LWP 9840]
[New LWP 9841]
[New LWP 9842]
[New LWP 9843]
[New LWP 9844]
[New LWP 9845]
[New LWP 9846]
[New LWP 9847]
[New LWP 9848]
[New LWP 9849]
[New LWP 9850]
[New LWP 9851]
[New LWP 9852]
[New LWP 9853]
[New LWP 9854]
[New LWP 9855]
[New LWP 9856]
[New LWP 9857]
[New LWP 9858]
[New LWP 9859]
[New LWP 9860]
[New LWP 9861]
[New LWP 9862]
[New LWP 9863]
[New LWP 9864]
[New LWP 9865]
[New LWP 9866]
[New LWP 9867]
[New LWP 9868]
[New LWP 9869]
[New LWP 9870]
[New LWP 9871]
[New LWP 9872]
[New LWP 9873]
[New LWP 9874]
[New LWP 9875]
[New LWP 9876]
[New LWP 9877]
[New LWP 9878]
[New LWP 9879]
[New LWP 9880]
[New LWP 9881]
[New LWP 9882]
[New LWP 9883]
[New LWP 9884]
[New LWP 9885]
[New LWP 9886]
[New LWP 9887]
[New LWP 9888]
[New LWP 9889]
[New LWP 9890]
[New LWP 9891]
[New LWP 9892]
[New LWP 9893]
[New LWP 9894]
[New LWP 9895]
[New LWP 9896]
[New LWP 9897]
[New LWP 9898]
[New LWP 9899]
[New LWP 9900]
[New LWP 9901]
[New LWP 9902]
[New LWP 9903]
[New LWP 9904]
[New LWP 9905]
[New LWP 9906]
[New LWP 9907]
[New LWP 9908]
[New LWP 9909]
[New LWP 9910]
[New LWP 9911]
[New LWP 9912]
[New LWP 9913]
[New LWP 9914]
[New LWP 9915]
[New LWP 9916]
[New LWP 9917]
[New LWP 9918]
[New LWP 9919]
[New LWP 9920]
[New LWP 9921]
[New LWP 9922]
[New LWP 9923]
[New LWP 9924]
[New LWP 9925]
[New LWP 9926]
[New LWP 9927]
[New LWP 9928]
[New LWP 9929]
[New LWP 9930]
[New LWP 9931]
[New LWP 9932]
[New LWP 9933]
[New LWP 9934]
[New LWP 9935]
[New LWP 9936]
[New LWP 9937]
[New LWP 10251]
[New LWP 10273]
[New LWP 10278]
[New LWP 10300]
[New LWP 10324]
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b49
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b49
0x00007ff19faaed50 in ?? ()
Id Target Id Frame
* 1 LWP 9809 "kudu" 0x00007ff19faaed50 in ?? ()
2 LWP 9810 "kudu" 0x00007ff19faaafb9 in ?? ()
3 LWP 9811 "kudu" 0x00007ff19faaafb9 in ?? ()
4 LWP 9812 "kudu" 0x00007ff19faaafb9 in ?? ()
5 LWP 9813 "kernel-watcher-" 0x00007ff19faaafb9 in ?? ()
6 LWP 9819 "ntp client-9819" 0x00007ff19faae9e2 in ?? ()
7 LWP 9820 "file cache-evic" 0x00007ff19faaafb9 in ?? ()
8 LWP 9821 "sq_acceptor" 0x00007ff19880ecb9 in ?? ()
9 LWP 9824 "rpc reactor-982" 0x00007ff19881ba47 in ?? ()
10 LWP 9825 "rpc reactor-982" 0x00007ff19881ba47 in ?? ()
11 LWP 9826 "rpc reactor-982" 0x00007ff19881ba47 in ?? ()
12 LWP 9827 "rpc reactor-982" 0x00007ff19881ba47 in ?? ()
13 LWP 9828 "MaintenanceMgr " 0x00007ff19faaaad3 in ?? ()
14 LWP 9829 "txn-status-mana" 0x00007ff19faaafb9 in ?? ()
15 LWP 9830 "collect_and_rem" 0x00007ff19faaafb9 in ?? ()
16 LWP 9831 "tc-session-exp-" 0x00007ff19faaafb9 in ?? ()
17 LWP 9832 "rpc worker-9832" 0x00007ff19faaaad3 in ?? ()
18 LWP 9833 "rpc worker-9833" 0x00007ff19faaaad3 in ?? ()
19 LWP 9834 "rpc worker-9834" 0x00007ff19faaaad3 in ?? ()
20 LWP 9835 "rpc worker-9835" 0x00007ff19faaaad3 in ?? ()
21 LWP 9836 "rpc worker-9836" 0x00007ff19faaaad3 in ?? ()
22 LWP 9837 "rpc worker-9837" 0x00007ff19faaaad3 in ?? ()
23 LWP 9838 "rpc worker-9838" 0x00007ff19faaaad3 in ?? ()
24 LWP 9839 "rpc worker-9839" 0x00007ff19faaaad3 in ?? ()
25 LWP 9840 "rpc worker-9840" 0x00007ff19faaaad3 in ?? ()
26 LWP 9841 "rpc worker-9841" 0x00007ff19faaaad3 in ?? ()
27 LWP 9842 "rpc worker-9842" 0x00007ff19faaaad3 in ?? ()
28 LWP 9843 "rpc worker-9843" 0x00007ff19faaaad3 in ?? ()
29 LWP 9844 "rpc worker-9844" 0x00007ff19faaaad3 in ?? ()
30 LWP 9845 "rpc worker-9845" 0x00007ff19faaaad3 in ?? ()
31 LWP 9846 "rpc worker-9846" 0x00007ff19faaaad3 in ?? ()
32 LWP 9847 "rpc worker-9847" 0x00007ff19faaaad3 in ?? ()
33 LWP 9848 "rpc worker-9848" 0x00007ff19faaaad3 in ?? ()
34 LWP 9849 "rpc worker-9849" 0x00007ff19faaaad3 in ?? ()
35 LWP 9850 "rpc worker-9850" 0x00007ff19faaaad3 in ?? ()
36 LWP 9851 "rpc worker-9851" 0x00007ff19faaaad3 in ?? ()
37 LWP 9852 "rpc worker-9852" 0x00007ff19faaaad3 in ?? ()
38 LWP 9853 "rpc worker-9853" 0x00007ff19faaaad3 in ?? ()
39 LWP 9854 "rpc worker-9854" 0x00007ff19faaaad3 in ?? ()
40 LWP 9855 "rpc worker-9855" 0x00007ff19faaaad3 in ?? ()
41 LWP 9856 "rpc worker-9856" 0x00007ff19faaaad3 in ?? ()
42 LWP 9857 "rpc worker-9857" 0x00007ff19faaaad3 in ?? ()
43 LWP 9858 "rpc worker-9858" 0x00007ff19faaaad3 in ?? ()
44 LWP 9859 "rpc worker-9859" 0x00007ff19faaaad3 in ?? ()
45 LWP 9860 "rpc worker-9860" 0x00007ff19faaaad3 in ?? ()
46 LWP 9861 "rpc worker-9861" 0x00007ff19faaaad3 in ?? ()
47 LWP 9862 "rpc worker-9862" 0x00007ff19faaaad3 in ?? ()
48 LWP 9863 "rpc worker-9863" 0x00007ff19faaaad3 in ?? ()
49 LWP 9864 "rpc worker-9864" 0x00007ff19faaaad3 in ?? ()
50 LWP 9865 "rpc worker-9865" 0x00007ff19faaaad3 in ?? ()
51 LWP 9866 "rpc worker-9866" 0x00007ff19faaaad3 in ?? ()
52 LWP 9867 "rpc worker-9867" 0x00007ff19faaaad3 in ?? ()
53 LWP 9868 "rpc worker-9868" 0x00007ff19faaaad3 in ?? ()
54 LWP 9869 "rpc worker-9869" 0x00007ff19faaaad3 in ?? ()
55 LWP 9870 "rpc worker-9870" 0x00007ff19faaaad3 in ?? ()
56 LWP 9871 "rpc worker-9871" 0x00007ff19faaaad3 in ?? ()
57 LWP 9872 "rpc worker-9872" 0x00007ff19faaaad3 in ?? ()
58 LWP 9873 "rpc worker-9873" 0x00007ff19faaaad3 in ?? ()
59 LWP 9874 "rpc worker-9874" 0x00007ff19faaaad3 in ?? ()
60 LWP 9875 "rpc worker-9875" 0x00007ff19faaaad3 in ?? ()
61 LWP 9876 "rpc worker-9876" 0x00007ff19faaaad3 in ?? ()
62 LWP 9877 "rpc worker-9877" 0x00007ff19faaaad3 in ?? ()
63 LWP 9878 "rpc worker-9878" 0x00007ff19faaaad3 in ?? ()
64 LWP 9879 "rpc worker-9879" 0x00007ff19faaaad3 in ?? ()
65 LWP 9880 "rpc worker-9880" 0x00007ff19faaaad3 in ?? ()
66 LWP 9881 "rpc worker-9881" 0x00007ff19faaaad3 in ?? ()
67 LWP 9882 "rpc worker-9882" 0x00007ff19faaaad3 in ?? ()
68 LWP 9883 "rpc worker-9883" 0x00007ff19faaaad3 in ?? ()
69 LWP 9884 "rpc worker-9884" 0x00007ff19faaaad3 in ?? ()
70 LWP 9885 "rpc worker-9885" 0x00007ff19faaaad3 in ?? ()
71 LWP 9886 "rpc worker-9886" 0x00007ff19faaaad3 in ?? ()
72 LWP 9887 "rpc worker-9887" 0x00007ff19faaaad3 in ?? ()
73 LWP 9888 "rpc worker-9888" 0x00007ff19faaaad3 in ?? ()
74 LWP 9889 "rpc worker-9889" 0x00007ff19faaaad3 in ?? ()
75 LWP 9890 "rpc worker-9890" 0x00007ff19faaaad3 in ?? ()
76 LWP 9891 "rpc worker-9891" 0x00007ff19faaaad3 in ?? ()
77 LWP 9892 "rpc worker-9892" 0x00007ff19faaaad3 in ?? ()
78 LWP 9893 "rpc worker-9893" 0x00007ff19faaaad3 in ?? ()
79 LWP 9894 "rpc worker-9894" 0x00007ff19faaaad3 in ?? ()
80 LWP 9895 "rpc worker-9895" 0x00007ff19faaaad3 in ?? ()
81 LWP 9896 "rpc worker-9896" 0x00007ff19faaaad3 in ?? ()
82 LWP 9897 "rpc worker-9897" 0x00007ff19faaaad3 in ?? ()
83 LWP 9898 "rpc worker-9898" 0x00007ff19faaaad3 in ?? ()
84 LWP 9899 "rpc worker-9899" 0x00007ff19faaaad3 in ?? ()
85 LWP 9900 "rpc worker-9900" 0x00007ff19faaaad3 in ?? ()
86 LWP 9901 "rpc worker-9901" 0x00007ff19faaaad3 in ?? ()
87 LWP 9902 "rpc worker-9902" 0x00007ff19faaaad3 in ?? ()
88 LWP 9903 "rpc worker-9903" 0x00007ff19faaaad3 in ?? ()
89 LWP 9904 "rpc worker-9904" 0x00007ff19faaaad3 in ?? ()
90 LWP 9905 "rpc worker-9905" 0x00007ff19faaaad3 in ?? ()
91 LWP 9906 "rpc worker-9906" 0x00007ff19faaaad3 in ?? ()
92 LWP 9907 "rpc worker-9907" 0x00007ff19faaaad3 in ?? ()
93 LWP 9908 "rpc worker-9908" 0x00007ff19faaaad3 in ?? ()
94 LWP 9909 "rpc worker-9909" 0x00007ff19faaaad3 in ?? ()
95 LWP 9910 "rpc worker-9910" 0x00007ff19faaaad3 in ?? ()
96 LWP 9911 "rpc worker-9911" 0x00007ff19faaaad3 in ?? ()
97 LWP 9912 "rpc worker-9912" 0x00007ff19faaaad3 in ?? ()
98 LWP 9913 "rpc worker-9913" 0x00007ff19faaaad3 in ?? ()
99 LWP 9914 "rpc worker-9914" 0x00007ff19faaaad3 in ?? ()
100 LWP 9915 "rpc worker-9915" 0x00007ff19faaaad3 in ?? ()
101 LWP 9916 "rpc worker-9916" 0x00007ff19faaaad3 in ?? ()
102 LWP 9917 "rpc worker-9917" 0x00007ff19faaaad3 in ?? ()
103 LWP 9918 "rpc worker-9918" 0x00007ff19faaaad3 in ?? ()
104 LWP 9919 "rpc worker-9919" 0x00007ff19faaaad3 in ?? ()
105 LWP 9920 "rpc worker-9920" 0x00007ff19faaaad3 in ?? ()
106 LWP 9921 "rpc worker-9921" 0x00007ff19faaaad3 in ?? ()
107 LWP 9922 "rpc worker-9922" 0x00007ff19faaaad3 in ?? ()
108 LWP 9923 "rpc worker-9923" 0x00007ff19faaaad3 in ?? ()
109 LWP 9924 "rpc worker-9924" 0x00007ff19faaaad3 in ?? ()
110 LWP 9925 "rpc worker-9925" 0x00007ff19faaaad3 in ?? ()
111 LWP 9926 "rpc worker-9926" 0x00007ff19faaaad3 in ?? ()
112 LWP 9927 "rpc worker-9927" 0x00007ff19faaaad3 in ?? ()
113 LWP 9928 "rpc worker-9928" 0x00007ff19faaaad3 in ?? ()
114 LWP 9929 "rpc worker-9929" 0x00007ff19faaaad3 in ?? ()
115 LWP 9930 "rpc worker-9930" 0x00007ff19faaaad3 in ?? ()
116 LWP 9931 "rpc worker-9931" 0x00007ff19faaaad3 in ?? ()
117 LWP 9932 "diag-logger-993" 0x00007ff19faaafb9 in ?? ()
118 LWP 9933 "result-tracker-" 0x00007ff19faaafb9 in ?? ()
119 LWP 9934 "excess-log-dele" 0x00007ff19faaafb9 in ?? ()
120 LWP 9935 "acceptor-9935" 0x00007ff19881d0c7 in ?? ()
121 LWP 9936 "heartbeat-9936" 0x00007ff19faaafb9 in ?? ()
122 LWP 9937 "maintenance_sch" 0x00007ff19faaafb9 in ?? ()
123 LWP 10251 "wal-append [wor" 0x00007ff19faaafb9 in ?? ()
124 LWP 10273 "wal-append [wor" 0x00007ff19faaafb9 in ?? ()
125 LWP 10278 "wal-append [wor" 0x00007ff19faaafb9 in ?? ()
126 LWP 10300 "raft [worker]-1" 0x00007ff19faaafb9 in ?? ()
127 LWP 10324 "wal-append [wor" 0x00007ff19faaafb9 in ?? ()
Thread 127 (LWP 10324):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x0000602000187238 in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061a00012fdb0 in ?? ()
#5 0x00007ff152252090 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 126 (LWP 10300):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x000000000000008f in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x00007ff154355b24 in ?? ()
#5 0x00007ff1543557b0 in ?? ()
#6 0x000000000000011f in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007ff1543557d0 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 125 (LWP 10278):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00006020001753b8 in ?? ()
#2 0x0000000000000138 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061a0000421b0 in ?? ()
#5 0x00007ff14d92d090 in ?? ()
#6 0x0000000000000270 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 124 (LWP 10273):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00006020001792d8 in ?? ()
#2 0x0000000000000137 in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a0000463b4 in ?? ()
#5 0x00007ff14e13c090 in ?? ()
#6 0x000000000000026f in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007ff14e13c0b0 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 123 (LWP 10251):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00006020001776f8 in ?? ()
#2 0x000000000000017f in ?? ()
#3 0x0000000100000081 in ?? ()
#4 0x000061a0000457b4 in ?? ()
#5 0x00007ff14f99d090 in ?? ()
#6 0x00000000000002ff in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x00007ff14f99d0b0 in ?? ()
#9 0x0000000200000000 in ?? ()
#10 0x0000008000000189 in ?? ()
#11 0x0000000000000000 in ?? ()
Thread 122 (LWP 9937):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000014 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000017580 in ?? ()
#5 0x00007ff154b6d550 in ?? ()
#6 0x0000000000000028 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 9936):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x4586fd8a787ef55b in ?? ()
#2 0x000000000000000d in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019400 in ?? ()
#5 0x00007ff1553855b0 in ?? ()
#6 0x000000000000001a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 9935):
#0 0x00007ff19881d0c7 in ?? ()
#1 0x00006140000224a8 in ?? ()
#2 0x00007ff155bacda0 in ?? ()
#3 0x00007ff155bacd50 in ?? ()
#4 0x00007ff155bace80 in ?? ()
#5 0x00007ff155bacd70 in ?? ()
#6 0x00007ff155bacde0 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008acceb in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007ff155bacf00 in ?? ()
#11 0x00007ff155bac63c in ?? ()
#12 0x0000003255bac5b0 in ?? ()
#13 0x00007ff1553b0000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 9934):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00007ff1563c6f00 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 9933):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00007ff156bdf0c0 in ?? ()
#2 0x0000000000000005 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006110000879b0 in ?? ()
#5 0x00007ff156bdf0b0 in ?? ()
#6 0x000000000000000a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 9932):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 9931):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 9930):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 9929):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 9928):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 9927):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 9926):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 9925):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 9924):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 9923):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 9922):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 9921):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 9920):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 9919):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 9918):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 9917):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 9916):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 9915):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 9914):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 9913):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 9912):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 9911):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 9910):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 9909):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 9908):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 9907):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 9906):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 9905):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 9904):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 9903):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 9902):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 9901):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 9900):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 9899):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 9898):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 9897):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 9896):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 9895):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 9894):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 9893):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 9892):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 9891):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x00000000000000c3 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001ad08c in ?? ()
#4 0x00007ff16bfcfe50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff16bfcfe70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001ad040 in ?? ()
#9 0x00007ff19faaa770 in ?? ()
#10 0x00007ff16bfcfe70 in ?? ()
#11 0x00000ffe2d7f9fd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 75 (LWP 9890):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000036 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007ff16c7e7e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff16c7e7e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 9889):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x00000000000000a6 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a0088 in ?? ()
#4 0x00007ff16cfffe50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff16cfffe70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 73 (LWP 9888):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x00000000000000b3 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001967cc in ?? ()
#4 0x00007ff16d817e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff16d817e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000196780 in ?? ()
#9 0x00007ff19faaa770 in ?? ()
#10 0x00007ff16d817e70 in ?? ()
#11 0x00000ffe2db02fd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 72 (LWP 9887):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 9886):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 9885):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 9884):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 9883):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 9882):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 9881):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 9880):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 9879):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 9878):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 9877):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 9876):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 9875):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 9874):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 9873):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 9872):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 9871):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007ff1761b0e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff1761b0e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007ff19faaa770 in ?? ()
#10 0x00007ff1761b0e70 in ?? ()
#11 0x00000ffe2ec361d0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 9870):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000120038 in ?? ()
#4 0x00007ff1769c8e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff1769c8e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 54 (LWP 9869):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00011d048 in ?? ()
#4 0x00007ff1771e0e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff1771e0e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 53 (LWP 9868):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007ff1779f8e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff1779f8e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007ff19faaa770 in ?? ()
#10 0x00007ff1779f8e70 in ?? ()
#11 0x00000ffe2ef3f1d0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 52 (LWP 9867):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 9866):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 9865):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 9864):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 9863):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 9862):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 9861):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 9860):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 9859):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 9858):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 9857):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 9856):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 9855):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 9854):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 9853):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 9852):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 9851):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x000000000000002e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000a67e8 in ?? ()
#4 0x00007ff180391e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff180391e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 35 (LWP 9850):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007ff180ba9e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff180ba9e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007ff19faaa770 in ?? ()
#10 0x00007ff180ba9e70 in ?? ()
#11 0x00000ffe301753d0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 9849):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000074 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000967f8 in ?? ()
#4 0x00007ff1813c1e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff1813c1e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 33 (LWP 9848):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000037 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008fffc in ?? ()
#4 0x00007ff181bd9e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007ff181bd9e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008ffb0 in ?? ()
#9 0x00007ff19faaa770 in ?? ()
#10 0x00007ff181bd9e70 in ?? ()
#11 0x00000ffe3037b3d0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 32 (LWP 9847):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 9846):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 9845):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 9844):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 9843):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 9842):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 9841):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 9840):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 9839):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 9838):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 9837):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 9836):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 9835):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 9834):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 9833):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 9832):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 9831):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00007ff18a59dc80 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 9830):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 14 (LWP 9829):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00007ff18b5af1c0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 9828):
#0 0x00007ff19faaaad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 9827):
#0 0x00007ff19881ba47 in ?? ()
#1 0x00007ff18c5b22e0 in ?? ()
#2 0x000061a00000f680 in ?? ()
#3 0x00007ff18c5b22d0 in ?? ()
#4 0x00007ff18c5b24e0 in ?? ()
#5 0x00007ff18c5b2320 in ?? ()
#6 0x0000614000022498 in ?? ()
#7 0x00007ff18c5b23a0 in ?? ()
#8 0x00007ff19ae7b25d in ?? ()
#9 0x3fb9577d99a3f000 in ?? ()
#10 0x000061a00000f680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000f680 in ?? ()
#13 0x000000002f000000 in ?? ()
#14 0x00007ff100000000 in ?? ()
#15 0x41d9e1f2ba65d1cf in ?? ()
#16 0x00000ffeb18ae474 in ?? ()
#17 0x00007ff18c5b2380 in ?? ()
#18 0x00007ff19ae7fba3 in ?? ()
#19 0x00007ff18c5b2350 in ?? ()
#20 0x3fb9577d99a3f000 in ?? ()
#21 0x000000008c5b23a0 in ?? ()
#22 0x000061a00000f680 in ?? ()
#23 0x0000614000022498 in ?? ()
#24 0x3fb9577d99a3f000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 9826):
#0 0x00007ff19881ba47 in ?? ()
#1 0x00007ff18cdb32e0 in ?? ()
#2 0x000061a00000f080 in ?? ()
#3 0x00007ff18cdb32d0 in ?? ()
#4 0x00007ff18cdb34e0 in ?? ()
#5 0x00007ff18cdb3320 in ?? ()
#6 0x0000614000022298 in ?? ()
#7 0x00007ff18cdb33a0 in ?? ()
#8 0x00007ff19ae7b25d in ?? ()
#9 0x3f8a98d2ca478000 in ?? ()
#10 0x000061a00000f080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000f080 in ?? ()
#13 0x0000000015c00000 in ?? ()
#14 0x00007ff100000000 in ?? ()
#15 0x41d9e1f2ba65d1d5 in ?? ()
#16 0x00000ffeb19ae674 in ?? ()
#17 0x00007ff18cdb3380 in ?? ()
#18 0x00007ff19ae7fba3 in ?? ()
#19 0x00007ff18cdb3350 in ?? ()
#20 0x3f8a98d2ca478000 in ?? ()
#21 0x000000008cdb33a0 in ?? ()
#22 0x000061a00000f080 in ?? ()
#23 0x0000614000022298 in ?? ()
#24 0x3f8a98d2ca478000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 9825):
#0 0x00007ff19881ba47 in ?? ()
#1 0x00007ff18d5b42e0 in ?? ()
#2 0x000061a00000ea80 in ?? ()
#3 0x00007ff18d5b42d0 in ?? ()
#4 0x00007ff18d5b44e0 in ?? ()
#5 0x00007ff18d5b4320 in ?? ()
#6 0x0000614000022098 in ?? ()
#7 0x00007ff18d5b43a0 in ?? ()
#8 0x00007ff19ae7b25d in ?? ()
#9 0x3f8e1b4ddbad0000 in ?? ()
#10 0x000061a00000ea80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ea80 in ?? ()
#13 0x0000000048000000 in ?? ()
#14 0x00007ff100000000 in ?? ()
#15 0x41d9e1f2ba65d1d3 in ?? ()
#16 0x00000ffeb1aae874 in ?? ()
#17 0x00007ff18d5b4380 in ?? ()
#18 0x00007ff19ae7fba3 in ?? ()
#19 0x00007ff18d5b4350 in ?? ()
#20 0x3f8e1b4ddbad0000 in ?? ()
#21 0x000000008d5b43a0 in ?? ()
#22 0x000061a00000ea80 in ?? ()
#23 0x0000614000022098 in ?? ()
#24 0x3f8e1b4ddbad0000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 9824):
#0 0x00007ff19881ba47 in ?? ()
#1 0x00007ff18f5ad2e0 in ?? ()
#2 0x000061a00000e480 in ?? ()
#3 0x00007ff18f5ad2d0 in ?? ()
#4 0x00007ff18f5ad4e0 in ?? ()
#5 0x00007ff18f5ad320 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007ff18f5ad3a0 in ?? ()
#8 0x00007ff19ae7b25d in ?? ()
#9 0x3fb96e77a8959000 in ?? ()
#10 0x000061a00000e480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000e480 in ?? ()
#13 0x0000000020800000 in ?? ()
#14 0x00007ff100000000 in ?? ()
#15 0x41d9e1f2ba65d1d6 in ?? ()
#16 0x00000ffeb1eada74 in ?? ()
#17 0x00007ff18f5ad380 in ?? ()
#18 0x00007ff19ae7fba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 9821):
#0 0x00007ff19880ecb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007ff190fb7788 in ?? ()
#3 0x0000602000018790 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008a4931 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 9820):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00007ff1907b6080 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 9819):
#0 0x00007ff19faae9e2 in ?? ()
#1 0x00007ff18ffb3b60 in ?? ()
#2 0x00007ff18ffb3c00 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007ff18ffb3bb0 in ?? ()
#6 0x000000000177bae0 in ?? ()
#7 0x00007ff18ffb3c10 in ?? ()
#8 0x0000611000088950 in ?? ()
#9 0x00007ff18ffb3c00 in ?? ()
#10 0x000000000089ee27 in __sanitizer::theDepot ()
#11 0x00007ff1a53d2f0c in ?? ()
#12 0x00007ff1a53c27b9 in ?? ()
#13 0x00007ff1a53c6da6 in ?? ()
#14 0x00007ff1a53cb7e0 in ?? ()
#15 0x00007ff1a53cb609 in ?? ()
#16 0x0000000000a71ecd in __sanitizer::theDepot ()
#17 0x00007ff19c6c298e in ?? ()
#18 0x00007ff19faa46db in ?? ()
#19 0x00000ffeb1fee67c in ?? ()
#20 0x00007ff18ffb3400 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 9813):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x00007ff191fb8c40 in ?? ()
#2 0x000000000000001a in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000f728 in ?? ()
#5 0x00007ff191fb8c30 in ?? ()
#6 0x0000000000000034 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 9812):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 9811):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 9810):
#0 0x00007ff19faaafb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000016eb8 in ?? ()
#5 0x00007ff1937bc410 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 9809):
#0 0x00007ff19faaed50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20250115 14:55:44.111949 9711 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID 0c2a19eb9fcf43bc927b1059bee4483e and pid 9940
************************ BEGIN STACKS **************************
[New LWP 9941]
[New LWP 9942]
[New LWP 9943]
[New LWP 9944]
[New LWP 9950]
[New LWP 9951]
[New LWP 9952]
[New LWP 9955]
[New LWP 9956]
[New LWP 9957]
[New LWP 9958]
[New LWP 9959]
[New LWP 9960]
[New LWP 9961]
[New LWP 9962]
[New LWP 9963]
[New LWP 9964]
[New LWP 9965]
[New LWP 9966]
[New LWP 9967]
[New LWP 9968]
[New LWP 9969]
[New LWP 9970]
[New LWP 9971]
[New LWP 9972]
[New LWP 9973]
[New LWP 9974]
[New LWP 9975]
[New LWP 9976]
[New LWP 9977]
[New LWP 9978]
[New LWP 9979]
[New LWP 9980]
[New LWP 9981]
[New LWP 9982]
[New LWP 9983]
[New LWP 9984]
[New LWP 9985]
[New LWP 9986]
[New LWP 9987]
[New LWP 9988]
[New LWP 9989]
[New LWP 9990]
[New LWP 9991]
[New LWP 9992]
[New LWP 9993]
[New LWP 9994]
[New LWP 9995]
[New LWP 9996]
[New LWP 9997]
[New LWP 9998]
[New LWP 9999]
[New LWP 10000]
[New LWP 10001]
[New LWP 10002]
[New LWP 10003]
[New LWP 10004]
[New LWP 10005]
[New LWP 10006]
[New LWP 10007]
[New LWP 10008]
[New LWP 10009]
[New LWP 10010]
[New LWP 10011]
[New LWP 10012]
[New LWP 10013]
[New LWP 10014]
[New LWP 10015]
[New LWP 10016]
[New LWP 10017]
[New LWP 10018]
[New LWP 10019]
[New LWP 10020]
[New LWP 10021]
[New LWP 10022]
[New LWP 10023]
[New LWP 10024]
[New LWP 10025]
[New LWP 10026]
[New LWP 10027]
[New LWP 10028]
[New LWP 10029]
[New LWP 10030]
[New LWP 10031]
[New LWP 10032]
[New LWP 10033]
[New LWP 10034]
[New LWP 10035]
[New LWP 10036]
[New LWP 10037]
[New LWP 10038]
[New LWP 10039]
[New LWP 10040]
[New LWP 10041]
[New LWP 10042]
[New LWP 10043]
[New LWP 10044]
[New LWP 10045]
[New LWP 10046]
[New LWP 10047]
[New LWP 10048]
[New LWP 10049]
[New LWP 10050]
[New LWP 10051]
[New LWP 10052]
[New LWP 10053]
[New LWP 10054]
[New LWP 10055]
[New LWP 10056]
[New LWP 10057]
[New LWP 10058]
[New LWP 10059]
[New LWP 10060]
[New LWP 10061]
[New LWP 10062]
[New LWP 10063]
[New LWP 10064]
[New LWP 10065]
[New LWP 10066]
[New LWP 10067]
[New LWP 10068]
[New LWP 10305]
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b49
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b49
0x00007f02d120cd50 in ?? ()
Id Target Id Frame
* 1 LWP 9940 "kudu" 0x00007f02d120cd50 in ?? ()
2 LWP 9941 "kudu" 0x00007f02d1208fb9 in ?? ()
3 LWP 9942 "kudu" 0x00007f02d1208fb9 in ?? ()
4 LWP 9943 "kudu" 0x00007f02d1208fb9 in ?? ()
5 LWP 9944 "kernel-watcher-" 0x00007f02d1208fb9 in ?? ()
6 LWP 9950 "ntp client-9950" 0x00007f02d120c9e2 in ?? ()
7 LWP 9951 "file cache-evic" 0x00007f02d1208fb9 in ?? ()
8 LWP 9952 "sq_acceptor" 0x00007f02c9f6ccb9 in ?? ()
9 LWP 9955 "rpc reactor-995" 0x00007f02c9f79a47 in ?? ()
10 LWP 9956 "rpc reactor-995" 0x00007f02c9f79a47 in ?? ()
11 LWP 9957 "rpc reactor-995" 0x00007f02c9f79a47 in ?? ()
12 LWP 9958 "rpc reactor-995" 0x00007f02c9f79a47 in ?? ()
13 LWP 9959 "MaintenanceMgr " 0x00007f02d1208ad3 in ?? ()
14 LWP 9960 "txn-status-mana" 0x00007f02d1208fb9 in ?? ()
15 LWP 9961 "collect_and_rem" 0x00007f02d1208fb9 in ?? ()
16 LWP 9962 "tc-session-exp-" 0x00007f02d1208fb9 in ?? ()
17 LWP 9963 "rpc worker-9963" 0x00007f02d1208ad3 in ?? ()
18 LWP 9964 "rpc worker-9964" 0x00007f02d1208ad3 in ?? ()
19 LWP 9965 "rpc worker-9965" 0x00007f02d1208ad3 in ?? ()
20 LWP 9966 "rpc worker-9966" 0x00007f02d1208ad3 in ?? ()
21 LWP 9967 "rpc worker-9967" 0x00007f02d1208ad3 in ?? ()
22 LWP 9968 "rpc worker-9968" 0x00007f02d1208ad3 in ?? ()
23 LWP 9969 "rpc worker-9969" 0x00007f02d1208ad3 in ?? ()
24 LWP 9970 "rpc worker-9970" 0x00007f02d1208ad3 in ?? ()
25 LWP 9971 "rpc worker-9971" 0x00007f02d1208ad3 in ?? ()
26 LWP 9972 "rpc worker-9972" 0x00007f02d1208ad3 in ?? ()
27 LWP 9973 "rpc worker-9973" 0x00007f02d1208ad3 in ?? ()
28 LWP 9974 "rpc worker-9974" 0x00007f02d1208ad3 in ?? ()
29 LWP 9975 "rpc worker-9975" 0x00007f02d1208ad3 in ?? ()
30 LWP 9976 "rpc worker-9976" 0x00007f02d1208ad3 in ?? ()
31 LWP 9977 "rpc worker-9977" 0x00007f02d1208ad3 in ?? ()
32 LWP 9978 "rpc worker-9978" 0x00007f02d1208ad3 in ?? ()
33 LWP 9979 "rpc worker-9979" 0x00007f02d1208ad3 in ?? ()
34 LWP 9980 "rpc worker-9980" 0x00007f02d1208ad3 in ?? ()
35 LWP 9981 "rpc worker-9981" 0x00007f02d1208ad3 in ?? ()
36 LWP 9982 "rpc worker-9982" 0x00007f02d1208ad3 in ?? ()
37 LWP 9983 "rpc worker-9983" 0x00007f02d1208ad3 in ?? ()
38 LWP 9984 "rpc worker-9984" 0x00007f02d1208ad3 in ?? ()
39 LWP 9985 "rpc worker-9985" 0x00007f02d1208ad3 in ?? ()
40 LWP 9986 "rpc worker-9986" 0x00007f02d1208ad3 in ?? ()
41 LWP 9987 "rpc worker-9987" 0x00007f02d1208ad3 in ?? ()
42 LWP 9988 "rpc worker-9988" 0x00007f02d1208ad3 in ?? ()
43 LWP 9989 "rpc worker-9989" 0x00007f02d1208ad3 in ?? ()
44 LWP 9990 "rpc worker-9990" 0x00007f02d1208ad3 in ?? ()
45 LWP 9991 "rpc worker-9991" 0x00007f02d1208ad3 in ?? ()
46 LWP 9992 "rpc worker-9992" 0x00007f02d1208ad3 in ?? ()
47 LWP 9993 "rpc worker-9993" 0x00007f02d1208ad3 in ?? ()
48 LWP 9994 "rpc worker-9994" 0x00007f02d1208ad3 in ?? ()
49 LWP 9995 "rpc worker-9995" 0x00007f02d1208ad3 in ?? ()
50 LWP 9996 "rpc worker-9996" 0x00007f02d1208ad3 in ?? ()
51 LWP 9997 "rpc worker-9997" 0x00007f02d1208ad3 in ?? ()
52 LWP 9998 "rpc worker-9998" 0x00007f02d1208ad3 in ?? ()
53 LWP 9999 "rpc worker-9999" 0x00007f02d1208ad3 in ?? ()
54 LWP 10000 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
55 LWP 10001 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
56 LWP 10002 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
57 LWP 10003 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
58 LWP 10004 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
59 LWP 10005 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
60 LWP 10006 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
61 LWP 10007 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
62 LWP 10008 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
63 LWP 10009 "rpc worker-1000" 0x00007f02d1208ad3 in ?? ()
64 LWP 10010 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
65 LWP 10011 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
66 LWP 10012 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
67 LWP 10013 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
68 LWP 10014 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
69 LWP 10015 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
70 LWP 10016 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
71 LWP 10017 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
72 LWP 10018 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
73 LWP 10019 "rpc worker-1001" 0x00007f02d1208ad3 in ?? ()
74 LWP 10020 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
75 LWP 10021 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
76 LWP 10022 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
77 LWP 10023 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
78 LWP 10024 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
79 LWP 10025 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
80 LWP 10026 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
81 LWP 10027 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
82 LWP 10028 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
83 LWP 10029 "rpc worker-1002" 0x00007f02d1208ad3 in ?? ()
84 LWP 10030 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
85 LWP 10031 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
86 LWP 10032 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
87 LWP 10033 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
88 LWP 10034 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
89 LWP 10035 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
90 LWP 10036 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
91 LWP 10037 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
92 LWP 10038 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
93 LWP 10039 "rpc worker-1003" 0x00007f02d1208ad3 in ?? ()
94 LWP 10040 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
95 LWP 10041 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
96 LWP 10042 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
97 LWP 10043 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
98 LWP 10044 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
99 LWP 10045 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
100 LWP 10046 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
101 LWP 10047 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
102 LWP 10048 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
103 LWP 10049 "rpc worker-1004" 0x00007f02d1208ad3 in ?? ()
104 LWP 10050 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
105 LWP 10051 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
106 LWP 10052 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
107 LWP 10053 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
108 LWP 10054 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
109 LWP 10055 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
110 LWP 10056 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
111 LWP 10057 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
112 LWP 10058 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
113 LWP 10059 "rpc worker-1005" 0x00007f02d1208ad3 in ?? ()
114 LWP 10060 "rpc worker-1006" 0x00007f02d1208ad3 in ?? ()
115 LWP 10061 "rpc worker-1006" 0x00007f02d1208ad3 in ?? ()
116 LWP 10062 "rpc worker-1006" 0x00007f02d1208ad3 in ?? ()
117 LWP 10063 "diag-logger-100" 0x00007f02d1208fb9 in ?? ()
118 LWP 10064 "result-tracker-" 0x00007f02d1208fb9 in ?? ()
119 LWP 10065 "excess-log-dele" 0x00007f02d1208fb9 in ?? ()
120 LWP 10066 "acceptor-10066" 0x00007f02c9f7b0c7 in ?? ()
121 LWP 10067 "heartbeat-10067" 0x00007f02d1208fb9 in ?? ()
122 LWP 10068 "maintenance_sch" 0x00007f02d1208fb9 in ?? ()
123 LWP 10305 "raft [worker]-1" 0x00007f02d1208fb9 in ?? ()
Thread 123 (LWP 10305):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000098 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00007f02c2fb7b20 in ?? ()
#5 0x00007f02c2fb77b0 in ?? ()
#6 0x0000000000000130 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 122 (LWP 10068):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000017580 in ?? ()
#5 0x00007f02862cb550 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 10067):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x4586fd8a787ef55b in ?? ()
#2 0x0000000000000010 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019400 in ?? ()
#5 0x00007f0286ae35b0 in ?? ()
#6 0x0000000000000020 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 10066):
#0 0x00007f02c9f7b0c7 in ?? ()
#1 0x0000614000021ea8 in ?? ()
#2 0x00007f028730ad50 in ?? ()
#3 0x00007f028730ad80 in ?? ()
#4 0x00007f028730ae80 in ?? ()
#5 0x00007f028730ad70 in ?? ()
#6 0x00007f028730ade0 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008acceb in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007f028730af00 in ?? ()
#11 0x00007f028730a63c in ?? ()
#12 0x000000328730a5b0 in ?? ()
#13 0x00007f0286b0e000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 10065):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x00007f0287b24f00 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 10064):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x00007f028833d0c0 in ?? ()
#2 0x0000000000000005 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006110000879b0 in ?? ()
#5 0x00007f028833d0b0 in ?? ()
#6 0x000000000000000a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 10063):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 10062):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 10061):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 10060):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 10059):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 10058):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 10057):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 10056):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 10055):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 10054):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 10053):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 10052):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 10051):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 10050):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 10049):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 10048):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 10047):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 10046):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 10045):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 10044):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 10043):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 10042):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 10041):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 10040):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 10039):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 10038):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 10037):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 10036):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 10035):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 10034):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 10033):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 10032):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 10031):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 10030):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 10029):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 10028):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 10027):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 10026):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 10025):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 10024):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 10023):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 10022):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x00000000000000d6 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007f029d72de50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f029d72de70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 10021):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x00000000000000cc in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007f029df45e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f029df45e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 10020):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000007 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007f029e75de50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f029e75de70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007f02d1208770 in ?? ()
#10 0x00007f029e75de70 in ?? ()
#11 0x00000fe053cebbd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 10019):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 72 (LWP 10018):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 10017):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 10016):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 10015):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 10014):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 10013):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 10012):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 10011):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 10010):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 10009):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 10008):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 10007):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 10006):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 10005):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 10004):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 10003):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 10002):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007f02a790ee50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02a790ee70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007f02d1208770 in ?? ()
#10 0x00007f02a790ee70 in ?? ()
#11 0x00000fe054f21dd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 10001):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000120038 in ?? ()
#4 0x00007f02a8126e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02a8126e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 54 (LWP 10000):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00011d048 in ?? ()
#4 0x00007f02a893ee50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02a893ee70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 53 (LWP 9999):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007f02a9156e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02a9156e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007f02d1208770 in ?? ()
#10 0x00007f02a9156e70 in ?? ()
#11 0x00000fe05522add0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 52 (LWP 9998):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 9997):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 9996):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 9995):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 9994):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 9993):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 9992):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 9991):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 9990):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 9989):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 9988):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 9987):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 9986):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 9985):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 9984):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 9983):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 9982):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000051 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007f02b1aefe50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02b1aefe70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007f02d1208770 in ?? ()
#10 0x00007f02b1aefe70 in ?? ()
#11 0x00000fe05635dfd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 9981):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000063 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007f02b2307e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02b2307e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007f02d1208770 in ?? ()
#10 0x00007f02b2307e70 in ?? ()
#11 0x00000fe056460fd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 9980):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000012 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0000967f8 in ?? ()
#4 0x00007f02b2b1fe50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02b2b1fe70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 33 (LWP 9979):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000078 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00008fff8 in ?? ()
#4 0x00007f02b3337e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02b3337e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 32 (LWP 9978):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000041 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008d00c in ?? ()
#4 0x00007f02b3b4fe50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02b3b4fe70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00008cfc0 in ?? ()
#9 0x00007f02d1208770 in ?? ()
#10 0x00007f02b3b4fe70 in ?? ()
#11 0x00000fe056769fd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 31 (LWP 9977):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000030 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000086808 in ?? ()
#4 0x00007f02b4367e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02b4367e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 30 (LWP 9976):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00008000c in ?? ()
#4 0x00007f02b4b7fe50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02b4b7fe70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00007ffc0 in ?? ()
#9 0x00007f02d1208770 in ?? ()
#10 0x00007f02b4b7fe70 in ?? ()
#11 0x00000fe05696ffd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 29 (LWP 9975):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00007681c in ?? ()
#4 0x00007f02b5397e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007f02b5397e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000767d0 in ?? ()
#9 0x00007f02d1208770 in ?? ()
#10 0x00007f02b5397e70 in ?? ()
#11 0x00000fe056a72fd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 28 (LWP 9974):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 9973):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 9972):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 9971):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 9970):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 9969):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 9968):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 9967):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 9966):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 9965):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 9964):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 9963):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 9962):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x00007f02bbd01c80 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 9961):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 14 (LWP 9960):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x00007f02bcd3f1c0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 9959):
#0 0x00007f02d1208ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 9958):
#0 0x00007f02c9f79a47 in ?? ()
#1 0x00007f02bdd7e2e0 in ?? ()
#2 0x000061a00000f680 in ?? ()
#3 0x00007f02bdd7e2d0 in ?? ()
#4 0x00007f02bdd7e4e0 in ?? ()
#5 0x00007f02bdd7e320 in ?? ()
#6 0x0000614000022498 in ?? ()
#7 0x00007f02bdd7e3a0 in ?? ()
#8 0x00007f02cc5d925d in ?? ()
#9 0x3fb974308b5be000 in ?? ()
#10 0x000061a00000f680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000f680 in ?? ()
#13 0x000000005a000000 in ?? ()
#14 0x00007f0200000000 in ?? ()
#15 0x41d9e1f2ba65d1cf in ?? ()
#16 0x00000fe0d7ba7c74 in ?? ()
#17 0x00007f02bdd7e380 in ?? ()
#18 0x00007f02cc5ddba3 in ?? ()
#19 0x00007f02bdd7e350 in ?? ()
#20 0x3fb974308b5be000 in ?? ()
#21 0x00000000bdd7e3a0 in ?? ()
#22 0x000061a00000f680 in ?? ()
#23 0x0000614000022498 in ?? ()
#24 0x3fb974308b5be000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 9957):
#0 0x00007f02c9f79a47 in ?? ()
#1 0x00007f02be5952e0 in ?? ()
#2 0x000061a00000f080 in ?? ()
#3 0x00007f02be5952d0 in ?? ()
#4 0x00007f02be5954e0 in ?? ()
#5 0x00007f02be595320 in ?? ()
#6 0x0000614000022298 in ?? ()
#7 0x00007f02be5953a0 in ?? ()
#8 0x00007f02cc5d925d in ?? ()
#9 0x3fb6d13ce2cf9000 in ?? ()
#10 0x000061a00000f080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000f080 in ?? ()
#13 0x000000006ad00000 in ?? ()
#14 0x00007f0200000000 in ?? ()
#15 0x41d9e1f2ba65d1d2 in ?? ()
#16 0x00000fe0d7caaa74 in ?? ()
#17 0x00007f02be595380 in ?? ()
#18 0x00007f02cc5ddba3 in ?? ()
#19 0x00007f02be595350 in ?? ()
#20 0x3fb6d13ce2cf9000 in ?? ()
#21 0x00000000be5953a0 in ?? ()
#22 0x000061a00000f080 in ?? ()
#23 0x0000614000022298 in ?? ()
#24 0x3fb6d13ce2cf9000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 9956):
#0 0x00007f02c9f79a47 in ?? ()
#1 0x00007f02bedac2e0 in ?? ()
#2 0x000061a00000ea80 in ?? ()
#3 0x00007f02bedac2d0 in ?? ()
#4 0x00007f02bedac4e0 in ?? ()
#5 0x00007f02bedac320 in ?? ()
#6 0x0000614000022098 in ?? ()
#7 0x00007f02bedac3a0 in ?? ()
#8 0x00007f02cc5d925d in ?? ()
#9 0x3fb98695f144d000 in ?? ()
#10 0x000061a00000ea80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ea80 in ?? ()
#13 0x000000009b800000 in ?? ()
#14 0x00007f0200000000 in ?? ()
#15 0x41d9e1f2ba65d1d2 in ?? ()
#16 0x00000fe0d7dad874 in ?? ()
#17 0x00007f02bedac380 in ?? ()
#18 0x00007f02cc5ddba3 in ?? ()
#19 0x00007f02bedac350 in ?? ()
#20 0x3fb98695f144d000 in ?? ()
#21 0x00000000bedac3a0 in ?? ()
#22 0x000061a00000ea80 in ?? ()
#23 0x0000614000022098 in ?? ()
#24 0x3fb98695f144d000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 9955):
#0 0x00007f02c9f79a47 in ?? ()
#1 0x00007f02c0dad2e0 in ?? ()
#2 0x000061a00000e480 in ?? ()
#3 0x00007f02c0dad2d0 in ?? ()
#4 0x00007f02c0dad4e0 in ?? ()
#5 0x00007f02c0dad320 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007f02c0dad3a0 in ?? ()
#8 0x00007f02cc5d925d in ?? ()
#9 0x3fb959ef52bda000 in ?? ()
#10 0x000061a00000e480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000e480 in ?? ()
#13 0x000000006a800000 in ?? ()
#14 0x00007f0200000000 in ?? ()
#15 0x41d9e1f2ba65d1d3 in ?? ()
#16 0x00000fe0d81ada74 in ?? ()
#17 0x00007f02c0dad380 in ?? ()
#18 0x00007f02cc5ddba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 9952):
#0 0x00007f02c9f6ccb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007f02c27b7788 in ?? ()
#3 0x0000602000018790 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008a4931 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 9951):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x00007f02c1fb6080 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 9950):
#0 0x00007f02d120c9e2 in ?? ()
#1 0x00007f02c17b3b60 in ?? ()
#2 0x00007f02c17b3c00 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007f02c17b3bb0 in ?? ()
#6 0x000000000177bae0 in ?? ()
#7 0x00007f02c17b3c10 in ?? ()
#8 0x0000611000088950 in ?? ()
#9 0x00007f02c17b3c00 in ?? ()
#10 0x000000000089ee27 in __sanitizer::theDepot ()
#11 0x00007f02d6b30f0c in ?? ()
#12 0x00007f02d6b207b9 in ?? ()
#13 0x00007f02d6b24da6 in ?? ()
#14 0x00007f02d6b297e0 in ?? ()
#15 0x00007f02d6b29609 in ?? ()
#16 0x0000000000a71ecd in __sanitizer::theDepot ()
#17 0x00007f02cde2098e in ?? ()
#18 0x00007f02d12026db in ?? ()
#19 0x00000fe0d82ee67c in ?? ()
#20 0x00007f02c17b3400 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 9944):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x00007f02c37b8c40 in ?? ()
#2 0x000000000000001b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000f728 in ?? ()
#5 0x00007f02c37b8c30 in ?? ()
#6 0x0000000000000036 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 9943):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 9942):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 9941):
#0 0x00007f02d1208fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000016eb8 in ?? ()
#5 0x00007f02c4fbc410 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 9940):
#0 0x00007f02d120cd50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20250115 14:55:44.698441 9711 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 2 with UUID 2f62359bebfe4f4599589ebc9fe0aa98 and pid 10070
************************ BEGIN STACKS **************************
[New LWP 10071]
[New LWP 10072]
[New LWP 10073]
[New LWP 10074]
[New LWP 10080]
[New LWP 10081]
[New LWP 10082]
[New LWP 10085]
[New LWP 10086]
[New LWP 10087]
[New LWP 10088]
[New LWP 10089]
[New LWP 10090]
[New LWP 10091]
[New LWP 10092]
[New LWP 10093]
[New LWP 10094]
[New LWP 10095]
[New LWP 10096]
[New LWP 10097]
[New LWP 10098]
[New LWP 10099]
[New LWP 10100]
[New LWP 10101]
[New LWP 10102]
[New LWP 10103]
[New LWP 10104]
[New LWP 10105]
[New LWP 10106]
[New LWP 10107]
[New LWP 10108]
[New LWP 10109]
[New LWP 10110]
[New LWP 10111]
[New LWP 10112]
[New LWP 10113]
[New LWP 10114]
[New LWP 10115]
[New LWP 10116]
[New LWP 10117]
[New LWP 10118]
[New LWP 10119]
[New LWP 10120]
[New LWP 10121]
[New LWP 10122]
[New LWP 10123]
[New LWP 10124]
[New LWP 10125]
[New LWP 10126]
[New LWP 10127]
[New LWP 10128]
[New LWP 10129]
[New LWP 10130]
[New LWP 10131]
[New LWP 10132]
[New LWP 10133]
[New LWP 10134]
[New LWP 10135]
[New LWP 10136]
[New LWP 10137]
[New LWP 10138]
[New LWP 10139]
[New LWP 10140]
[New LWP 10141]
[New LWP 10142]
[New LWP 10143]
[New LWP 10144]
[New LWP 10145]
[New LWP 10146]
[New LWP 10147]
[New LWP 10148]
[New LWP 10149]
[New LWP 10150]
[New LWP 10151]
[New LWP 10152]
[New LWP 10153]
[New LWP 10154]
[New LWP 10155]
[New LWP 10156]
[New LWP 10157]
[New LWP 10158]
[New LWP 10159]
[New LWP 10160]
[New LWP 10161]
[New LWP 10162]
[New LWP 10163]
[New LWP 10164]
[New LWP 10165]
[New LWP 10166]
[New LWP 10167]
[New LWP 10168]
[New LWP 10169]
[New LWP 10170]
[New LWP 10171]
[New LWP 10172]
[New LWP 10173]
[New LWP 10174]
[New LWP 10175]
[New LWP 10176]
[New LWP 10177]
[New LWP 10178]
[New LWP 10179]
[New LWP 10180]
[New LWP 10181]
[New LWP 10182]
[New LWP 10183]
[New LWP 10184]
[New LWP 10185]
[New LWP 10186]
[New LWP 10187]
[New LWP 10188]
[New LWP 10189]
[New LWP 10190]
[New LWP 10191]
[New LWP 10192]
[New LWP 10193]
[New LWP 10194]
[New LWP 10195]
[New LWP 10196]
[New LWP 10197]
[New LWP 10198]
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b49
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b51
Cannot access memory at address 0x5f35535f35534b49
0x00007fd821a85d50 in ?? ()
Id Target Id Frame
* 1 LWP 10070 "kudu" 0x00007fd821a85d50 in ?? ()
2 LWP 10071 "kudu" 0x00007fd821a81fb9 in ?? ()
3 LWP 10072 "kudu" 0x00007fd821a81fb9 in ?? ()
4 LWP 10073 "kudu" 0x00007fd821a81fb9 in ?? ()
5 LWP 10074 "kernel-watcher-" 0x00007fd821a81fb9 in ?? ()
6 LWP 10080 "ntp client-1008" 0x00007fd821a859e2 in ?? ()
7 LWP 10081 "file cache-evic" 0x00007fd821a81fb9 in ?? ()
8 LWP 10082 "sq_acceptor" 0x00007fd81a7e5cb9 in ?? ()
9 LWP 10085 "rpc reactor-100" 0x00007fd81a7f2a47 in ?? ()
10 LWP 10086 "rpc reactor-100" 0x00007fd81a7f2a47 in ?? ()
11 LWP 10087 "rpc reactor-100" 0x00007fd81a7f2a47 in ?? ()
12 LWP 10088 "rpc reactor-100" 0x00007fd81a7f2a47 in ?? ()
13 LWP 10089 "MaintenanceMgr " 0x00007fd821a81ad3 in ?? ()
14 LWP 10090 "txn-status-mana" 0x00007fd821a81fb9 in ?? ()
15 LWP 10091 "collect_and_rem" 0x00007fd821a81fb9 in ?? ()
16 LWP 10092 "tc-session-exp-" 0x00007fd821a81fb9 in ?? ()
17 LWP 10093 "rpc worker-1009" 0x00007fd821a81ad3 in ?? ()
18 LWP 10094 "rpc worker-1009" 0x00007fd821a81ad3 in ?? ()
19 LWP 10095 "rpc worker-1009" 0x00007fd821a81ad3 in ?? ()
20 LWP 10096 "rpc worker-1009" 0x00007fd821a81ad3 in ?? ()
21 LWP 10097 "rpc worker-1009" 0x00007fd821a81ad3 in ?? ()
22 LWP 10098 "rpc worker-1009" 0x00007fd821a81ad3 in ?? ()
23 LWP 10099 "rpc worker-1009" 0x00007fd821a81ad3 in ?? ()
24 LWP 10100 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
25 LWP 10101 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
26 LWP 10102 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
27 LWP 10103 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
28 LWP 10104 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
29 LWP 10105 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
30 LWP 10106 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
31 LWP 10107 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
32 LWP 10108 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
33 LWP 10109 "rpc worker-1010" 0x00007fd821a81ad3 in ?? ()
34 LWP 10110 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
35 LWP 10111 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
36 LWP 10112 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
37 LWP 10113 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
38 LWP 10114 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
39 LWP 10115 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
40 LWP 10116 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
41 LWP 10117 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
42 LWP 10118 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
43 LWP 10119 "rpc worker-1011" 0x00007fd821a81ad3 in ?? ()
44 LWP 10120 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
45 LWP 10121 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
46 LWP 10122 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
47 LWP 10123 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
48 LWP 10124 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
49 LWP 10125 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
50 LWP 10126 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
51 LWP 10127 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
52 LWP 10128 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
53 LWP 10129 "rpc worker-1012" 0x00007fd821a81ad3 in ?? ()
54 LWP 10130 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
55 LWP 10131 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
56 LWP 10132 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
57 LWP 10133 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
58 LWP 10134 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
59 LWP 10135 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
60 LWP 10136 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
61 LWP 10137 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
62 LWP 10138 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
63 LWP 10139 "rpc worker-1013" 0x00007fd821a81ad3 in ?? ()
64 LWP 10140 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
65 LWP 10141 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
66 LWP 10142 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
67 LWP 10143 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
68 LWP 10144 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
69 LWP 10145 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
70 LWP 10146 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
71 LWP 10147 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
72 LWP 10148 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
73 LWP 10149 "rpc worker-1014" 0x00007fd821a81ad3 in ?? ()
74 LWP 10150 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
75 LWP 10151 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
76 LWP 10152 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
77 LWP 10153 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
78 LWP 10154 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
79 LWP 10155 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
80 LWP 10156 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
81 LWP 10157 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
82 LWP 10158 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
83 LWP 10159 "rpc worker-1015" 0x00007fd821a81ad3 in ?? ()
84 LWP 10160 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
85 LWP 10161 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
86 LWP 10162 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
87 LWP 10163 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
88 LWP 10164 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
89 LWP 10165 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
90 LWP 10166 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
91 LWP 10167 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
92 LWP 10168 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
93 LWP 10169 "rpc worker-1016" 0x00007fd821a81ad3 in ?? ()
94 LWP 10170 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
95 LWP 10171 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
96 LWP 10172 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
97 LWP 10173 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
98 LWP 10174 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
99 LWP 10175 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
100 LWP 10176 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
101 LWP 10177 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
102 LWP 10178 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
103 LWP 10179 "rpc worker-1017" 0x00007fd821a81ad3 in ?? ()
104 LWP 10180 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
105 LWP 10181 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
106 LWP 10182 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
107 LWP 10183 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
108 LWP 10184 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
109 LWP 10185 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
110 LWP 10186 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
111 LWP 10187 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
112 LWP 10188 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
113 LWP 10189 "rpc worker-1018" 0x00007fd821a81ad3 in ?? ()
114 LWP 10190 "rpc worker-1019" 0x00007fd821a81ad3 in ?? ()
115 LWP 10191 "rpc worker-1019" 0x00007fd821a81ad3 in ?? ()
116 LWP 10192 "rpc worker-1019" 0x00007fd821a81ad3 in ?? ()
117 LWP 10193 "diag-logger-101" 0x00007fd821a81fb9 in ?? ()
118 LWP 10194 "result-tracker-" 0x00007fd821a81fb9 in ?? ()
119 LWP 10195 "excess-log-dele" 0x00007fd821a81fb9 in ?? ()
120 LWP 10196 "acceptor-10196" 0x00007fd81a7f40c7 in ?? ()
121 LWP 10197 "heartbeat-10197" 0x00007fd821a81fb9 in ?? ()
122 LWP 10198 "maintenance_sch" 0x00007fd821a81fb9 in ?? ()
Thread 122 (LWP 10198):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x0000000045e0360e in ?? ()
#2 0x0000000000000015 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000616000017580 in ?? ()
#5 0x00007fd7d6b44550 in ?? ()
#6 0x000000000000002a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 121 (LWP 10197):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x4586fd8a787ef55b in ?? ()
#2 0x000000000000000b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000613000019400 in ?? ()
#5 0x00007fd7d735c5b0 in ?? ()
#6 0x0000000000000016 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 120 (LWP 10196):
#0 0x00007fd81a7f40c7 in ?? ()
#1 0x00006140000224a8 in ?? ()
#2 0x00007fd7d7b83d50 in ?? ()
#3 0x00007fd7d7b83d80 in ?? ()
#4 0x00007fd7d7b83e80 in ?? ()
#5 0x00007fd7d7b83d70 in ?? ()
#6 0x00007fd7d7b83de0 in ?? ()
#7 0x0000000000000080 in ?? ()
#8 0x00000000008acceb in __sanitizer::theDepot ()
#9 0x0000000500000014 in ?? ()
#10 0x00007fd7d7b83f00 in ?? ()
#11 0x00007fd7d7b8363c in ?? ()
#12 0x00000032d7b835b0 in ?? ()
#13 0x00007fd7d7387000 in ?? ()
#14 0x0000000000000000 in ?? ()
Thread 119 (LWP 10195):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x00007fd7d839df00 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 118 (LWP 10194):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x00007fd7d8bb60c0 in ?? ()
#2 0x0000000000000005 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x00006110000879b0 in ?? ()
#5 0x00007fd7d8bb60b0 in ?? ()
#6 0x000000000000000a in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 117 (LWP 10193):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 116 (LWP 10192):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 115 (LWP 10191):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 114 (LWP 10190):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 113 (LWP 10189):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 112 (LWP 10188):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 111 (LWP 10187):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 110 (LWP 10186):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 109 (LWP 10185):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 108 (LWP 10184):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 107 (LWP 10183):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 106 (LWP 10182):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 105 (LWP 10181):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 104 (LWP 10180):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 103 (LWP 10179):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 102 (LWP 10178):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 101 (LWP 10177):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 100 (LWP 10176):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 99 (LWP 10175):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 98 (LWP 10174):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 97 (LWP 10173):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 96 (LWP 10172):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 95 (LWP 10171):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 94 (LWP 10170):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 93 (LWP 10169):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 92 (LWP 10168):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 91 (LWP 10167):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 90 (LWP 10166):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 89 (LWP 10165):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 88 (LWP 10164):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 87 (LWP 10163):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 86 (LWP 10162):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 85 (LWP 10161):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 84 (LWP 10160):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 83 (LWP 10159):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 82 (LWP 10158):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 81 (LWP 10157):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 80 (LWP 10156):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 79 (LWP 10155):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 78 (LWP 10154):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 77 (LWP 10153):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 76 (LWP 10152):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000092 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001ad088 in ?? ()
#4 0x00007fd7edfa6e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd7edfa6e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 75 (LWP 10151):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x00000000000000aa in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d0001a6888 in ?? ()
#4 0x00007fd7ee7bee50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd7ee7bee70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 74 (LWP 10150):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x00000000000000cd in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001a008c in ?? ()
#4 0x00007fd7eefd6e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd7eefd6e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001a0040 in ?? ()
#9 0x00007fd821a81770 in ?? ()
#10 0x00007fd7eefd6e70 in ?? ()
#11 0x00000ffafddfadd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 73 (LWP 10149):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000099 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0001967cc in ?? ()
#4 0x00007fd7ef7eee50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd7ef7eee70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000196780 in ?? ()
#9 0x00007fd821a81770 in ?? ()
#10 0x00007fd7ef7eee70 in ?? ()
#11 0x00000ffafdefddd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 72 (LWP 10148):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 71 (LWP 10147):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 70 (LWP 10146):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 69 (LWP 10145):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 68 (LWP 10144):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 67 (LWP 10143):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 66 (LWP 10142):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 65 (LWP 10141):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 64 (LWP 10140):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 63 (LWP 10139):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 62 (LWP 10138):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 61 (LWP 10137):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 60 (LWP 10136):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 59 (LWP 10135):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 58 (LWP 10134):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 57 (LWP 10133):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 56 (LWP 10132):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00012683c in ?? ()
#4 0x00007fd7f8187e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd7f8187e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0001267f0 in ?? ()
#9 0x00007fd821a81770 in ?? ()
#10 0x00007fd7f8187e70 in ?? ()
#11 0x00000ffaff030fd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 55 (LWP 10131):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d000120038 in ?? ()
#4 0x00007fd7f899fe50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd7f899fe70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 54 (LWP 10130):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000002 in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00011d048 in ?? ()
#4 0x00007fd7f91b7e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd7f91b7e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 53 (LWP 10129):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000001 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00011684c in ?? ()
#4 0x00007fd7f99cfe50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd7f99cfe70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d000116800 in ?? ()
#9 0x00007fd821a81770 in ?? ()
#10 0x00007fd7f99cfe70 in ?? ()
#11 0x00000ffaff339fd0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 52 (LWP 10128):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 51 (LWP 10127):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 50 (LWP 10126):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 49 (LWP 10125):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 48 (LWP 10124):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 47 (LWP 10123):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 46 (LWP 10122):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 45 (LWP 10121):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 44 (LWP 10120):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 43 (LWP 10119):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 42 (LWP 10118):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 41 (LWP 10117):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 40 (LWP 10116):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 39 (LWP 10115):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 38 (LWP 10114):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 37 (LWP 10113):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 36 (LWP 10112):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x000000000000000f in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000a67ec in ?? ()
#4 0x00007fd802368e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd802368e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000a67a0 in ?? ()
#9 0x00007fd821a81770 in ?? ()
#10 0x00007fd802368e70 in ?? ()
#11 0x00000ffb0046d1d0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 35 (LWP 10111):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000043 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d00009ffec in ?? ()
#4 0x00007fd802b80e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd802b80e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d00009ffa0 in ?? ()
#9 0x00007fd821a81770 in ?? ()
#10 0x00007fd802b80e70 in ?? ()
#11 0x00000ffb005701d0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 34 (LWP 10110):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000047 in ?? ()
#2 0x0000000100000081 in ?? ()
#3 0x000060d0000967fc in ?? ()
#4 0x00007fd803398e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd803398e70 in ?? ()
#7 0x0000000000000001 in ?? ()
#8 0x000060d0000967b0 in ?? ()
#9 0x00007fd821a81770 in ?? ()
#10 0x00007fd803398e70 in ?? ()
#11 0x00000ffb006731d0 in ?? ()
#12 0x0000000000000000 in ?? ()
Thread 33 (LWP 10109):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x000000000000003e in ?? ()
#2 0x0000000000000081 in ?? ()
#3 0x000060d00008fff8 in ?? ()
#4 0x00007fd803bb0e50 in ?? ()
#5 0x0000008000000000 in ?? ()
#6 0x00007fd803bb0e70 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 32 (LWP 10108):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 31 (LWP 10107):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 30 (LWP 10106):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 29 (LWP 10105):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 28 (LWP 10104):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 27 (LWP 10103):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 26 (LWP 10102):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 25 (LWP 10101):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 24 (LWP 10100):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 23 (LWP 10099):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 22 (LWP 10098):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 21 (LWP 10097):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 20 (LWP 10096):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 19 (LWP 10095):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 18 (LWP 10094):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 17 (LWP 10093):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 16 (LWP 10092):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x00007fd80c571c80 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 15 (LWP 10091):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 14 (LWP 10090):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x00007fd80d5af1c0 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 13 (LWP 10089):
#0 0x00007fd821a81ad3 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 12 (LWP 10088):
#0 0x00007fd81a7f2a47 in ?? ()
#1 0x00007fd80e5b22e0 in ?? ()
#2 0x000061a00000f680 in ?? ()
#3 0x00007fd80e5b22d0 in ?? ()
#4 0x00007fd80e5b24e0 in ?? ()
#5 0x00007fd80e5b2320 in ?? ()
#6 0x0000614000022498 in ?? ()
#7 0x00007fd80e5b23a0 in ?? ()
#8 0x00007fd81ce5225d in ?? ()
#9 0x3fb98c6ee3b9e000 in ?? ()
#10 0x000061a00000f680 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000f680 in ?? ()
#13 0x00000000f5800000 in ?? ()
#14 0x00007fd800000000 in ?? ()
#15 0x41d9e1f2ba65d1d4 in ?? ()
#16 0x00000ffb81cae474 in ?? ()
#17 0x00007fd80e5b2380 in ?? ()
#18 0x00007fd81ce56ba3 in ?? ()
#19 0x00007fd80e5b2350 in ?? ()
#20 0x3fb98c6ee3b9e000 in ?? ()
#21 0x000000000e5b23a0 in ?? ()
#22 0x000061a00000f680 in ?? ()
#23 0x0000614000022498 in ?? ()
#24 0x3fb98c6ee3b9e000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 11 (LWP 10087):
#0 0x00007fd81a7f2a47 in ?? ()
#1 0x00007fd80edb32e0 in ?? ()
#2 0x000061a00000f080 in ?? ()
#3 0x00007fd80edb32d0 in ?? ()
#4 0x00007fd80edb34e0 in ?? ()
#5 0x00007fd80edb3320 in ?? ()
#6 0x0000614000022298 in ?? ()
#7 0x00007fd80edb33a0 in ?? ()
#8 0x00007fd81ce5225d in ?? ()
#9 0x3fb983488146f000 in ?? ()
#10 0x000061a00000f080 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000f080 in ?? ()
#13 0x0000000014000000 in ?? ()
#14 0x00007fd800000000 in ?? ()
#15 0x41d9e1f2ba65d1d7 in ?? ()
#16 0x00000ffb81dae674 in ?? ()
#17 0x00007fd80edb3380 in ?? ()
#18 0x00007fd81ce56ba3 in ?? ()
#19 0x00007fd80edb3350 in ?? ()
#20 0x3fb983488146f000 in ?? ()
#21 0x000000000edb33a0 in ?? ()
#22 0x000061a00000f080 in ?? ()
#23 0x0000614000022298 in ?? ()
#24 0x3fb983488146f000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 10 (LWP 10086):
#0 0x00007fd81a7f2a47 in ?? ()
#1 0x00007fd80f5b42e0 in ?? ()
#2 0x000061a00000ea80 in ?? ()
#3 0x00007fd80f5b42d0 in ?? ()
#4 0x00007fd80f5b44e0 in ?? ()
#5 0x00007fd80f5b4320 in ?? ()
#6 0x0000614000022098 in ?? ()
#7 0x00007fd80f5b43a0 in ?? ()
#8 0x00007fd81ce5225d in ?? ()
#9 0x3fb971a5f0d28000 in ?? ()
#10 0x000061a00000ea80 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000ea80 in ?? ()
#13 0x00000000e6000000 in ?? ()
#14 0x00007fd800000000 in ?? ()
#15 0x41d9e1f2ba65d1d0 in ?? ()
#16 0x00000ffb81eae874 in ?? ()
#17 0x00007fd80f5b4380 in ?? ()
#18 0x00007fd81ce56ba3 in ?? ()
#19 0x00007fd80f5b4350 in ?? ()
#20 0x3fb971a5f0d28000 in ?? ()
#21 0x000000000f5b43a0 in ?? ()
#22 0x000061a00000ea80 in ?? ()
#23 0x0000614000022098 in ?? ()
#24 0x3fb971a5f0d28000 in ?? ()
#25 0x0000000000000000 in ?? ()
Thread 9 (LWP 10085):
#0 0x00007fd81a7f2a47 in ?? ()
#1 0x00007fd8115ad2e0 in ?? ()
#2 0x000061a00000e480 in ?? ()
#3 0x00007fd8115ad2d0 in ?? ()
#4 0x00007fd8115ad4e0 in ?? ()
#5 0x00007fd8115ad320 in ?? ()
#6 0x0000614000021e98 in ?? ()
#7 0x00007fd8115ad3a0 in ?? ()
#8 0x00007fd81ce5225d in ?? ()
#9 0x3fb97368a4d2e000 in ?? ()
#10 0x000061a00000e480 in ?? ()
#11 0x42a2309ce5400000 in ?? ()
#12 0x000061a00000e480 in ?? ()
#13 0x000000006a400000 in ?? ()
#14 0x00007fd800000000 in ?? ()
#15 0x41d9e1f2ba65d1d2 in ?? ()
#16 0x00000ffb822ada74 in ?? ()
#17 0x00007fd8115ad380 in ?? ()
#18 0x00007fd81ce56ba3 in ?? ()
#19 0x0000000000000000 in ?? ()
Thread 8 (LWP 10082):
#0 0x00007fd81a7e5cb9 in ?? ()
#1 0x00000000000000c8 in ?? ()
#2 0x00007fd812fb7788 in ?? ()
#3 0x0000602000018790 in ?? ()
#4 0x0000000000000002 in ?? ()
#5 0x00000000000000c8 in ?? ()
#6 0x00000000008a4931 in __sanitizer::theDepot ()
#7 0x0000000000000000 in ?? ()
Thread 7 (LWP 10081):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x00007fd8127b6080 in ?? ()
#2 0x0000000000000000 in ?? ()
Thread 6 (LWP 10080):
#0 0x00007fd821a859e2 in ?? ()
#1 0x00007fd811fb3b60 in ?? ()
#2 0x00007fd811fb3c00 in ?? ()
#3 0x000000000000001e in ?? ()
#4 0x0000000000000030 in ?? ()
#5 0x00007fd811fb3bb0 in ?? ()
#6 0x000000000177bae0 in ?? ()
#7 0x00007fd811fb3c10 in ?? ()
#8 0x0000611000088950 in ?? ()
#9 0x00007fd811fb3c00 in ?? ()
#10 0x000000000089ee27 in __sanitizer::theDepot ()
#11 0x00007fd8273a9f0c in ?? ()
#12 0x00007fd8273997b9 in ?? ()
#13 0x00007fd82739dda6 in ?? ()
#14 0x00007fd8273a27e0 in ?? ()
#15 0x00007fd8273a2609 in ?? ()
#16 0x0000000000a71ecd in __sanitizer::theDepot ()
#17 0x00007fd81e69998e in ?? ()
#18 0x00007fd821a7b6db in ?? ()
#19 0x00000ffb823ee67c in ?? ()
#20 0x00007fd811fb3400 in ?? ()
#21 0x0000000000000000 in ?? ()
Thread 5 (LWP 10074):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x00007fd813fb8c40 in ?? ()
#2 0x000000000000001b in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x000061200000f728 in ?? ()
#5 0x00007fd813fb8c30 in ?? ()
#6 0x0000000000000036 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 4 (LWP 10073):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 3 (LWP 10072):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x0000000000000000 in ?? ()
Thread 2 (LWP 10071):
#0 0x00007fd821a81fb9 in ?? ()
#1 0x5f5347414c46000a in ?? ()
#2 0x0000000000000002 in ?? ()
#3 0x0000000000000081 in ?? ()
#4 0x0000612000016eb8 in ?? ()
#5 0x00007fd8157bc410 in ?? ()
#6 0x0000000000000004 in ?? ()
#7 0x0000000000000000 in ?? ()
Thread 1 (LWP 10070):
#0 0x00007fd821a85d50 in ?? ()
#1 0x0000000000000000 in ?? ()
************************* END STACKS ***************************
I20250115 14:55:45.300272 9711 external_mini_cluster.cc:1661] Attempting to check leaks for /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu pid 9809
I20250115 14:55:45.301882 9931 generic_service.cc:196] Checking for leaks (request via RPC)
I20250115 14:55:45.426192 9711 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu with pid 9809
W20250115 14:55:45.448240 10088 connection.cc:537] server connection from 127.9.123.193:51601 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20250115 14:55:45.448949 9711 external_mini_cluster.cc:1661] Attempting to check leaks for /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu pid 9940
I20250115 14:55:45.456363 10062 generic_service.cc:196] Checking for leaks (request via RPC)
W20250115 14:55:45.586916 9956 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.123.193:33197: connect: Connection refused (error 111)
I20250115 14:55:45.587781 9711 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu with pid 9940
I20250115 14:55:45.610852 9711 external_mini_cluster.cc:1661] Attempting to check leaks for /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu pid 10070
I20250115 14:55:45.617771 10192 generic_service.cc:196] Checking for leaks (request via RPC)
I20250115 14:55:45.742048 9711 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu with pid 10070
I20250115 14:55:45.764189 9711 external_mini_cluster.cc:1661] Attempting to check leaks for /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu pid 9719
I20250115 14:55:45.765579 9780 generic_service.cc:196] Checking for leaks (request via RPC)
I20250115 14:55:45.873286 9711 external_mini_cluster.cc:1620] Killing /tmp/dist-test-taskf3gU9X/build/asan/bin/kudu with pid 9719
2025-01-15T14:55:45Z chronyd exiting
I20250115 14:55:45.908584 9711 test_util.cc:181] -----------------------------------------------
I20250115 14:55:45.908682 9711 test_util.cc:182] Had failures, leaving test files at /tmp/dist-test-taskf3gU9X/test-tmp/replace_tablet-itest.0.ReplaceTabletITest.ReplaceTabletsWhileWriting.1736952937685197-9711-0
[ FAILED ] ReplaceTabletITest.ReplaceTabletsWhileWriting (8156 ms)
[----------] 1 test from ReplaceTabletITest (8156 ms total)
[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (8156 ms total)
[ PASSED ] 0 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] ReplaceTabletITest.ReplaceTabletsWhileWriting
1 FAILED TEST