[==========] Running 5 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 5 tests from TabletCopyClientSessionITest
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping
2024-05-02T21:29:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T21:29:37Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20240502 21:29:37.073499 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:36113
--webserver_interface=127.6.51.254
--webserver_port=0
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.51.254:36113
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 21:29:37.399209 6359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:37.399530 6359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:37.399628 6359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:37.407159 6359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 21:29:37.407280 6359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:37.407333 6359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 21:29:37.407389 6359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 21:29:37.416646 6359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.6.51.254:36113
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:36113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.51.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:37.418090 6359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:37.419839 6359 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:37.430853 6365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:37.431501 6359 server_base.cc:1034] running on GCE node
W20240502 21:29:37.431860 6364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:37.431905 6368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:37.432885 6359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:37.434422 6359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:37.435653 6359 hybrid_clock.cc:648] HybridClock initialized: now 1714685377435566 us; error 62 us; skew 500 ppm
I20240502 21:29:37.435995 6359 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:37.442997 6359 webserver.cc:460] Webserver started at http://127.6.51.254:43587/ using document root <none> and password file <none>
I20240502 21:29:37.443817 6359 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:37.443948 6359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:37.444269 6359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:37.447176 6359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/instance:
uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9"
format_stamp: "Formatted at 2024-05-02 21:29:37 on dist-test-slave-ns1z"
I20240502 21:29:37.448004 6359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal/instance:
uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9"
format_stamp: "Formatted at 2024-05-02 21:29:37 on dist-test-slave-ns1z"
I20240502 21:29:37.453703 6359 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20240502 21:29:37.457172 6374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:37.458539 6359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20240502 21:29:37.458706 6359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9"
format_stamp: "Formatted at 2024-05-02 21:29:37 on dist-test-slave-ns1z"
I20240502 21:29:37.458899 6359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:37.484742 6359 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:37.485678 6359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:37.485934 6359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:37.502969 6359 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.254:36113
I20240502 21:29:37.503001 6426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.254:36113 every 8 connection(s)
I20240502 21:29:37.504357 6359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
I20240502 21:29:37.508176 6427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:37.511462 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 6359
I20240502 21:29:37.511771 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal/instance
I20240502 21:29:37.520197 6427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Bootstrap starting.
I20240502 21:29:37.523226 6427 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Neither blocks nor log segments found. Creating new log.
I20240502 21:29:37.524209 6427 log.cc:824] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:37.526782 6427 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: No bootstrap required, opened a new log
I20240502 21:29:37.535636 6427 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } }
I20240502 21:29:37.535989 6427 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:29:37.536090 6427 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a1c87f0bd50479f83a5cc9d0ee213a9, State: Initialized, Role: FOLLOWER
I20240502 21:29:37.536862 6427 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } }
I20240502 21:29:37.537138 6427 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:37.537293 6427 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:37.537477 6427 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:29:37.539840 6427 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } }
I20240502 21:29:37.540328 6427 leader_election.cc:302] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a1c87f0bd50479f83a5cc9d0ee213a9; no voters:
I20240502 21:29:37.541014 6427 leader_election.cc:288] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:29:37.541167 6432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:29:37.542454 6432 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 1 LEADER]: Becoming Leader. State: Replica: 2a1c87f0bd50479f83a5cc9d0ee213a9, State: Running, Role: LEADER
I20240502 21:29:37.542939 6432 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } }
I20240502 21:29:37.543169 6427 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 21:29:37.545876 6434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a1c87f0bd50479f83a5cc9d0ee213a9. Latest consensus state: current_term: 1 leader_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } } }
I20240502 21:29:37.545941 6433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } } }
I20240502 21:29:37.546262 6434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:37.546267 6433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:37.549715 6440 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 21:29:37.555231 6440 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 21:29:37.565794 6440 catalog_manager.cc:1347] Generated new cluster ID: 7abab4496ed24e97a7c8d0587dfd0acd
I20240502 21:29:37.565919 6440 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 21:29:37.588080 6440 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 21:29:37.589437 6440 catalog_manager.cc:1504] Loading token signing keys...
I20240502 21:29:37.599829 6440 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Generated new TSK 0
I20240502 21:29:37.600721 6440 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 21:29:37.607247 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:0
--local_ip_for_outbound_sockets=127.6.51.193
--webserver_interface=127.6.51.193
--webserver_port=0
--tserver_master_addrs=127.6.51.254:36113
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:37.973650 6451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:37.973946 6451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:37.974037 6451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:37.981544 6451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:37.981748 6451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:29:37.990926 6451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=0
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:37.992276 6451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:37.994120 6451 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:38.005860 6456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:38.006356 6457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:38.006948 6459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:38.007452 6451 server_base.cc:1034] running on GCE node
I20240502 21:29:38.008054 6451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:38.009011 6451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:38.010218 6451 hybrid_clock.cc:648] HybridClock initialized: now 1714685378010145 us; error 51 us; skew 500 ppm
I20240502 21:29:38.010506 6451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:38.012638 6451 webserver.cc:460] Webserver started at http://127.6.51.193:38625/ using document root <none> and password file <none>
I20240502 21:29:38.013387 6451 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:38.013515 6451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:38.013823 6451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:38.016466 6451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/instance:
uuid: "09cd17ec860940a78124fb2801281362"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:38.017279 6451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal/instance:
uuid: "09cd17ec860940a78124fb2801281362"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:38.022382 6451 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20240502 21:29:38.025830 6465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:38.027153 6451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20240502 21:29:38.027304 6451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "09cd17ec860940a78124fb2801281362"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:38.027485 6451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:38.071388 6451 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:38.072288 6451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:38.072577 6451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:38.073590 6451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:38.075109 6451 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:38.075182 6451 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:38.075301 6451 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:38.075356 6451 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:38.104986 6451 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:34991
I20240502 21:29:38.105044 6579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:34991 every 8 connection(s)
I20240502 21:29:38.106317 6451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:29:38.107061 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 6451
I20240502 21:29:38.107292 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal/instance
I20240502 21:29:38.111220 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:0
--local_ip_for_outbound_sockets=127.6.51.194
--webserver_interface=127.6.51.194
--webserver_port=0
--tserver_master_addrs=127.6.51.254:36113
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 21:29:38.119763 6580 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:38.120066 6580 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:38.120958 6580 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:38.123100 6391 ts_manager.cc:194] Registered new tserver with Master: 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:38.124612 6391 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:33631
W20240502 21:29:38.435410 6584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:38.435721 6584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:38.435834 6584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:38.443346 6584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:38.443563 6584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:38.452625 6584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=0
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:38.454047 6584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:38.455932 6584 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:38.467936 6589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:38.468425 6590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:38.469007 6592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:38.469411 6584 server_base.cc:1034] running on GCE node
I20240502 21:29:38.469985 6584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:38.470901 6584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:38.472106 6584 hybrid_clock.cc:648] HybridClock initialized: now 1714685378472042 us; error 41 us; skew 500 ppm
I20240502 21:29:38.472404 6584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:38.474833 6584 webserver.cc:460] Webserver started at http://127.6.51.194:36061/ using document root <none> and password file <none>
I20240502 21:29:38.475584 6584 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:38.475715 6584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:38.476006 6584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:38.478746 6584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/instance:
uuid: "388a493a514d434881270f4c24d030f3"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:38.479525 6584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal/instance:
uuid: "388a493a514d434881270f4c24d030f3"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:38.484721 6584 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20240502 21:29:38.488145 6598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:38.489524 6584 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:38.489687 6584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "388a493a514d434881270f4c24d030f3"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:38.489876 6584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:38.508503 6584 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:38.509357 6584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:38.509639 6584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:38.510654 6584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:38.512220 6584 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:38.512297 6584 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:38.512421 6584 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:38.512480 6584 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:38.542596 6584 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:43501
I20240502 21:29:38.542661 6711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:43501 every 8 connection(s)
I20240502 21:29:38.543936 6584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:38.549187 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 6584
I20240502 21:29:38.549363 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal/instance
I20240502 21:29:38.556959 6712 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:38.557266 6712 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:38.558123 6712 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:38.559504 6391 ts_manager.cc:194] Registered new tserver with Master: 388a493a514d434881270f4c24d030f3 (127.6.51.194:43501)
I20240502 21:29:38.560235 6391 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:58141
I20240502 21:29:38.565443 6351 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 21:29:38.583068 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 6584
I20240502 21:29:38.591593 6707 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:38.672422 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 6584
I20240502 21:29:38.687865 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 6359
I20240502 21:29:38.689113 6422 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:38.788497 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 6359
I20240502 21:29:38.808063 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:36113
--webserver_interface=127.6.51.254
--webserver_port=43587
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.51.254:36113
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240502 21:29:39.127660 6580 heartbeater.cc:503] Master 127.6.51.254:36113 was elected leader, sending a full tablet report...
W20240502 21:29:39.129388 6580 heartbeater.cc:644] Failed to heartbeat to 127.6.51.254:36113 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.51.254:36113: connect: Connection refused (error 111)
W20240502 21:29:39.141227 6724 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:39.141531 6724 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:39.141629 6724 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:39.149308 6724 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 21:29:39.149428 6724 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:39.149479 6724 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 21:29:39.149536 6724 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 21:29:39.158919 6724 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.6.51.254:36113
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:36113
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.51.254
--webserver_port=43587
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:39.160305 6724 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:39.162130 6724 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:39.172855 6730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:39.173270 6731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:39.173764 6733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:39.174198 6724 server_base.cc:1034] running on GCE node
I20240502 21:29:39.175000 6724 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:39.176442 6724 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:39.177659 6724 hybrid_clock.cc:648] HybridClock initialized: now 1714685379177596 us; error 33 us; skew 500 ppm
I20240502 21:29:39.177996 6724 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:39.180282 6724 webserver.cc:460] Webserver started at http://127.6.51.254:43587/ using document root <none> and password file <none>
I20240502 21:29:39.181072 6724 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:39.181231 6724 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:39.186520 6724 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20240502 21:29:39.189487 6739 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:39.190848 6724 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:39.191018 6724 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9"
format_stamp: "Formatted at 2024-05-02 21:29:37 on dist-test-slave-ns1z"
I20240502 21:29:39.191880 6724 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:39.209830 6724 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:39.210749 6724 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:39.211025 6724 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:39.227980 6724 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.254:36113
I20240502 21:29:39.227999 6790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.254:36113 every 8 connection(s)
I20240502 21:29:39.229565 6724 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
I20240502 21:29:39.234187 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 6724
I20240502 21:29:39.237234 6791 sys_catalog.cc:263] Verifying existing consensus state
I20240502 21:29:39.240943 6791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Bootstrap starting.
I20240502 21:29:39.257761 6791 log.cc:824] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:39.267215 6791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:39.267740 6791 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Bootstrap complete.
I20240502 21:29:39.274960 6791 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } }
I20240502 21:29:39.275725 6791 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a1c87f0bd50479f83a5cc9d0ee213a9, State: Initialized, Role: FOLLOWER
I20240502 21:29:39.276352 6791 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } }
I20240502 21:29:39.276577 6791 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:39.276687 6791 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:39.276880 6791 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:29:39.280483 6791 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } }
I20240502 21:29:39.281018 6791 leader_election.cc:302] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a1c87f0bd50479f83a5cc9d0ee213a9; no voters:
I20240502 21:29:39.281580 6791 leader_election.cc:288] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:29:39.281729 6796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:29:39.282325 6796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [term 2 LEADER]: Becoming Leader. State: Replica: 2a1c87f0bd50479f83a5cc9d0ee213a9, State: Running, Role: LEADER
I20240502 21:29:39.282835 6796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } }
I20240502 21:29:39.283530 6791 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 21:29:39.285315 6797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } } }
I20240502 21:29:39.285640 6797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:39.286705 6798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a1c87f0bd50479f83a5cc9d0ee213a9. Latest consensus state: current_term: 2 leader_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a1c87f0bd50479f83a5cc9d0ee213a9" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 36113 } } }
I20240502 21:29:39.286945 6798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:39.287959 6801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 21:29:39.293956 6801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 21:29:39.295555 6801 catalog_manager.cc:1259] Loaded cluster ID: 7abab4496ed24e97a7c8d0587dfd0acd
I20240502 21:29:39.295667 6801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 21:29:39.299933 6801 catalog_manager.cc:1504] Loading token signing keys...
I20240502 21:29:39.301518 6801 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a1c87f0bd50479f83a5cc9d0ee213a9: Loaded TSK: 0
I20240502 21:29:39.303237 6801 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 21:29:40.136317 6580 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:40.136577 6580 heartbeater.cc:503] Master 127.6.51.254:36113 was elected leader, sending a full tablet report...
I20240502 21:29:40.138717 6756 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "09cd17ec860940a78124fb2801281362" instance_seqno: 1714685378097670) as {username='slave'} at 127.6.51.193:56969; Asking this server to re-register.
I20240502 21:29:40.139451 6580 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:40.139683 6580 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:40.140985 6756 ts_manager.cc:194] Registered new tserver with Master: 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:40.151239 6351 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 21:29:40.151557 6351 test_util.cc:268] Using random seed: 1291602143
I20240502 21:29:40.176039 6756 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48558:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 21:29:40.202436 6513 tablet_service.cc:1467] Processing CreateTablet for tablet 8663ca58300140809d7e5f5b624959be (DEFAULT_TABLE table=test-workload [id=ad8667e64a194469b06768cd37d051f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 21:29:40.203908 6513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8663ca58300140809d7e5f5b624959be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:40.214573 6827 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap starting.
I20240502 21:29:40.217710 6827 tablet_bootstrap.cc:654] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Neither blocks nor log segments found. Creating new log.
I20240502 21:29:40.218777 6827 log.cc:824] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:40.221386 6827 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: No bootstrap required, opened a new log
I20240502 21:29:40.221699 6827 ts_tablet_manager.cc:1367] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20240502 21:29:40.227895 6827 raft_consensus.cc:348] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:40.228245 6827 raft_consensus.cc:374] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:29:40.228345 6827 raft_consensus.cc:729] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cd17ec860940a78124fb2801281362, State: Initialized, Role: FOLLOWER
I20240502 21:29:40.229032 6827 consensus_queue.cc:260] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:40.229238 6827 raft_consensus.cc:388] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:40.229364 6827 raft_consensus.cc:482] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:40.229513 6827 raft_consensus.cc:3037] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:29:40.231842 6827 raft_consensus.cc:504] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:40.232405 6827 leader_election.cc:302] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cd17ec860940a78124fb2801281362; no voters:
I20240502 21:29:40.233073 6827 leader_election.cc:288] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:29:40.233232 6829 raft_consensus.cc:2781] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:29:40.234810 6827 ts_tablet_manager.cc:1398] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20240502 21:29:40.235209 6829 raft_consensus.cc:686] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 1 LEADER]: Becoming Leader. State: Replica: 09cd17ec860940a78124fb2801281362, State: Running, Role: LEADER
I20240502 21:29:40.235736 6829 consensus_queue.cc:237] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:40.241708 6756 catalog_manager.cc:5484] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09cd17ec860940a78124fb2801281362 (127.6.51.193). New cstate: current_term: 1 leader_uuid: "09cd17ec860940a78124fb2801281362" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } health_report { overall_health: HEALTHY } } }
I20240502 21:29:40.907030 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:43501
--local_ip_for_outbound_sockets=127.6.51.194
--tserver_master_addrs=127.6.51.254:36113
--webserver_port=36061
--webserver_interface=127.6.51.194
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:41.234593 6845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:41.234898 6845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:41.235009 6845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:41.242758 6845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:41.242974 6845 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:41.252514 6845 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:43501
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=36061
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:41.253968 6845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:41.255813 6845 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:41.268276 6851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:41.268774 6850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:41.268879 6853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:41.269251 6845 server_base.cc:1034] running on GCE node
I20240502 21:29:41.269850 6845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:41.270829 6845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:41.272047 6845 hybrid_clock.cc:648] HybridClock initialized: now 1714685381271985 us; error 34 us; skew 500 ppm
I20240502 21:29:41.272375 6845 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:41.274700 6845 webserver.cc:460] Webserver started at http://127.6.51.194:36061/ using document root <none> and password file <none>
I20240502 21:29:41.275476 6845 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:41.275619 6845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:41.281044 6845 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20240502 21:29:41.283833 6859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:41.285284 6845 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:41.285444 6845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "388a493a514d434881270f4c24d030f3"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:41.286293 6845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:41.350589 6845 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:41.351537 6845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:41.351832 6845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:41.352948 6845 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:41.354635 6845 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:41.354732 6845 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:41.354841 6845 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:41.354909 6845 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:41.387678 6845 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:43501
I20240502 21:29:41.387722 6971 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:43501 every 8 connection(s)
I20240502 21:29:41.389269 6845 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:41.396937 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 6845
I20240502 21:29:41.401101 6351 tablet_copy_client_session-itest.cc:139] Starting loop 0
I20240502 21:29:41.401314 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 6451
I20240502 21:29:41.402406 6575 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:41.404623 6972 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:41.405102 6972 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:41.406376 6972 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:41.408449 6756 ts_manager.cc:194] Registered new tserver with Master: 388a493a514d434881270f4c24d030f3 (127.6.51.194:43501)
I20240502 21:29:41.410079 6756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:34157
I20240502 21:29:41.504729 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 6451
I20240502 21:29:41.526124 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:34991
--local_ip_for_outbound_sockets=127.6.51.193
--tserver_master_addrs=127.6.51.254:36113
--webserver_port=38625
--webserver_interface=127.6.51.193
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 21:29:41.547077 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.560263 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.567229 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.568289 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.572224 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.573848 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.577867 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.578887 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.585808 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.586911 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.592794 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.593899 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.596518 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.597577 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.624137 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.625546 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.628650 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.629714 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.632249 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.633304 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.644611 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.645839 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.653661 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.654824 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.678094 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.679294 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.681775 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.682919 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.699610 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.700940 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.703341 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.710789 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.715169 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.716262 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.720472 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.727762 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.737120 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.738299 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.749562 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.750737 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.759785 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.760999 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.763410 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.764467 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.770371 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.778082 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.784731 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.785837 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.797858 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.798991 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.806927 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.808130 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.817119 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.818240 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.822235 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.829161 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.832185 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.833281 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.839426 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.840585 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.842787 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.843837 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.849033 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.851814 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.858338 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.859429 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.862293 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.869406 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.879377 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.880456 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.896157 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.897678 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
W20240502 21:29:41.898861 6983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:41.899286 6983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:41.899451 6983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240502 21:29:41.903785 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.905273 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.908985 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
W20240502 21:29:41.909014 6983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:41.909237 6983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:29:41.911285 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.913862 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.917456 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.921810 6983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:34991
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=38625
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:41.923182 6983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:41.925136 6983 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 21:29:41.932766 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.934150 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
W20240502 21:29:41.938769 7154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:41.938809 7152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:41.939330 7151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:41.939730 6983 server_base.cc:1034] running on GCE node
I20240502 21:29:41.940347 6983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:41.941388 6983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:41.942623 6983 hybrid_clock.cc:648] HybridClock initialized: now 1714685381942552 us; error 42 us; skew 500 ppm
I20240502 21:29:41.942965 6983 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:41.945334 6983 webserver.cc:460] Webserver started at http://127.6.51.193:38625/ using document root <none> and password file <none>
I20240502 21:29:41.946092 6983 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:41.946233 6983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:41.949442 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.950568 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.954222 6983 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.000s
I20240502 21:29:41.957278 7168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:41.958696 6983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240502 21:29:41.958878 6983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "09cd17ec860940a78124fb2801281362"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:41.959816 6983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:41.968605 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.969710 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.975661 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.978276 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.982712 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.985486 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.988116 6983 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:41.989040 6983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:41.989297 6983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:41.990353 6983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:41.992415 7187 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240502 21:29:41.995824 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:41.997474 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:41.999850 6983 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 21:29:41.999956 6983 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.008s user 0.001s sys 0.000s
I20240502 21:29:42.000049 6983 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 21:29:42.003033 6983 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 21:29:42.003129 6983 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20240502 21:29:42.003526 7187 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap starting.
I20240502 21:29:42.006238 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.007328 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.020001 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.024246 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.030022 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.031108 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.037098 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.039427 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.057705 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.070618 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.073172 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.075320 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.085331 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.087234 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.093317 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.101922 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.102128 6983 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:34991
I20240502 21:29:42.102299 7329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:34991 every 8 connection(s)
I20240502 21:29:42.104287 6983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:29:42.108027 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 6983
I20240502 21:29:42.122004 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.122536 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
I20240502 21:29:42.124684 7332 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
W20240502 21:29:42.124715 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.125063 7332 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:42.126044 7332 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:42.127652 7187 log.cc:824] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:42.128734 6756 ts_manager.cc:194] Re-registered known tserver with Master: 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.130260 6756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:42643
I20240502 21:29:42.135517 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.136584 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.137244 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.137398 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.137571 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.143107 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.145557 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.146207 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.146344 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.146540 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.150390 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.154114 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.154731 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.154884 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.155051 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.162319 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.163483 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.164233 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.164393 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.164614 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.167750 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.173120 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.173768 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.173925 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.174111 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.178759 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.179812 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.180452 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.180630 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.180871 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.191860 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.193020 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.193707 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.193907 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.194097 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.198343 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.205533 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.206292 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.206442 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.206591 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.212488 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.213596 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.214227 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.214380 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.214556 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.217718 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.219056 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.219862 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.220007 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.220180 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.230721 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.231876 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.232601 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.232786 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.232987 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.240103 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.241437 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.242102 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.242270 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.242486 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.249619 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.250777 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.251456 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.251628 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.251796 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.275200 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.276535 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.277328 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.277495 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.277717 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.280390 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.283655 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.284370 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.284569 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.284782 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.288162 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.289266 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.289867 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.290048 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.290287 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.292168 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.293323 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.293943 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.294121 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.294304 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.296561 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.301489 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.302296 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.302441 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.302600 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.323712 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.324950 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.325649 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.325817 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.326040 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.338033 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.339236 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.340004 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.340164 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.340351 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.345139 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.348961 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.349758 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.349963 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.350171 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.358137 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.359246 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.359979 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.360157 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.360374 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.364200 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.365423 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.366083 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.366276 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.366472 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.373135 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.374312 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.375092 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.375276 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.375476 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.377525 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.378531 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.379325 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.379490 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.379650 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.381992 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.383117 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.383744 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.383905 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.384130 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.386340 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.387504 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.388172 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.388348 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.388561 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.393163 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.399241 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.400162 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.400347 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.400592 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.406529 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.408043 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.408733 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.408972 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.409169 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.413125 6972 heartbeater.cc:503] Master 127.6.51.254:36113 was elected leader, sending a full tablet report...
I20240502 21:29:42.421983 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.423130 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.424079 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.424266 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.424502 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.434554 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.436086 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.436805 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.437043 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.437232 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.443930 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.445089 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.445814 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.445971 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.446146 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.453668 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.455624 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.456297 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.456517 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.456748 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.461230 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.462304 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.462988 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.463162 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.463356 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.465220 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.470464 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.471074 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.471225 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.471387 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.485922 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.487066 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.487771 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.487915 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.488101 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.496786 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.503201 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.503937 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.504137 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.504328 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.511464 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.512581 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.513306 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.513445 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.513633 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.518296 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.525485 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.526285 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.526469 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.526644 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.530483 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.531540 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.532238 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.532428 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.532636 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.538827 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.540289 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.540967 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.541169 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.541375 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.548125 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.549208 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.549913 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.550081 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.550288 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.553720 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.554807 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.555505 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.555685 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.555881 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.561192 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.564241 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.564973 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.565120 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.565302 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.574944 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.576201 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.576897 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.577085 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.577277 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.579313 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.583531 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.584277 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.584447 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.584683 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.595178 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.596508 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.597209 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.597390 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.597580 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.604234 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.605388 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.606309 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.606467 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.606650 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.610925 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.613487 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.614179 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.614379 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.614558 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.629645 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.630779 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.631410 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.631558 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.631742 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.649576 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.650852 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.651530 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.651703 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.651872 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.653278 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.654901 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.655532 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.655673 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.655818 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.665438 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.672848 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.673532 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.673724 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.673915 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.676226 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.677287 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.677924 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.678059 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.678243 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.694941 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.696631 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.697412 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.697611 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.697793 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.699527 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.700572 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.701331 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.701519 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.701701 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.704686 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.709025 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.709678 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.709856 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.710024 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.714515 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.715826 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.716529 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.716677 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.716895 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.717152 7187 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap replayed 1/1 log segments. Stats: ops{read=217 overwritten=0 applied=217 ignored=0} inserts{seen=10800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:42.717878 7187 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap complete.
I20240502 21:29:42.719158 7187 ts_tablet_manager.cc:1367] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Time spent bootstrapping tablet: real 0.716s user 0.644s sys 0.066s
I20240502 21:29:42.722007 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.723102 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.723819 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.723980 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.724143 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.724803 7187 raft_consensus.cc:348] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:42.725883 7187 raft_consensus.cc:729] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cd17ec860940a78124fb2801281362, State: Initialized, Role: FOLLOWER
I20240502 21:29:42.726287 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.726667 7187 consensus_queue.cc:260] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 217, Last appended: 1.217, Last appended by leader: 217, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:42.726949 7187 raft_consensus.cc:388] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:42.727087 7187 raft_consensus.cc:482] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:42.727294 7187 raft_consensus.cc:3037] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:29:42.727486 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.728132 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.728263 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:42.728443 7290 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:38289: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:42.731446 7187 raft_consensus.cc:504] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:42.731961 7187 leader_election.cc:302] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cd17ec860940a78124fb2801281362; no voters:
I20240502 21:29:42.732565 7187 leader_election.cc:288] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:29:42.732707 7580 raft_consensus.cc:2781] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:29:42.732872 6985 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:42.733222 7580 raft_consensus.cc:686] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 2 LEADER]: Becoming Leader. State: Replica: 09cd17ec860940a78124fb2801281362, State: Running, Role: LEADER
I20240502 21:29:42.733804 7332 heartbeater.cc:503] Master 127.6.51.254:36113 was elected leader, sending a full tablet report...
I20240502 21:29:42.733803 7580 consensus_queue.cc:237] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 217, Committed index: 217, Last appended: 1.217, Last appended by leader: 217, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:42.738098 6756 catalog_manager.cc:5484] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "09cd17ec860940a78124fb2801281362" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } health_report { overall_health: HEALTHY } } }
I20240502 21:29:42.741223 7187 ts_tablet_manager.cc:1398] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Time spent starting tablet: real 0.022s user 0.020s sys 0.004s
I20240502 21:29:42.747093 6985 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:42.747794 7290 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:38289)
I20240502 21:29:42.747967 7290 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:38289: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
I20240502 21:29:42.750627 7290 tablet_copy_source_session.cc:205] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:29:42.755736 6985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8663ca58300140809d7e5f5b624959be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:42.766515 6985 tablet_copy_client.cc:783] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Starting download of 0 data blocks...
I20240502 21:29:42.766829 6985 tablet_copy_client.cc:647] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Starting download of 1 WAL segments...
I20240502 21:29:42.770953 6985 tablet_copy_client.cc:523] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:29:42.774067 6985 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap starting.
I20240502 21:29:42.848541 6985 log.cc:824] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:43.418527 6985 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=218 overwritten=0 applied=218 ignored=0} inserts{seen=10800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:43.419020 6985 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap complete.
I20240502 21:29:43.419543 6985 ts_tablet_manager.cc:1367] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Time spent bootstrapping tablet: real 0.646s user 0.624s sys 0.020s
I20240502 21:29:43.424724 6985 raft_consensus.cc:348] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:43.425146 6985 raft_consensus.cc:729] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 388a493a514d434881270f4c24d030f3, State: Initialized, Role: NON_PARTICIPANT
I20240502 21:29:43.425746 6985 consensus_queue.cc:260] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 218, Last appended: 2.218, Last appended by leader: 218, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:43.427178 6985 ts_tablet_manager.cc:1398] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20240502 21:29:43.428143 7290 tablet_copy_service.cc:342] P 09cd17ec860940a78124fb2801281362: Request end of tablet copy session 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be received from {username='slave'} at 127.6.51.194:38289
I20240502 21:29:43.428285 7290 tablet_copy_service.cc:433] P 09cd17ec860940a78124fb2801281362: ending tablet copy session 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be on tablet 8663ca58300140809d7e5f5b624959be with peer 388a493a514d434881270f4c24d030f3
W20240502 21:29:43.430956 6985 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240502 21:29:43.432674 6985 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
W20240502 21:29:43.437101 6985 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request
I20240502 21:29:43.439605 6907 tablet_service.cc:1514] Processing DeleteTablet for tablet 8663ca58300140809d7e5f5b624959be with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:58606
I20240502 21:29:43.440277 7596 tablet_replica.cc:330] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: stopping tablet replica
I20240502 21:29:43.440662 7596 raft_consensus.cc:2229] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 2 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 21:29:43.440989 7596 raft_consensus.cc:2258] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 21:29:43.442209 7596 ts_tablet_manager.cc:1875] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 21:29:43.446606 7596 ts_tablet_manager.cc:1888] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.218
I20240502 21:29:43.446733 7596 log.cc:1196] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting WAL directory at /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal/wals/8663ca58300140809d7e5f5b624959be
I20240502 21:29:43.447167 7596 ts_tablet_manager.cc:1909] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting consensus metadata
I20240502 21:29:43.449119 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 6845
I20240502 21:29:43.450229 6967 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:43.555022 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 6845
I20240502 21:29:43.574692 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:43501
--local_ip_for_outbound_sockets=127.6.51.194
--tserver_master_addrs=127.6.51.254:36113
--webserver_port=36061
--webserver_interface=127.6.51.194
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:43.901147 7598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:43.901484 7598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:43.901624 7598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:43.909335 7598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:43.909559 7598 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:43.919734 7598 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:43501
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=36061
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:43.921262 7598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:43.923125 7598 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:43.935313 7603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:43.935809 7604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:43.936196 7606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:43.936928 7598 server_base.cc:1034] running on GCE node
I20240502 21:29:43.937584 7598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:43.938560 7598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:43.939785 7598 hybrid_clock.cc:648] HybridClock initialized: now 1714685383939720 us; error 36 us; skew 500 ppm
I20240502 21:29:43.940120 7598 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:43.942459 7598 webserver.cc:460] Webserver started at http://127.6.51.194:36061/ using document root <none> and password file <none>
I20240502 21:29:43.943207 7598 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:43.943331 7598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:43.948784 7598 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20240502 21:29:43.951592 7612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:43.953060 7598 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:43.953202 7598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "388a493a514d434881270f4c24d030f3"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:43.954042 7598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:43.970866 7598 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:43.971740 7598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:43.971989 7598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:43.972932 7598 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:43.974447 7598 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:43.974542 7598 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:43.974632 7598 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:43.974685 7598 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:44.004695 7598 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:43501
I20240502 21:29:44.004745 7726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:43501 every 8 connection(s)
I20240502 21:29:44.006249 7598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:44.012117 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 7598
I20240502 21:29:44.012392 6351 tablet_copy_client_session-itest.cc:139] Starting loop 1
I20240502 21:29:44.012481 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 6983
I20240502 21:29:44.019503 7318 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:44.019613 7727 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:44.019942 7727 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:44.020988 7727 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:44.022578 6756 ts_manager.cc:194] Re-registered known tserver with Master: 388a493a514d434881270f4c24d030f3 (127.6.51.194:43501)
I20240502 21:29:44.023672 6756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:41275
I20240502 21:29:44.120764 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 6983
I20240502 21:29:44.142043 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:34991
--local_ip_for_outbound_sockets=127.6.51.193
--tserver_master_addrs=127.6.51.254:36113
--webserver_port=38625
--webserver_interface=127.6.51.193
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 21:29:44.169585 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.174981 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.183625 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.184772 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.190830 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.191924 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.196900 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.204434 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.225248 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.226505 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.229605 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.233316 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.237017 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.241535 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.253738 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.255038 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.258057 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.259053 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.261085 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.262041 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.289095 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.290342 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.302774 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.304049 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.308013 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.315443 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.330607 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.336920 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.340310 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.345142 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.365612 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.367794 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.388711 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.389992 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.396027 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.403913 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.406793 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.407891 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.412194 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.420044 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.424469 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.429586 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.441694 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.443004 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.448251 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.449334 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.467706 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.468976 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.473654 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.474668 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.486176 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.487386 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.491722 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.492852 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.496256 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.497336 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.503228 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.504297 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.511703 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.513481 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.516144 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
W20240502 21:29:44.520725 7739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:44.521224 7739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:44.521391 7739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240502 21:29:44.528977 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
W20240502 21:29:44.529366 7739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:44.529610 7739 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:29:44.539566 7739 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:34991
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=38625
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:44.541028 7739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:44.542940 7739 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 21:29:44.548589 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.550184 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
W20240502 21:29:44.556879 7879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:44.557286 7880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:44.557662 7882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:44.558418 7739 server_base.cc:1034] running on GCE node
I20240502 21:29:44.558511 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.559321 7739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:44.559600 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.560497 7739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:44.561722 7739 hybrid_clock.cc:648] HybridClock initialized: now 1714685384561635 us; error 62 us; skew 500 ppm
I20240502 21:29:44.562037 7739 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:44.564218 7739 webserver.cc:460] Webserver started at http://127.6.51.193:38625/ using document root <none> and password file <none>
I20240502 21:29:44.564762 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.565075 7739 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:44.565235 7739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:44.565871 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.571198 7739 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20240502 21:29:44.574069 7896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:44.575423 7739 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:44.575593 7739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "09cd17ec860940a78124fb2801281362"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:44.576464 7739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:44.582098 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.583576 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.588660 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.589833 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.592902 7739 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:44.593756 7739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:44.594023 7739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:44.594977 7739 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:44.596956 7911 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240502 21:29:44.598640 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.599617 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.601866 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.602834 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.603526 7739 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 21:29:44.603646 7739 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20240502 21:29:44.603772 7739 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 21:29:44.606817 7739 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 21:29:44.606916 7739 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.001s sys 0.000s
I20240502 21:29:44.607299 7911 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap starting.
I20240502 21:29:44.612938 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.622565 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.632350 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.637248 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.652123 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.660132 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.669080 7739 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:34991
I20240502 21:29:44.669178 8038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:34991 every 8 connection(s)
I20240502 21:29:44.670743 7739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:29:44.671833 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 7739
I20240502 21:29:44.678046 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.679493 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.698475 8039 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:44.698827 8039 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:44.699873 8039 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:44.702522 6756 ts_manager.cc:194] Re-registered known tserver with Master: 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.704007 6756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:46165
I20240502 21:29:44.704100 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.704417 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.706614 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.717283 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.718523 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.719199 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.719412 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.719642 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.722232 7911 log.cc:824] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:44.729823 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.731204 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.731981 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.732138 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.732343 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.740471 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.741585 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.742205 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.742359 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.742528 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.750759 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.752892 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.753664 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.753834 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.754009 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.762115 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.766968 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.767647 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.767828 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.768044 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.781934 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.783367 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.784111 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.784271 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.784457 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.786090 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.787173 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.787786 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.787920 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.788045 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.803006 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.804193 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.805002 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.805200 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.805395 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.807682 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.808756 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.809477 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.809640 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.809810 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.814563 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.815610 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.816336 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.816531 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.816753 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.820089 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.821419 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.821992 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.822129 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.822254 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.831476 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.832558 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.833293 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.833456 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.833637 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.837652 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.838914 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.839519 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.839666 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.839828 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.843133 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.844210 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.844923 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.845063 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.845237 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.858350 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.859547 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.860239 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.860409 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.860602 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.873219 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.874341 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.875041 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.875180 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.875362 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.878176 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.879257 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.879858 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.880010 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.880156 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.882227 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.885433 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.886056 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.886214 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.886399 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.891762 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.893851 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.894759 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.894924 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.895118 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.907289 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.908475 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.909204 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.909358 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.909549 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.924566 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.932152 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.933157 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.933365 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.933573 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.939189 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.942534 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.943181 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.943357 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.943583 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.948019 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.949188 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.949846 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.950026 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.950213 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.954293 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.955546 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.956198 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.956377 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.956588 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.959290 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.960592 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.961215 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.961351 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.961512 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.965189 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.969239 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.969942 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.970068 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.970240 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.979897 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.981024 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.981720 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.981894 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.982091 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.988152 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.989356 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:44.990132 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:44.990294 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:44.990500 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:44.992586 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:44.999928 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.000615 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.000782 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.000991 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.006351 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.013752 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.014585 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.014793 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.015067 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.026327 7727 heartbeater.cc:503] Master 127.6.51.254:36113 was elected leader, sending a full tablet report...
I20240502 21:29:45.026659 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.030146 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.030952 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.031142 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.031332 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.056957 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.058209 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.058993 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.059170 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.059378 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.063894 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.065006 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.065629 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.065832 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.066040 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.071043 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.072088 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.072808 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.073006 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.073213 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.075281 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.076308 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.077019 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.077190 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.077368 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.079753 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.080854 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.081565 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.081733 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.081938 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.084275 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.085470 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.086048 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.086179 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.086306 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.095965 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.097225 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.097900 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.098044 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.098232 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.113104 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.114284 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.115057 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.115229 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.115396 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.126277 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.128268 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.129004 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.129197 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.129405 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.132534 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.134019 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.134654 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.134822 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.134986 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.144440 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.145671 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.146423 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.146597 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.146811 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.158634 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.159925 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.160676 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.160915 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.161155 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.163067 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.169169 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.170033 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.170274 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.170526 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.173238 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.179119 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.179786 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.179998 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.180197 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.193665 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.194818 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.195494 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.195664 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.195879 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.205976 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.207177 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.207827 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.207985 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.208155 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.212065 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.213080 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.213755 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.213894 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.214071 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.220522 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.221632 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.222285 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.222474 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.222661 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.231513 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.232668 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.233460 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.233621 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.233824 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.246434 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.247568 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.248224 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.248380 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.248545 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.252246 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.253342 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.253964 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.254104 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.254284 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.256669 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.257701 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.258397 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.258576 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.258803 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.271114 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.272485 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.273212 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.273442 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.273667 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.285441 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.287449 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.288468 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.288640 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.288857 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.291813 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.292963 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.293689 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.293892 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:45.294052 8010 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:58407: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:45.299924 7911 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap replayed 1/1 log segments. Stats: ops{read=218 overwritten=0 applied=218 ignored=0} inserts{seen=10800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:45.300444 7911 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap complete.
I20240502 21:29:45.301570 7911 ts_tablet_manager.cc:1367] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Time spent bootstrapping tablet: real 0.695s user 0.619s sys 0.064s
I20240502 21:29:45.306464 7911 raft_consensus.cc:348] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:45.307255 7911 raft_consensus.cc:729] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cd17ec860940a78124fb2801281362, State: Initialized, Role: FOLLOWER
I20240502 21:29:45.307895 7911 consensus_queue.cc:260] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 218, Last appended: 2.218, Last appended by leader: 218, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:45.308107 7911 raft_consensus.cc:388] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:45.308215 7911 raft_consensus.cc:482] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:45.308383 7911 raft_consensus.cc:3037] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 2 FOLLOWER]: Advancing to term 3
I20240502 21:29:45.311872 7911 raft_consensus.cc:504] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:45.312381 7911 leader_election.cc:302] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cd17ec860940a78124fb2801281362; no voters:
I20240502 21:29:45.313002 7911 leader_election.cc:288] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [CANDIDATE]: Term 3 election: Requested vote from peers
I20240502 21:29:45.313138 8277 raft_consensus.cc:2781] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 3 FOLLOWER]: Leader election won for term 3
I20240502 21:29:45.313670 8277 raft_consensus.cc:686] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 3 LEADER]: Becoming Leader. State: Replica: 09cd17ec860940a78124fb2801281362, State: Running, Role: LEADER
I20240502 21:29:45.314234 8039 heartbeater.cc:503] Master 127.6.51.254:36113 was elected leader, sending a full tablet report...
I20240502 21:29:45.314419 8277 consensus_queue.cc:237] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 218, Committed index: 218, Last appended: 2.218, Last appended by leader: 218, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:45.314741 7911 ts_tablet_manager.cc:1398] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Time spent starting tablet: real 0.013s user 0.005s sys 0.008s
I20240502 21:29:45.318378 6756 catalog_manager.cc:5484] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "09cd17ec860940a78124fb2801281362" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } health_report { overall_health: HEALTHY } } }
I20240502 21:29:45.321393 7741 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:45.322590 7741 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:45.323338 8010 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:58407)
I20240502 21:29:45.323515 8010 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:58407: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
I20240502 21:29:45.326373 8010 tablet_copy_source_session.cc:205] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:29:45.331219 7741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8663ca58300140809d7e5f5b624959be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:45.341904 7741 tablet_copy_client.cc:783] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Starting download of 0 data blocks...
I20240502 21:29:45.342258 7741 tablet_copy_client.cc:647] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Starting download of 1 WAL segments...
I20240502 21:29:45.346773 7741 tablet_copy_client.cc:523] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:29:45.350682 7741 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap starting.
I20240502 21:29:45.419144 7741 log.cc:824] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:46.009757 7741 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=219 overwritten=0 applied=219 ignored=0} inserts{seen=10800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:46.010464 7741 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap complete.
I20240502 21:29:46.011137 7741 ts_tablet_manager.cc:1367] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Time spent bootstrapping tablet: real 0.661s user 0.595s sys 0.064s
I20240502 21:29:46.016053 7741 raft_consensus.cc:348] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 3 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:46.016460 7741 raft_consensus.cc:729] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 388a493a514d434881270f4c24d030f3, State: Initialized, Role: NON_PARTICIPANT
I20240502 21:29:46.017146 7741 consensus_queue.cc:260] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 219, Last appended: 3.219, Last appended by leader: 219, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:46.018909 7741 ts_tablet_manager.cc:1398] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Time spent starting tablet: real 0.008s user 0.005s sys 0.004s
I20240502 21:29:46.019908 8010 tablet_copy_service.cc:342] P 09cd17ec860940a78124fb2801281362: Request end of tablet copy session 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be received from {username='slave'} at 127.6.51.194:58407
I20240502 21:29:46.020045 8010 tablet_copy_service.cc:433] P 09cd17ec860940a78124fb2801281362: ending tablet copy session 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be on tablet 8663ca58300140809d7e5f5b624959be with peer 388a493a514d434881270f4c24d030f3
W20240502 21:29:46.021800 7741 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240502 21:29:46.023033 7741 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
W20240502 21:29:46.026749 7741 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request
I20240502 21:29:46.030368 7662 tablet_service.cc:1514] Processing DeleteTablet for tablet 8663ca58300140809d7e5f5b624959be with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:58622
I20240502 21:29:46.031064 8293 tablet_replica.cc:330] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: stopping tablet replica
I20240502 21:29:46.031525 8293 raft_consensus.cc:2229] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 3 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 21:29:46.031859 8293 raft_consensus.cc:2258] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 3 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 21:29:46.033310 8293 ts_tablet_manager.cc:1875] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 21:29:46.037835 8293 ts_tablet_manager.cc:1888] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.219
I20240502 21:29:46.037976 8293 log.cc:1196] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting WAL directory at /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal/wals/8663ca58300140809d7e5f5b624959be
I20240502 21:29:46.038484 8293 ts_tablet_manager.cc:1909] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting consensus metadata
I20240502 21:29:46.040391 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 7598
I20240502 21:29:46.041554 7722 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:46.147583 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 7598
I20240502 21:29:46.166779 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:43501
--local_ip_for_outbound_sockets=127.6.51.194
--tserver_master_addrs=127.6.51.254:36113
--webserver_port=36061
--webserver_interface=127.6.51.194
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:46.495223 8296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:46.495527 8296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:46.495651 8296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:46.503273 8296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:46.503491 8296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:46.512540 8296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:43501
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=36061
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:46.513965 8296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:46.515789 8296 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:46.528148 8302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:46.528169 8301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:46.528709 8304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:46.529183 8296 server_base.cc:1034] running on GCE node
I20240502 21:29:46.529774 8296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:46.530673 8296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:46.531881 8296 hybrid_clock.cc:648] HybridClock initialized: now 1714685386531811 us; error 41 us; skew 500 ppm
I20240502 21:29:46.532166 8296 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:46.534384 8296 webserver.cc:460] Webserver started at http://127.6.51.194:36061/ using document root <none> and password file <none>
I20240502 21:29:46.535068 8296 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:46.535176 8296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:46.540244 8296 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.001s
I20240502 21:29:46.543053 8310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:46.544345 8296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 21:29:46.544492 8296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "388a493a514d434881270f4c24d030f3"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:46.545432 8296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:46.576735 8296 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:46.577698 8296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:46.577978 8296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:46.578971 8296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:46.580590 8296 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:46.580696 8296 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:46.580808 8296 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:46.580909 8296 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20240502 21:29:46.610294 8296 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:43501
I20240502 21:29:46.610363 8424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:43501 every 8 connection(s)
I20240502 21:29:46.611837 8296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:46.615482 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 8296
I20240502 21:29:46.615741 6351 tablet_copy_client_session-itest.cc:139] Starting loop 2
I20240502 21:29:46.615857 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 7739
I20240502 21:29:46.622859 8034 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:46.625319 8425 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:46.625666 8425 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:46.626737 8425 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:46.628214 6756 ts_manager.cc:194] Re-registered known tserver with Master: 388a493a514d434881270f4c24d030f3 (127.6.51.194:43501)
I20240502 21:29:46.629103 6756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:42925
I20240502 21:29:46.723610 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 7739
I20240502 21:29:46.743894 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:34991
--local_ip_for_outbound_sockets=127.6.51.193
--tserver_master_addrs=127.6.51.254:36113
--webserver_port=38625
--webserver_interface=127.6.51.193
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 21:29:46.767596 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.776429 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.789202 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.790419 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.794106 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.797122 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.811759 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.812961 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.816359 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.817440 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.820140 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.821195 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.832726 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.833889 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.843734 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.844929 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.855031 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.856335 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.879233 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.880475 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.900709 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.902133 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.923017 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.924261 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.927670 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.932796 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.952701 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.953905 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.958550 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.959650 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.963704 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.964771 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.977942 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.979102 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.994307 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:46.995487 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:46.999533 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.005321 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.007589 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.008767 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.020879 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.022034 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.031195 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.033033 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.039283 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.046432 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.055625 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.056784 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.062886 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.063920 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.079982 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.081202 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.090802 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.091871 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.103928 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.105088 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.107069 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
W20240502 21:29:47.106988 8438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:47.107412 8438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:47.107563 8438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20240502 21:29:47.111729 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
W20240502 21:29:47.115695 8438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:47.115882 8438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:29:47.120167 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.121315 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.126449 8438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:34991
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=38625
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:47.127871 8438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:47.128504 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.129592 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.130102 8438 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20240502 21:29:47.141798 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
W20240502 21:29:47.143225 8574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:47.143523 8576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:47.147933 8573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:47.153439 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.155138 8438 server_base.cc:1034] running on GCE node
I20240502 21:29:47.156168 8438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:47.156474 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.157306 8438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:47.158551 8438 hybrid_clock.cc:648] HybridClock initialized: now 1714685387158451 us; error 77 us; skew 500 ppm
I20240502 21:29:47.158879 8438 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:47.164100 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.164580 8438 webserver.cc:460] Webserver started at http://127.6.51.193:38625/ using document root <none> and password file <none>
I20240502 21:29:47.165627 8438 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:47.165787 8438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:47.167858 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.169538 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.172076 8438 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20240502 21:29:47.175999 8594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:47.177374 8438 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 21:29:47.177524 8438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "09cd17ec860940a78124fb2801281362"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:47.178412 8438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:47.179116 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.180150 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.182756 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.183759 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.210330 8438 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:47.211246 8438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:47.211540 8438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:47.212520 8438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:47.214676 8609 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240502 21:29:47.214828 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.215945 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.218556 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.219545 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.221499 8438 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 21:29:47.221603 8438 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.007s user 0.001s sys 0.000s
I20240502 21:29:47.221698 8438 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 21:29:47.224567 8438 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 21:29:47.224663 8438 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240502 21:29:47.225111 8609 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap starting.
I20240502 21:29:47.227388 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.241214 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.249382 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.251957 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.257198 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.259395 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.266211 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.291059 8438 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:34991
I20240502 21:29:47.291081 8739 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:34991 every 8 connection(s)
I20240502 21:29:47.292713 8438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:29:47.294144 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 8438
I20240502 21:29:47.309159 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.327338 8740 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:47.327750 8740 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:47.329026 8740 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:47.331140 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.331470 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.332983 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.333652 6756 ts_manager.cc:194] Re-registered known tserver with Master: 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.335228 6756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:35839
I20240502 21:29:47.342056 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.343205 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.343959 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.344125 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.344293 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.350270 8609 log.cc:824] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:47.358063 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.359189 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.359922 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.360075 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.360245 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.365028 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.366093 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.366745 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.366904 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.367063 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.377195 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.381036 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.382579 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.382799 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.383010 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.390379 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.391569 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.392268 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.392462 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.392683 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.397148 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.398294 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.398931 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.399070 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.399250 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.404711 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.405844 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.406518 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.406711 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.406900 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.409245 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.410276 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.410939 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.411113 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.411319 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.417976 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.420172 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.420889 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.421077 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.421300 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.427260 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.428258 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.428982 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.429152 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.429368 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.431946 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.432996 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.433620 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.433791 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.433976 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.440716 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.441872 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.442589 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.442898 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.443145 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.461938 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.463444 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.464193 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.464383 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.464574 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.471058 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.472199 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.472940 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.473111 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.473313 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.484736 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.486055 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.486764 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.486965 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.487180 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.493665 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.494724 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.495450 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.495622 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.495844 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.501284 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.502384 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.503125 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.503306 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.503489 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.522830 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.524019 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.524771 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.524988 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.525198 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.530736 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.537997 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.538704 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.538868 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.539047 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.542133 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.543162 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.543818 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.543967 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.544140 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.562095 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.569478 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.570250 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.570441 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.570636 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.573868 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.581079 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.581853 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.582023 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.582219 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.600420 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.601755 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.602461 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.602636 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.602806 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.609167 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.617165 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.618026 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.618221 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.618435 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.620784 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.625864 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.626556 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.626732 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.626899 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.631527 8425 heartbeater.cc:503] Master 127.6.51.254:36113 was elected leader, sending a full tablet report...
I20240502 21:29:47.641315 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.642825 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.643502 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.643677 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.643891 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.660657 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.662074 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.662796 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.662976 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.663161 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.669750 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.673300 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.673997 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.674150 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.674353 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.676642 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.677824 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.678617 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.678812 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.679013 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.688416 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.690668 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.691471 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.691644 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.691857 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.699405 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.700526 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.701329 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.701521 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.701732 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.710696 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.711794 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.712462 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.712630 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.712868 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.722185 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.723608 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.724340 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.724568 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.724839 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.738746 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.739920 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.740657 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.740865 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.741079 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.744386 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.745491 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.746169 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.746351 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.746544 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.750021 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.756980 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.757777 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.757946 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.758152 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.767773 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.769523 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.770207 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.770399 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.770589 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.774080 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.781255 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.782392 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.782603 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.782815 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.789093 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.793021 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.793749 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.793923 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.794085 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.805404 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.806546 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.807233 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.807395 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.807575 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.815724 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.817363 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.818035 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.818192 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.818360 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.828176 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.830101 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.830751 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.830896 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.831084 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.839205 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.840334 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.841063 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.841243 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.841421 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.849030 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.850386 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.851080 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.851233 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.851424 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.860167 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.861624 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.862409 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.862610 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.862807 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.872859 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.878317 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.879076 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.879251 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.879498 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.881404 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.882763 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.883489 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.883675 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.883862 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.891680 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.893127 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.893935 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.894129 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.894335 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.897962 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.899061 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.899715 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.899902 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.900087 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.905761 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.906821 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.907557 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.907732 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.907965 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.919232 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.920333 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.921032 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.921236 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.921442 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.942062 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.944519 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.945266 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.945454 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.945683 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.946467 8609 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap replayed 1/1 log segments. Stats: ops{read=219 overwritten=0 applied=219 ignored=0} inserts{seen=10800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:47.947093 8609 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Bootstrap complete.
I20240502 21:29:47.947960 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.948436 8609 ts_tablet_manager.cc:1367] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Time spent bootstrapping tablet: real 0.724s user 0.650s sys 0.059s
I20240502 21:29:47.949409 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.950042 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.950196 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
W20240502 21:29:47.950357 8713 tablet_copy_service.cc:478] P 09cd17ec860940a78124fb2801281362: Error handling TabletCopyService RPC request from {username='slave'} at 127.6.51.194:48013: Error beginning tablet copy session for tablet 8663ca58300140809d7e5f5b624959be: Illegal state: The tablet is not in a running state: BOOTSTRAPPING
I20240502 21:29:47.953754 8609 raft_consensus.cc:348] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:47.954525 8609 raft_consensus.cc:729] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09cd17ec860940a78124fb2801281362, State: Initialized, Role: FOLLOWER
I20240502 21:29:47.955124 8609 consensus_queue.cc:260] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 219, Last appended: 3.219, Last appended by leader: 219, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:47.955330 8609 raft_consensus.cc:388] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:47.955443 8609 raft_consensus.cc:482] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:47.955603 8609 raft_consensus.cc:3037] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 3 FOLLOWER]: Advancing to term 4
I20240502 21:29:47.959100 8609 raft_consensus.cc:504] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:47.959662 8609 leader_election.cc:302] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09cd17ec860940a78124fb2801281362; no voters:
I20240502 21:29:47.960235 8609 leader_election.cc:288] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [CANDIDATE]: Term 4 election: Requested vote from peers
I20240502 21:29:47.960377 8962 raft_consensus.cc:2781] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 4 FOLLOWER]: Leader election won for term 4
I20240502 21:29:47.960912 8962 raft_consensus.cc:686] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [term 4 LEADER]: Becoming Leader. State: Replica: 09cd17ec860940a78124fb2801281362, State: Running, Role: LEADER
I20240502 21:29:47.961383 8740 heartbeater.cc:503] Master 127.6.51.254:36113 was elected leader, sending a full tablet report...
I20240502 21:29:47.961870 8609 ts_tablet_manager.cc:1398] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Time spent starting tablet: real 0.013s user 0.012s sys 0.004s
I20240502 21:29:47.961838 8962 consensus_queue.cc:237] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 219, Committed index: 219, Last appended: 3.219, Last appended by leader: 219, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:47.965325 6756 catalog_manager.cc:5484] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362 reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "09cd17ec860940a78124fb2801281362" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } health_report { overall_health: HEALTHY } } }
I20240502 21:29:47.977334 8442 ts_tablet_manager.cc:902] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Initiating tablet copy from peer 09cd17ec860940a78124fb2801281362 (127.6.51.193:34991)
I20240502 21:29:47.978480 8442 tablet_copy_client.cc:308] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34991
I20240502 21:29:47.979247 8713 tablet_copy_service.cc:140] P 09cd17ec860940a78124fb2801281362: Received BeginTabletCopySession request for tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 ({username='slave'} at 127.6.51.194:48013)
I20240502 21:29:47.979398 8713 tablet_copy_service.cc:161] P 09cd17ec860940a78124fb2801281362: Beginning new tablet copy session on tablet 8663ca58300140809d7e5f5b624959be from peer 388a493a514d434881270f4c24d030f3 at {username='slave'} at 127.6.51.194:48013: session id = 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be
I20240502 21:29:47.981976 8713 tablet_copy_source_session.cc:205] T 8663ca58300140809d7e5f5b624959be P 09cd17ec860940a78124fb2801281362: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:29:47.986625 8442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8663ca58300140809d7e5f5b624959be. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:47.997992 8442 tablet_copy_client.cc:783] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Starting download of 0 data blocks...
I20240502 21:29:47.998302 8442 tablet_copy_client.cc:647] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Starting download of 1 WAL segments...
I20240502 21:29:48.002688 8442 tablet_copy_client.cc:523] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:29:48.006347 8442 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap starting.
I20240502 21:29:48.071934 8442 log.cc:824] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:48.632680 8442 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=220 overwritten=0 applied=220 ignored=0} inserts{seen=10800 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:48.633216 8442 tablet_bootstrap.cc:492] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Bootstrap complete.
I20240502 21:29:48.633821 8442 ts_tablet_manager.cc:1367] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Time spent bootstrapping tablet: real 0.628s user 0.568s sys 0.059s
I20240502 21:29:48.638803 8442 raft_consensus.cc:348] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 4 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:48.639149 8442 raft_consensus.cc:729] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 388a493a514d434881270f4c24d030f3, State: Initialized, Role: NON_PARTICIPANT
I20240502 21:29:48.639613 8442 consensus_queue.cc:260] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 220, Last appended: 4.220, Last appended by leader: 220, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09cd17ec860940a78124fb2801281362" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34991 } }
I20240502 21:29:48.641219 8442 ts_tablet_manager.cc:1398] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20240502 21:29:48.642129 8713 tablet_copy_service.cc:342] P 09cd17ec860940a78124fb2801281362: Request end of tablet copy session 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be received from {username='slave'} at 127.6.51.194:48013
I20240502 21:29:48.642263 8713 tablet_copy_service.cc:433] P 09cd17ec860940a78124fb2801281362: ending tablet copy session 388a493a514d434881270f4c24d030f3-8663ca58300140809d7e5f5b624959be on tablet 8663ca58300140809d7e5f5b624959be with peer 388a493a514d434881270f4c24d030f3
W20240502 21:29:48.645107 8442 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240502 21:29:48.649132 8442 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
W20240502 21:29:48.681363 8442 ts_tablet_manager.cc:701] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Tablet Copy: Invalid argument: Leader has replica of tablet 8663ca58300140809d7e5f5b624959be with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request
I20240502 21:29:48.684201 8360 tablet_service.cc:1514] Processing DeleteTablet for tablet 8663ca58300140809d7e5f5b624959be with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:58634
I20240502 21:29:48.685026 8979 tablet_replica.cc:330] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: stopping tablet replica
I20240502 21:29:48.685458 8979 raft_consensus.cc:2229] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 4 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 21:29:48.685775 8979 raft_consensus.cc:2258] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3 [term 4 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 21:29:48.687027 8979 ts_tablet_manager.cc:1875] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20240502 21:29:48.691633 8979 ts_tablet_manager.cc:1888] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.220
I20240502 21:29:48.691772 8979 log.cc:1196] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting WAL directory at /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal/wals/8663ca58300140809d7e5f5b624959be
I20240502 21:29:48.692236 8979 ts_tablet_manager.cc:1909] T 8663ca58300140809d7e5f5b624959be P 388a493a514d434881270f4c24d030f3: Deleting consensus metadata
I20240502 21:29:48.694173 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 8296
I20240502 21:29:48.695174 8420 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:48.799002 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 8296
I20240502 21:29:48.820593 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:43501
--local_ip_for_outbound_sockets=127.6.51.194
--tserver_master_addrs=127.6.51.254:36113
--webserver_port=36061
--webserver_interface=127.6.51.194
--builtin_ntp_servers=127.6.51.212:35673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:49.149283 8981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:49.149631 8981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:49.149770 8981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:49.157320 8981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:49.157559 8981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:49.166682 8981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:35673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:43501
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=36061
--tserver_master_addrs=127.6.51.254:36113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:49.168138 8981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:49.170037 8981 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:49.181963 8986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:49.182410 8989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:49.182806 8987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:49.183050 8981 server_base.cc:1034] running on GCE node
I20240502 21:29:49.183733 8981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:49.184721 8981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:49.185953 8981 hybrid_clock.cc:648] HybridClock initialized: now 1714685389185875 us; error 48 us; skew 500 ppm
I20240502 21:29:49.186270 8981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:49.193966 8981 webserver.cc:460] Webserver started at http://127.6.51.194:36061/ using document root <none> and password file <none>
I20240502 21:29:49.194749 8981 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:49.194880 8981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:49.200440 8981 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20240502 21:29:49.203296 8995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:49.204643 8981 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 21:29:49.204850 8981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "388a493a514d434881270f4c24d030f3"
format_stamp: "Formatted at 2024-05-02 21:29:38 on dist-test-slave-ns1z"
I20240502 21:29:49.205747 8981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:49.226696 8981 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:49.227564 8981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:49.227865 8981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:49.229077 8981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:49.230976 8981 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:49.231083 8981 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:49.231194 8981 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:49.231276 8981 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:49.261483 8981 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:43501
I20240502 21:29:49.261529 9108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:43501 every 8 connection(s)
I20240502 21:29:49.262981 8981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:49.269384 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 8981
I20240502 21:29:49.269830 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 8438
I20240502 21:29:49.276074 9109 heartbeater.cc:347] Connected to a master server at 127.6.51.254:36113
I20240502 21:29:49.276465 9109 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:49.276702 8735 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:49.277462 9109 heartbeater.cc:511] Master 127.6.51.254:36113 requested a full tablet report, sending...
I20240502 21:29:49.279213 6756 ts_manager.cc:194] Re-registered known tserver with Master: 388a493a514d434881270f4c24d030f3 (127.6.51.194:43501)
I20240502 21:29:49.280393 6756 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:32985
I20240502 21:29:49.378999 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 8438
I20240502 21:29:49.398222 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 8981
I20240502 21:29:49.406960 9104 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:49.486260 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 8981
I20240502 21:29:49.502492 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 6724
I20240502 21:29:49.503772 6786 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:49.608238 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 6724
2024-05-02T21:29:49Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (12610 ms)
[ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy
2024-05-02T21:29:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T21:29:49Z Disabled control of system clock
I20240502 21:29:49.673931 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:42733
--webserver_interface=127.6.51.254
--webserver_port=0
--builtin_ntp_servers=127.6.51.212:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.51.254:42733
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 21:29:50.003368 9122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:50.003703 9122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:50.003810 9122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:50.011422 9122 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 21:29:50.011543 9122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:50.011588 9122 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 21:29:50.011639 9122 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 21:29:50.020977 9122 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.6.51.254:42733
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:42733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.51.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:50.022406 9122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:50.024194 9122 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:50.035472 9128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:50.035737 9130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:50.036077 9127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:50.036412 9122 server_base.cc:1034] running on GCE node
I20240502 21:29:50.037285 9122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:50.038797 9122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:50.040019 9122 hybrid_clock.cc:648] HybridClock initialized: now 1714685390039947 us; error 48 us; skew 500 ppm
I20240502 21:29:50.040352 9122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:50.042788 9122 webserver.cc:460] Webserver started at http://127.6.51.254:46425/ using document root <none> and password file <none>
I20240502 21:29:50.043525 9122 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:50.043660 9122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:50.043977 9122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:50.046797 9122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/instance:
uuid: "cfce8d84b3734df5a459c2fa0f682440"
format_stamp: "Formatted at 2024-05-02 21:29:50 on dist-test-slave-ns1z"
I20240502 21:29:50.047572 9122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal/instance:
uuid: "cfce8d84b3734df5a459c2fa0f682440"
format_stamp: "Formatted at 2024-05-02 21:29:50 on dist-test-slave-ns1z"
I20240502 21:29:50.053157 9122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20240502 21:29:50.056672 9136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:50.058079 9122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:50.058254 9122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
uuid: "cfce8d84b3734df5a459c2fa0f682440"
format_stamp: "Formatted at 2024-05-02 21:29:50 on dist-test-slave-ns1z"
I20240502 21:29:50.058439 9122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:50.073530 9122 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:50.074347 9122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:50.074633 9122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:50.091363 9122 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.254:42733
I20240502 21:29:50.091383 9187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.254:42733 every 8 connection(s)
I20240502 21:29:50.092860 9122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
I20240502 21:29:50.096767 9188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:50.102435 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 9122
I20240502 21:29:50.102679 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal/instance
I20240502 21:29:50.106590 9188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Bootstrap starting.
I20240502 21:29:50.110595 9188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Neither blocks nor log segments found. Creating new log.
I20240502 21:29:50.111901 9188 log.cc:824] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:50.115043 9188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: No bootstrap required, opened a new log
I20240502 21:29:50.121631 9188 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } }
I20240502 21:29:50.121959 9188 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:29:50.122035 9188 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfce8d84b3734df5a459c2fa0f682440, State: Initialized, Role: FOLLOWER
I20240502 21:29:50.122547 9188 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } }
I20240502 21:29:50.122728 9188 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:50.122817 9188 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:50.122933 9188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:29:50.125109 9188 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } }
I20240502 21:29:50.125653 9188 leader_election.cc:302] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfce8d84b3734df5a459c2fa0f682440; no voters:
I20240502 21:29:50.126209 9188 leader_election.cc:288] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:29:50.126380 9193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:29:50.127032 9193 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 1 LEADER]: Becoming Leader. State: Replica: cfce8d84b3734df5a459c2fa0f682440, State: Running, Role: LEADER
I20240502 21:29:50.127550 9193 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } }
I20240502 21:29:50.128269 9188 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 21:29:50.130704 9194 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfce8d84b3734df5a459c2fa0f682440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } } }
I20240502 21:29:50.131093 9194 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:50.130674 9195 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfce8d84b3734df5a459c2fa0f682440. Latest consensus state: current_term: 1 leader_uuid: "cfce8d84b3734df5a459c2fa0f682440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } } }
I20240502 21:29:50.131403 9195 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:50.132686 9198 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 21:29:50.138204 9198 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 21:29:50.148110 9198 catalog_manager.cc:1347] Generated new cluster ID: 57fee93fabb244bd868e9134a2d061f0
I20240502 21:29:50.148244 9198 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 21:29:50.172075 9198 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 21:29:50.173386 9198 catalog_manager.cc:1504] Loading token signing keys...
I20240502 21:29:50.180691 9198 catalog_manager.cc:5857] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Generated new TSK 0
I20240502 21:29:50.181653 9198 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 21:29:50.199088 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:0
--local_ip_for_outbound_sockets=127.6.51.193
--webserver_interface=127.6.51.193
--webserver_port=0
--tserver_master_addrs=127.6.51.254:42733
--builtin_ntp_servers=127.6.51.212:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:50.560127 9213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:50.560423 9213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:50.560523 9213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:50.568063 9213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:50.568246 9213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:29:50.577278 9213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=0
--tserver_master_addrs=127.6.51.254:42733
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:50.578747 9213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:50.580538 9213 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:50.592804 9218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:50.593365 9219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:50.593720 9221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:50.593930 9213 server_base.cc:1034] running on GCE node
I20240502 21:29:50.594597 9213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:50.595551 9213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:50.596756 9213 hybrid_clock.cc:648] HybridClock initialized: now 1714685390596681 us; error 53 us; skew 500 ppm
I20240502 21:29:50.597069 9213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:50.599237 9213 webserver.cc:460] Webserver started at http://127.6.51.193:39499/ using document root <none> and password file <none>
I20240502 21:29:50.599952 9213 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:50.600055 9213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:50.600340 9213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:50.603013 9213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/data/instance:
uuid: "5560f42ba666436b843cf3a2921e71e3"
format_stamp: "Formatted at 2024-05-02 21:29:50 on dist-test-slave-ns1z"
I20240502 21:29:50.603739 9213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/wal/instance:
uuid: "5560f42ba666436b843cf3a2921e71e3"
format_stamp: "Formatted at 2024-05-02 21:29:50 on dist-test-slave-ns1z"
I20240502 21:29:50.608997 9213 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20240502 21:29:50.612357 9227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:50.613719 9213 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:50.613857 9213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "5560f42ba666436b843cf3a2921e71e3"
format_stamp: "Formatted at 2024-05-02 21:29:50 on dist-test-slave-ns1z"
I20240502 21:29:50.614010 9213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:50.632614 9213 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:50.633606 9213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:50.633860 9213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:50.634872 9213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:50.636469 9213 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:50.636544 9213 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:50.636639 9213 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:50.636682 9213 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:50.667171 9213 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:34561
I20240502 21:29:50.667205 9339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:34561 every 8 connection(s)
I20240502 21:29:50.668520 9213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:29:50.671562 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 9213
I20240502 21:29:50.671775 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-0/wal/instance
I20240502 21:29:50.675527 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:0
--local_ip_for_outbound_sockets=127.6.51.194
--webserver_interface=127.6.51.194
--webserver_port=0
--tserver_master_addrs=127.6.51.254:42733
--builtin_ntp_servers=127.6.51.212:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 21:29:50.683351 9340 heartbeater.cc:347] Connected to a master server at 127.6.51.254:42733
I20240502 21:29:50.683705 9340 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:50.684777 9340 heartbeater.cc:511] Master 127.6.51.254:42733 requested a full tablet report, sending...
I20240502 21:29:50.687335 9153 ts_manager.cc:194] Registered new tserver with Master: 5560f42ba666436b843cf3a2921e71e3 (127.6.51.193:34561)
I20240502 21:29:50.689486 9153 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:43459
W20240502 21:29:51.002804 9344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:51.003100 9344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:51.003186 9344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:51.010568 9344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:51.010753 9344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:51.019800 9344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=0
--tserver_master_addrs=127.6.51.254:42733
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:51.021232 9344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:51.023047 9344 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:51.034863 9350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:51.035362 9349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:51.035773 9352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:51.035989 9344 server_base.cc:1034] running on GCE node
I20240502 21:29:51.036633 9344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:51.037626 9344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:51.038839 9344 hybrid_clock.cc:648] HybridClock initialized: now 1714685391038761 us; error 58 us; skew 500 ppm
I20240502 21:29:51.039132 9344 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:51.041453 9344 webserver.cc:460] Webserver started at http://127.6.51.194:37669/ using document root <none> and password file <none>
I20240502 21:29:51.042214 9344 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:51.042347 9344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:51.042708 9344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:51.045506 9344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/instance:
uuid: "047f49a6f3fa4871a12eb352433e37a3"
format_stamp: "Formatted at 2024-05-02 21:29:51 on dist-test-slave-ns1z"
I20240502 21:29:51.046286 9344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal/instance:
uuid: "047f49a6f3fa4871a12eb352433e37a3"
format_stamp: "Formatted at 2024-05-02 21:29:51 on dist-test-slave-ns1z"
I20240502 21:29:51.051656 9344 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20240502 21:29:51.055327 9358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:51.056840 9344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20240502 21:29:51.057005 9344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "047f49a6f3fa4871a12eb352433e37a3"
format_stamp: "Formatted at 2024-05-02 21:29:51 on dist-test-slave-ns1z"
I20240502 21:29:51.057175 9344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:51.072276 9344 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:51.073191 9344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:51.073460 9344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:51.074458 9344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:51.076023 9344 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:51.076094 9344 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:51.076207 9344 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:51.076254 9344 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:51.106842 9344 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:35235
I20240502 21:29:51.106899 9471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:35235 every 8 connection(s)
I20240502 21:29:51.108176 9344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:51.117949 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 9344
I20240502 21:29:51.118153 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal/instance
I20240502 21:29:51.120687 9472 heartbeater.cc:347] Connected to a master server at 127.6.51.254:42733
I20240502 21:29:51.121011 9472 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:51.121920 9472 heartbeater.cc:511] Master 127.6.51.254:42733 requested a full tablet report, sending...
I20240502 21:29:51.123229 9153 ts_manager.cc:194] Registered new tserver with Master: 047f49a6f3fa4871a12eb352433e37a3 (127.6.51.194:35235)
I20240502 21:29:51.124011 9153 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:40483
I20240502 21:29:51.134016 6351 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 21:29:51.147747 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 9344
I20240502 21:29:51.155650 9467 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:51.235998 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 9344
I20240502 21:29:51.251823 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 9122
I20240502 21:29:51.253098 9183 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:51.351706 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 9122
I20240502 21:29:51.371037 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:42733
--webserver_interface=127.6.51.254
--webserver_port=46425
--builtin_ntp_servers=127.6.51.212:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.51.254:42733
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240502 21:29:51.693363 9340 heartbeater.cc:503] Master 127.6.51.254:42733 was elected leader, sending a full tablet report...
W20240502 21:29:51.694906 9340 heartbeater.cc:644] Failed to heartbeat to 127.6.51.254:42733 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.51.254:42733: connect: Connection refused (error 111)
W20240502 21:29:51.700189 9484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:51.700497 9484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:51.700623 9484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:51.708065 9484 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 21:29:51.708184 9484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:51.708257 9484 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 21:29:51.708331 9484 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 21:29:51.717365 9484 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.6.51.254:42733
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:42733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.51.254
--webserver_port=46425
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:51.718776 9484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:51.720638 9484 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:51.731011 9490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:51.731484 9493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:51.731870 9491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:51.732527 9484 server_base.cc:1034] running on GCE node
I20240502 21:29:51.733328 9484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:51.734707 9484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:51.735937 9484 hybrid_clock.cc:648] HybridClock initialized: now 1714685391735872 us; error 36 us; skew 500 ppm
I20240502 21:29:51.736266 9484 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:51.738677 9484 webserver.cc:460] Webserver started at http://127.6.51.254:46425/ using document root <none> and password file <none>
I20240502 21:29:51.739384 9484 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:51.739542 9484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:51.744886 9484 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20240502 21:29:51.747884 9499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:51.749364 9484 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:51.749558 9484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
uuid: "cfce8d84b3734df5a459c2fa0f682440"
format_stamp: "Formatted at 2024-05-02 21:29:50 on dist-test-slave-ns1z"
I20240502 21:29:51.750392 9484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:51.801515 9484 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:51.802456 9484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:51.802733 9484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:51.819839 9484 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.254:42733
I20240502 21:29:51.819859 9552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.254:42733 every 8 connection(s)
I20240502 21:29:51.821380 9484 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
I20240502 21:29:51.822983 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 9484
I20240502 21:29:51.829356 9553 sys_catalog.cc:263] Verifying existing consensus state
I20240502 21:29:51.833498 9553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Bootstrap starting.
I20240502 21:29:51.848737 9553 log.cc:824] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:51.857506 9553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:51.857972 9553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Bootstrap complete.
I20240502 21:29:51.864903 9553 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } }
I20240502 21:29:51.865651 9553 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfce8d84b3734df5a459c2fa0f682440, State: Initialized, Role: FOLLOWER
I20240502 21:29:51.866206 9553 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } }
I20240502 21:29:51.866403 9553 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:51.866494 9553 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:51.866631 9553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:29:51.870170 9553 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } }
I20240502 21:29:51.870622 9553 leader_election.cc:302] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfce8d84b3734df5a459c2fa0f682440; no voters:
I20240502 21:29:51.871146 9553 leader_election.cc:288] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:29:51.871299 9558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:29:51.871918 9558 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [term 2 LEADER]: Becoming Leader. State: Replica: cfce8d84b3734df5a459c2fa0f682440, State: Running, Role: LEADER
I20240502 21:29:51.872418 9558 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } }
I20240502 21:29:51.873098 9553 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 21:29:51.874832 9559 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cfce8d84b3734df5a459c2fa0f682440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } } }
I20240502 21:29:51.875090 9559 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:51.875909 9560 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfce8d84b3734df5a459c2fa0f682440. Latest consensus state: current_term: 2 leader_uuid: "cfce8d84b3734df5a459c2fa0f682440" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfce8d84b3734df5a459c2fa0f682440" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 42733 } } }
I20240502 21:29:51.876192 9560 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:51.877447 9564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 21:29:51.883311 9564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 21:29:51.884742 9564 catalog_manager.cc:1259] Loaded cluster ID: 57fee93fabb244bd868e9134a2d061f0
I20240502 21:29:51.884860 9564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 21:29:51.888188 9564 catalog_manager.cc:1504] Loading token signing keys...
I20240502 21:29:51.889328 9564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfce8d84b3734df5a459c2fa0f682440: Loaded TSK: 0
I20240502 21:29:51.890515 9564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 21:29:52.702009 9340 heartbeater.cc:347] Connected to a master server at 127.6.51.254:42733
I20240502 21:29:52.702234 9340 heartbeater.cc:503] Master 127.6.51.254:42733 was elected leader, sending a full tablet report...
I20240502 21:29:52.704104 9516 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" instance_seqno: 1714685390659969) as {username='slave'} at 127.6.51.193:46505; Asking this server to re-register.
I20240502 21:29:52.704883 9340 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:52.705106 9340 heartbeater.cc:511] Master 127.6.51.254:42733 requested a full tablet report, sending...
I20240502 21:29:52.706418 9516 ts_manager.cc:194] Registered new tserver with Master: 5560f42ba666436b843cf3a2921e71e3 (127.6.51.193:34561)
I20240502 21:29:52.708389 6351 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 21:29:52.708554 6351 test_util.cc:268] Using random seed: 1304159162
I20240502 21:29:52.727262 9516 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56138:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 21:29:52.751022 9275 tablet_service.cc:1467] Processing CreateTablet for tablet b465be2aa8d142659d6c9c375722f571 (DEFAULT_TABLE table=test-workload [id=56dc28b1e8314d68b11cfcad76c78e3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 21:29:52.752249 9275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b465be2aa8d142659d6c9c375722f571. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:52.762212 9589 tablet_bootstrap.cc:492] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3: Bootstrap starting.
I20240502 21:29:52.765336 9589 tablet_bootstrap.cc:654] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3: Neither blocks nor log segments found. Creating new log.
I20240502 21:29:52.766330 9589 log.cc:824] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:52.768625 9589 tablet_bootstrap.cc:492] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3: No bootstrap required, opened a new log
I20240502 21:29:52.768877 9589 ts_tablet_manager.cc:1367] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3: Time spent bootstrapping tablet: real 0.007s user 0.007s sys 0.000s
I20240502 21:29:52.774853 9589 raft_consensus.cc:348] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } }
I20240502 21:29:52.775148 9589 raft_consensus.cc:374] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:29:52.775228 9589 raft_consensus.cc:729] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5560f42ba666436b843cf3a2921e71e3, State: Initialized, Role: FOLLOWER
I20240502 21:29:52.775750 9589 consensus_queue.cc:260] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } }
I20240502 21:29:52.775929 9589 raft_consensus.cc:388] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:52.776019 9589 raft_consensus.cc:482] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:52.776142 9589 raft_consensus.cc:3037] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:29:52.778033 9589 raft_consensus.cc:504] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } }
I20240502 21:29:52.778470 9589 leader_election.cc:302] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5560f42ba666436b843cf3a2921e71e3; no voters:
I20240502 21:29:52.779059 9589 leader_election.cc:288] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:29:52.779211 9591 raft_consensus.cc:2781] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:29:52.779860 9591 raft_consensus.cc:686] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [term 1 LEADER]: Becoming Leader. State: Replica: 5560f42ba666436b843cf3a2921e71e3, State: Running, Role: LEADER
I20240502 21:29:52.780499 9591 consensus_queue.cc:237] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } }
I20240502 21:29:52.780731 9589 ts_tablet_manager.cc:1398] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20240502 21:29:52.785533 9516 catalog_manager.cc:5484] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5560f42ba666436b843cf3a2921e71e3 (127.6.51.193). New cstate: current_term: 1 leader_uuid: "5560f42ba666436b843cf3a2921e71e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } health_report { overall_health: HEALTHY } } }
I20240502 21:29:53.436370 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:35235
--local_ip_for_outbound_sockets=127.6.51.194
--tserver_master_addrs=127.6.51.254:42733
--webserver_port=37669
--webserver_interface=127.6.51.194
--builtin_ntp_servers=127.6.51.212:37745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:53.762179 9607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:53.762450 9607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:53.762580 9607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:53.769999 9607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:53.770253 9607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:53.779793 9607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:37745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:35235
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=37669
--tserver_master_addrs=127.6.51.254:42733
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:53.781219 9607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:53.783071 9607 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:53.795118 9612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:53.795729 9615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:53.796067 9613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:53.796459 9607 server_base.cc:1034] running on GCE node
I20240502 21:29:53.797080 9607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:53.797967 9607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:53.799189 9607 hybrid_clock.cc:648] HybridClock initialized: now 1714685393799135 us; error 24 us; skew 500 ppm
I20240502 21:29:53.799499 9607 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:53.801692 9607 webserver.cc:460] Webserver started at http://127.6.51.194:37669/ using document root <none> and password file <none>
I20240502 21:29:53.802384 9607 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:53.802547 9607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:53.807755 9607 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20240502 21:29:53.810595 9621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:53.811851 9607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20240502 21:29:53.812009 9607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "047f49a6f3fa4871a12eb352433e37a3"
format_stamp: "Formatted at 2024-05-02 21:29:51 on dist-test-slave-ns1z"
I20240502 21:29:53.812861 9607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:53.866400 9607 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:53.867308 9607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:53.867586 9607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:53.868584 9607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:53.870154 9607 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:53.870252 9607 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:53.870359 9607 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:53.870426 9607 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:53.899399 9607 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:35235
I20240502 21:29:53.899503 9735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:35235 every 8 connection(s)
I20240502 21:29:53.900913 9607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:53.907450 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 9607
I20240502 21:29:53.914289 9736 heartbeater.cc:347] Connected to a master server at 127.6.51.254:42733
I20240502 21:29:53.914597 9736 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:53.915473 9736 heartbeater.cc:511] Master 127.6.51.254:42733 requested a full tablet report, sending...
I20240502 21:29:53.917136 9514 ts_manager.cc:194] Registered new tserver with Master: 047f49a6f3fa4871a12eb352433e37a3 (127.6.51.194:35235)
I20240502 21:29:53.918489 9514 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:46149
I20240502 21:29:53.920931 9741 ts_tablet_manager.cc:902] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Initiating tablet copy from peer 5560f42ba666436b843cf3a2921e71e3 (127.6.51.193:34561)
I20240502 21:29:53.922549 9741 tablet_copy_client.cc:308] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34561
I20240502 21:29:53.928215 9315 tablet_copy_service.cc:140] P 5560f42ba666436b843cf3a2921e71e3: Received BeginTabletCopySession request for tablet b465be2aa8d142659d6c9c375722f571 from peer 047f49a6f3fa4871a12eb352433e37a3 ({username='slave'} at 127.6.51.194:51369)
I20240502 21:29:53.928431 9315 tablet_copy_service.cc:161] P 5560f42ba666436b843cf3a2921e71e3: Beginning new tablet copy session on tablet b465be2aa8d142659d6c9c375722f571 from peer 047f49a6f3fa4871a12eb352433e37a3 at {username='slave'} at 127.6.51.194:51369: session id = 047f49a6f3fa4871a12eb352433e37a3-b465be2aa8d142659d6c9c375722f571
I20240502 21:29:53.930954 9315 tablet_copy_source_session.cc:205] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:29:53.935387 9741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b465be2aa8d142659d6c9c375722f571. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:53.945835 9741 tablet_copy_client.cc:783] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet copy: Starting download of 0 data blocks...
I20240502 21:29:53.946130 9741 tablet_copy_client.cc:647] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet copy: Starting download of 1 WAL segments...
I20240502 21:29:53.950455 9741 tablet_copy_client.cc:523] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:29:53.954488 9741 tablet_bootstrap.cc:492] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Bootstrap starting.
I20240502 21:29:54.013214 9741 log.cc:824] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:54.505476 9741 tablet_bootstrap.cc:492] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:54.506047 9741 tablet_bootstrap.cc:492] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Bootstrap complete.
I20240502 21:29:54.506578 9741 ts_tablet_manager.cc:1367] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Time spent bootstrapping tablet: real 0.552s user 0.520s sys 0.032s
I20240502 21:29:54.510996 9741 raft_consensus.cc:348] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } }
I20240502 21:29:54.511345 9741 raft_consensus.cc:729] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 047f49a6f3fa4871a12eb352433e37a3, State: Initialized, Role: NON_PARTICIPANT
I20240502 21:29:54.511819 9741 consensus_queue.cc:260] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } }
I20240502 21:29:54.512778 9736 heartbeater.cc:503] Master 127.6.51.254:42733 was elected leader, sending a full tablet report...
I20240502 21:29:54.513206 9741 ts_tablet_manager.cc:1398] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20240502 21:29:54.514330 9315 tablet_copy_service.cc:342] P 5560f42ba666436b843cf3a2921e71e3: Request end of tablet copy session 047f49a6f3fa4871a12eb352433e37a3-b465be2aa8d142659d6c9c375722f571 received from {username='slave'} at 127.6.51.194:51369
I20240502 21:29:54.514508 9315 tablet_copy_service.cc:433] P 5560f42ba666436b843cf3a2921e71e3: ending tablet copy session 047f49a6f3fa4871a12eb352433e37a3-b465be2aa8d142659d6c9c375722f571 on tablet b465be2aa8d142659d6c9c375722f571 with peer 047f49a6f3fa4871a12eb352433e37a3
I20240502 21:29:54.518501 9671 tablet_service.cc:1514] Processing DeleteTablet for tablet b465be2aa8d142659d6c9c375722f571 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:35658
I20240502 21:29:54.519121 9749 tablet_replica.cc:330] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: stopping tablet replica
I20240502 21:29:54.519506 9749 raft_consensus.cc:2229] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 21:29:54.519810 9749 raft_consensus.cc:2258] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20240502 21:29:54.521046 9749 ts_tablet_manager.cc:1875] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 21:29:54.525377 9749 ts_tablet_manager.cc:1888] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.209
I20240502 21:29:54.525506 9749 log.cc:1196] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Deleting WAL directory at /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1714685376968067-6351-0/minicluster-data/ts-1/wal/wals/b465be2aa8d142659d6c9c375722f571
I20240502 21:29:54.527364 9741 ts_tablet_manager.cc:902] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Initiating tablet copy from peer 5560f42ba666436b843cf3a2921e71e3 (127.6.51.193:34561)
I20240502 21:29:54.528416 9741 tablet_copy_client.cc:308] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:34561
I20240502 21:29:54.529124 9315 tablet_copy_service.cc:140] P 5560f42ba666436b843cf3a2921e71e3: Received BeginTabletCopySession request for tablet b465be2aa8d142659d6c9c375722f571 from peer 047f49a6f3fa4871a12eb352433e37a3 ({username='slave'} at 127.6.51.194:51369)
I20240502 21:29:54.529304 9315 tablet_copy_service.cc:161] P 5560f42ba666436b843cf3a2921e71e3: Beginning new tablet copy session on tablet b465be2aa8d142659d6c9c375722f571 from peer 047f49a6f3fa4871a12eb352433e37a3 at {username='slave'} at 127.6.51.194:51369: session id = 047f49a6f3fa4871a12eb352433e37a3-b465be2aa8d142659d6c9c375722f571
I20240502 21:29:54.531149 9315 tablet_copy_source_session.cc:205] T b465be2aa8d142659d6c9c375722f571 P 5560f42ba666436b843cf3a2921e71e3: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:29:54.531999 9741 ts_tablet_manager.cc:1875] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 21:29:54.536199 9741 ts_tablet_manager.cc:1888] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.209
I20240502 21:29:54.536446 9741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b465be2aa8d142659d6c9c375722f571. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:54.538686 9741 tablet_copy_client.cc:783] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet copy: Starting download of 0 data blocks...
I20240502 21:29:54.538865 9741 tablet_copy_client.cc:647] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet copy: Starting download of 1 WAL segments...
I20240502 21:29:54.542223 9741 tablet_copy_client.cc:523] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:29:54.544553 9741 tablet_bootstrap.cc:492] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Bootstrap starting.
I20240502 21:29:55.079067 9741 tablet_bootstrap.cc:492] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:55.079452 9741 tablet_bootstrap.cc:492] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Bootstrap complete.
I20240502 21:29:55.079756 9741 ts_tablet_manager.cc:1367] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Time spent bootstrapping tablet: real 0.535s user 0.510s sys 0.024s
I20240502 21:29:55.080574 9741 raft_consensus.cc:348] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } }
I20240502 21:29:55.080753 9741 raft_consensus.cc:729] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3 [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 047f49a6f3fa4871a12eb352433e37a3, State: Initialized, Role: NON_PARTICIPANT
I20240502 21:29:55.080972 9741 consensus_queue.cc:260] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5560f42ba666436b843cf3a2921e71e3" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 34561 } }
I20240502 21:29:55.081624 9741 ts_tablet_manager.cc:1398] T b465be2aa8d142659d6c9c375722f571 P 047f49a6f3fa4871a12eb352433e37a3: Time spent starting tablet: real 0.002s user 0.001s sys 0.004s
I20240502 21:29:55.082499 9315 tablet_copy_service.cc:342] P 5560f42ba666436b843cf3a2921e71e3: Request end of tablet copy session 047f49a6f3fa4871a12eb352433e37a3-b465be2aa8d142659d6c9c375722f571 received from {username='slave'} at 127.6.51.194:51369
I20240502 21:29:55.082646 9315 tablet_copy_service.cc:433] P 5560f42ba666436b843cf3a2921e71e3: ending tablet copy session 047f49a6f3fa4871a12eb352433e37a3-b465be2aa8d142659d6c9c375722f571 on tablet b465be2aa8d142659d6c9c375722f571 with peer 047f49a6f3fa4871a12eb352433e37a3
I20240502 21:29:55.085911 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 9213
I20240502 21:29:55.086863 9335 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:55.184692 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 9213
I20240502 21:29:55.203820 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 9607
I20240502 21:29:55.204998 9731 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:55.318595 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 9607
I20240502 21:29:55.338692 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 9484
I20240502 21:29:55.339850 9546 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:55.447713 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 9484
2024-05-02T21:29:55Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (5837 ms)
[ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource
2024-05-02T21:29:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T21:29:55Z Disabled control of system clock
I20240502 21:29:55.512969 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:34849
--webserver_interface=127.6.51.254
--webserver_port=0
--builtin_ntp_servers=127.6.51.212:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.51.254:34849
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 21:29:55.836794 9762 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:55.837136 9762 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:55.837232 9762 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:55.844692 9762 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 21:29:55.844803 9762 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:55.844897 9762 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 21:29:55.844959 9762 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 21:29:55.854190 9762 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.6.51.254:34849
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:34849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.51.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:55.855516 9762 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:55.857371 9762 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:55.867890 9767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:55.868327 9770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:55.868661 9768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:55.869310 9762 server_base.cc:1034] running on GCE node
I20240502 21:29:55.870119 9762 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:55.871490 9762 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:55.872728 9762 hybrid_clock.cc:648] HybridClock initialized: now 1714685395872645 us; error 51 us; skew 500 ppm
I20240502 21:29:55.873085 9762 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:55.879290 9762 webserver.cc:460] Webserver started at http://127.6.51.254:34227/ using document root <none> and password file <none>
I20240502 21:29:55.880081 9762 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:55.880213 9762 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:55.880522 9762 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:55.883263 9762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/instance:
uuid: "88315ea16b4440579699fe91bd3584a6"
format_stamp: "Formatted at 2024-05-02 21:29:55 on dist-test-slave-ns1z"
I20240502 21:29:55.884042 9762 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal/instance:
uuid: "88315ea16b4440579699fe91bd3584a6"
format_stamp: "Formatted at 2024-05-02 21:29:55 on dist-test-slave-ns1z"
I20240502 21:29:55.889379 9762 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20240502 21:29:55.892863 9776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:55.894268 9762 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240502 21:29:55.894502 9762 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
uuid: "88315ea16b4440579699fe91bd3584a6"
format_stamp: "Formatted at 2024-05-02 21:29:55 on dist-test-slave-ns1z"
I20240502 21:29:55.894695 9762 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:55.914696 9762 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:55.915520 9762 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:55.915776 9762 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:55.933670 9762 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.254:34849
I20240502 21:29:55.933689 9828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.254:34849 every 8 connection(s)
I20240502 21:29:55.935163 9762 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
I20240502 21:29:55.938870 9829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:55.941243 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 9762
I20240502 21:29:55.941442 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal/instance
I20240502 21:29:55.949321 9829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Bootstrap starting.
I20240502 21:29:55.952332 9829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Neither blocks nor log segments found. Creating new log.
I20240502 21:29:55.953631 9829 log.cc:824] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:55.956068 9829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: No bootstrap required, opened a new log
I20240502 21:29:55.963001 9829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } }
I20240502 21:29:55.963315 9829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:29:55.963388 9829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88315ea16b4440579699fe91bd3584a6, State: Initialized, Role: FOLLOWER
I20240502 21:29:55.963900 9829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } }
I20240502 21:29:55.964075 9829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:55.964165 9829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:55.964274 9829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:29:55.966413 9829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } }
I20240502 21:29:55.966850 9829 leader_election.cc:302] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88315ea16b4440579699fe91bd3584a6; no voters:
I20240502 21:29:55.967334 9829 leader_election.cc:288] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:29:55.967473 9834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:29:55.968046 9834 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 1 LEADER]: Becoming Leader. State: Replica: 88315ea16b4440579699fe91bd3584a6, State: Running, Role: LEADER
I20240502 21:29:55.968503 9834 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } }
I20240502 21:29:55.969167 9829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 21:29:55.971169 9836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88315ea16b4440579699fe91bd3584a6. Latest consensus state: current_term: 1 leader_uuid: "88315ea16b4440579699fe91bd3584a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } } }
I20240502 21:29:55.971419 9835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88315ea16b4440579699fe91bd3584a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } } }
I20240502 21:29:55.971589 9836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:55.971644 9835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:55.973703 9841 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 21:29:55.978452 9841 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 21:29:55.986505 9841 catalog_manager.cc:1347] Generated new cluster ID: 8e461afa72254f2a8d763c3de4c7373b
I20240502 21:29:55.986627 9841 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 21:29:56.010739 9841 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 21:29:56.011935 9841 catalog_manager.cc:1504] Loading token signing keys...
I20240502 21:29:56.019253 9841 catalog_manager.cc:5857] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Generated new TSK 0
I20240502 21:29:56.020085 9841 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 21:29:56.036278 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:0
--local_ip_for_outbound_sockets=127.6.51.193
--webserver_interface=127.6.51.193
--webserver_port=0
--tserver_master_addrs=127.6.51.254:34849
--builtin_ntp_servers=127.6.51.212:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:56.358247 9853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:56.358552 9853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:56.358683 9853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:56.366393 9853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:56.366608 9853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:29:56.376042 9853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=0
--tserver_master_addrs=127.6.51.254:34849
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:56.377513 9853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:56.379252 9853 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:56.390985 9859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:56.391381 9858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:56.391938 9861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:56.392401 9853 server_base.cc:1034] running on GCE node
I20240502 21:29:56.393065 9853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:56.394112 9853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:56.395380 9853 hybrid_clock.cc:648] HybridClock initialized: now 1714685396395302 us; error 46 us; skew 500 ppm
I20240502 21:29:56.395715 9853 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:56.397918 9853 webserver.cc:460] Webserver started at http://127.6.51.193:40181/ using document root <none> and password file <none>
I20240502 21:29:56.398644 9853 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:56.398767 9853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:56.399107 9853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:56.401786 9853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/instance:
uuid: "a9021e33214d405884be90a0d5fa7a5f"
format_stamp: "Formatted at 2024-05-02 21:29:56 on dist-test-slave-ns1z"
I20240502 21:29:56.402508 9853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal/instance:
uuid: "a9021e33214d405884be90a0d5fa7a5f"
format_stamp: "Formatted at 2024-05-02 21:29:56 on dist-test-slave-ns1z"
I20240502 21:29:56.407717 9853 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20240502 21:29:56.411339 9867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:56.412789 9853 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 21:29:56.413003 9853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "a9021e33214d405884be90a0d5fa7a5f"
format_stamp: "Formatted at 2024-05-02 21:29:56 on dist-test-slave-ns1z"
I20240502 21:29:56.413177 9853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:56.441799 9853 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:56.442680 9853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:56.442952 9853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:56.443923 9853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:56.445502 9853 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:56.445575 9853 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:56.445669 9853 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:56.445715 9853 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:56.475499 9853 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:36605
I20240502 21:29:56.475531 9980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:36605 every 8 connection(s)
I20240502 21:29:56.476977 9853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:29:56.485877 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 9853
I20240502 21:29:56.486055 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal/instance
I20240502 21:29:56.489768 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:0
--local_ip_for_outbound_sockets=127.6.51.194
--webserver_interface=127.6.51.194
--webserver_port=0
--tserver_master_addrs=127.6.51.254:34849
--builtin_ntp_servers=127.6.51.212:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
I20240502 21:29:56.489835 9981 heartbeater.cc:347] Connected to a master server at 127.6.51.254:34849
I20240502 21:29:56.490145 9981 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:56.490988 9981 heartbeater.cc:511] Master 127.6.51.254:34849 requested a full tablet report, sending...
I20240502 21:29:56.493094 9794 ts_manager.cc:194] Registered new tserver with Master: a9021e33214d405884be90a0d5fa7a5f (127.6.51.193:36605)
I20240502 21:29:56.494652 9794 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:49547
W20240502 21:29:56.810926 9985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:56.811231 9985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:56.811345 9985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:56.818994 9985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:56.819205 9985 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:56.828405 9985 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=0
--tserver_master_addrs=127.6.51.254:34849
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:56.829875 9985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:56.831701 9985 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:56.843446 9990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:56.844022 9993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:56.844576 9991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:56.844775 9985 server_base.cc:1034] running on GCE node
I20240502 21:29:56.845400 9985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:56.846307 9985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:56.847515 9985 hybrid_clock.cc:648] HybridClock initialized: now 1714685396847442 us; error 50 us; skew 500 ppm
I20240502 21:29:56.847810 9985 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:56.850008 9985 webserver.cc:460] Webserver started at http://127.6.51.194:45297/ using document root <none> and password file <none>
I20240502 21:29:56.850715 9985 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:56.850834 9985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:56.851142 9985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:29:56.853847 9985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/instance:
uuid: "6f146c4271a3400caa4d6d98aeb34df0"
format_stamp: "Formatted at 2024-05-02 21:29:56 on dist-test-slave-ns1z"
I20240502 21:29:56.854588 9985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal/instance:
uuid: "6f146c4271a3400caa4d6d98aeb34df0"
format_stamp: "Formatted at 2024-05-02 21:29:56 on dist-test-slave-ns1z"
I20240502 21:29:56.859694 9985 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20240502 21:29:56.863090 9999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:56.864404 9985 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20240502 21:29:56.864562 9985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "6f146c4271a3400caa4d6d98aeb34df0"
format_stamp: "Formatted at 2024-05-02 21:29:56 on dist-test-slave-ns1z"
I20240502 21:29:56.864727 9985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:56.886943 9985 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:56.887799 9985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:56.888075 9985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:56.889159 9985 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:56.890731 9985 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:56.890805 9985 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:56.890920 9985 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:56.890969 9985 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:56.920933 9985 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:41381
I20240502 21:29:56.920993 10112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:41381 every 8 connection(s)
I20240502 21:29:56.922286 9985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:56.929919 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 9985
I20240502 21:29:56.930087 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal/instance
I20240502 21:29:56.935343 10113 heartbeater.cc:347] Connected to a master server at 127.6.51.254:34849
I20240502 21:29:56.935674 10113 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:56.936556 10113 heartbeater.cc:511] Master 127.6.51.254:34849 requested a full tablet report, sending...
I20240502 21:29:56.938050 9794 ts_manager.cc:194] Registered new tserver with Master: 6f146c4271a3400caa4d6d98aeb34df0 (127.6.51.194:41381)
I20240502 21:29:56.938890 9794 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:33855
I20240502 21:29:56.946213 6351 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 21:29:56.959924 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 9985
I20240502 21:29:56.970203 10108 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:57.050388 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 9985
I20240502 21:29:57.066005 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 9762
I20240502 21:29:57.067263 9824 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:29:57.167003 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 9762
I20240502 21:29:57.186642 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:34849
--webserver_interface=127.6.51.254
--webserver_port=34227
--builtin_ntp_servers=127.6.51.212:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.51.254:34849
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240502 21:29:57.497875 9981 heartbeater.cc:503] Master 127.6.51.254:34849 was elected leader, sending a full tablet report...
W20240502 21:29:57.499375 9981 heartbeater.cc:644] Failed to heartbeat to 127.6.51.254:34849 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.51.254:34849: connect: Connection refused (error 111)
W20240502 21:29:57.520491 10125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:57.520797 10125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:57.520947 10125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:57.528259 10125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 21:29:57.528368 10125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:57.528440 10125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 21:29:57.528522 10125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 21:29:57.537406 10125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.6.51.254:34849
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:34849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.51.254
--webserver_port=34227
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:57.538702 10125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:57.540412 10125 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:57.550612 10131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:57.551064 10134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:57.551563 10132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:57.551847 10125 server_base.cc:1034] running on GCE node
I20240502 21:29:57.552618 10125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:57.554064 10125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:57.555276 10125 hybrid_clock.cc:648] HybridClock initialized: now 1714685397555215 us; error 35 us; skew 500 ppm
I20240502 21:29:57.555608 10125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:57.557849 10125 webserver.cc:460] Webserver started at http://127.6.51.254:34227/ using document root <none> and password file <none>
I20240502 21:29:57.558584 10125 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:57.558727 10125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:57.564047 10125 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.002s
I20240502 21:29:57.566964 10140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:57.568290 10125 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20240502 21:29:57.568446 10125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
uuid: "88315ea16b4440579699fe91bd3584a6"
format_stamp: "Formatted at 2024-05-02 21:29:55 on dist-test-slave-ns1z"
I20240502 21:29:57.569361 10125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:57.607033 10125 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:57.607996 10125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:57.608278 10125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:57.625581 10125 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.254:34849
I20240502 21:29:57.625588 10192 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.254:34849 every 8 connection(s)
I20240502 21:29:57.627094 10125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
I20240502 21:29:57.633631 10193 sys_catalog.cc:263] Verifying existing consensus state
I20240502 21:29:57.634485 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 10125
I20240502 21:29:57.637212 10193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Bootstrap starting.
I20240502 21:29:57.653038 10193 log.cc:824] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:57.661211 10193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:29:57.661834 10193 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Bootstrap complete.
I20240502 21:29:57.668709 10193 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } }
I20240502 21:29:57.669546 10193 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88315ea16b4440579699fe91bd3584a6, State: Initialized, Role: FOLLOWER
I20240502 21:29:57.670174 10193 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } }
I20240502 21:29:57.670388 10193 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:57.670473 10193 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:57.670605 10193 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:29:57.674712 10193 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } }
I20240502 21:29:57.675175 10193 leader_election.cc:302] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88315ea16b4440579699fe91bd3584a6; no voters:
I20240502 21:29:57.675704 10193 leader_election.cc:288] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:29:57.675843 10198 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:29:57.676403 10198 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [term 2 LEADER]: Becoming Leader. State: Replica: 88315ea16b4440579699fe91bd3584a6, State: Running, Role: LEADER
I20240502 21:29:57.677008 10198 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } }
I20240502 21:29:57.677686 10193 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 21:29:57.679538 10200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88315ea16b4440579699fe91bd3584a6. Latest consensus state: current_term: 2 leader_uuid: "88315ea16b4440579699fe91bd3584a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } } }
I20240502 21:29:57.679886 10200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:57.680291 10199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "88315ea16b4440579699fe91bd3584a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88315ea16b4440579699fe91bd3584a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 34849 } } }
I20240502 21:29:57.680537 10199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6 [sys.catalog]: This master's current role is: LEADER
I20240502 21:29:57.687103 10204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 21:29:57.692759 10204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 21:29:57.694309 10204 catalog_manager.cc:1259] Loaded cluster ID: 8e461afa72254f2a8d763c3de4c7373b
I20240502 21:29:57.694571 10204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 21:29:57.699450 10204 catalog_manager.cc:1504] Loading token signing keys...
I20240502 21:29:57.700919 10204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88315ea16b4440579699fe91bd3584a6: Loaded TSK: 0
I20240502 21:29:57.702586 10204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 21:29:58.506444 9981 heartbeater.cc:347] Connected to a master server at 127.6.51.254:34849
I20240502 21:29:58.506656 9981 heartbeater.cc:503] Master 127.6.51.254:34849 was elected leader, sending a full tablet report...
I20240502 21:29:58.508571 10157 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" instance_seqno: 1714685396468056) as {username='slave'} at 127.6.51.193:48433; Asking this server to re-register.
I20240502 21:29:58.509341 9981 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:58.509615 9981 heartbeater.cc:511] Master 127.6.51.254:34849 requested a full tablet report, sending...
I20240502 21:29:58.510947 10157 ts_manager.cc:194] Registered new tserver with Master: a9021e33214d405884be90a0d5fa7a5f (127.6.51.193:36605)
I20240502 21:29:58.522986 6351 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 21:29:58.523180 6351 test_util.cc:268] Using random seed: 1309973784
I20240502 21:29:58.543062 10157 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37028:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 21:29:58.568010 9916 tablet_service.cc:1467] Processing CreateTablet for tablet 1ee4141dfb0e4e78ac9a107ce84d0a67 (DEFAULT_TABLE table=test-workload [id=0ac386090a1e4ff2a749788e048bcfb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20240502 21:29:58.569325 9916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee4141dfb0e4e78ac9a107ce84d0a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:58.579783 10229 tablet_bootstrap.cc:492] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Bootstrap starting.
I20240502 21:29:58.583025 10229 tablet_bootstrap.cc:654] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Neither blocks nor log segments found. Creating new log.
I20240502 21:29:58.584079 10229 log.cc:824] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Log is configured to *not* fsync() on all Append() calls
I20240502 21:29:58.586525 10229 tablet_bootstrap.cc:492] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: No bootstrap required, opened a new log
I20240502 21:29:58.586776 10229 ts_tablet_manager.cc:1367] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20240502 21:29:58.592747 10229 raft_consensus.cc:348] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:29:58.593115 10229 raft_consensus.cc:374] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:29:58.593207 10229 raft_consensus.cc:729] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9021e33214d405884be90a0d5fa7a5f, State: Initialized, Role: FOLLOWER
I20240502 21:29:58.593865 10229 consensus_queue.cc:260] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:29:58.594067 10229 raft_consensus.cc:388] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:29:58.594183 10229 raft_consensus.cc:482] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:29:58.594322 10229 raft_consensus.cc:3037] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:29:58.596419 10229 raft_consensus.cc:504] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:29:58.596977 10229 leader_election.cc:302] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9021e33214d405884be90a0d5fa7a5f; no voters:
I20240502 21:29:58.597594 10229 leader_election.cc:288] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:29:58.597736 10231 raft_consensus.cc:2781] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:29:58.598286 10231 raft_consensus.cc:686] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 1 LEADER]: Becoming Leader. State: Replica: a9021e33214d405884be90a0d5fa7a5f, State: Running, Role: LEADER
I20240502 21:29:58.598809 10231 consensus_queue.cc:237] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:29:58.599228 10229 ts_tablet_manager.cc:1398] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20240502 21:29:58.603766 10157 catalog_manager.cc:5484] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a9021e33214d405884be90a0d5fa7a5f (127.6.51.193). New cstate: current_term: 1 leader_uuid: "a9021e33214d405884be90a0d5fa7a5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } health_report { overall_health: HEALTHY } } }
I20240502 21:29:59.262734 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:41381
--local_ip_for_outbound_sockets=127.6.51.194
--tserver_master_addrs=127.6.51.254:34849
--webserver_port=45297
--webserver_interface=127.6.51.194
--builtin_ntp_servers=127.6.51.212:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:29:59.601347 10247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:29:59.601680 10247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:29:59.601835 10247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:29:59.609894 10247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:29:59.610118 10247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:29:59.620119 10247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:41381
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=45297
--tserver_master_addrs=127.6.51.254:34849
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:29:59.621693 10247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:29:59.623590 10247 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:29:59.637187 10253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:59.637516 10255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:29:59.637722 10252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:29:59.638291 10247 server_base.cc:1034] running on GCE node
I20240502 21:29:59.638859 10247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:29:59.639811 10247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:29:59.641010 10247 hybrid_clock.cc:648] HybridClock initialized: now 1714685399640941 us; error 45 us; skew 500 ppm
I20240502 21:29:59.641321 10247 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:29:59.643478 10247 webserver.cc:460] Webserver started at http://127.6.51.194:45297/ using document root <none> and password file <none>
I20240502 21:29:59.644186 10247 fs_manager.cc:359] Metadata directory not provided
I20240502 21:29:59.644315 10247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:29:59.649549 10247 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:59.652247 10261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:59.653569 10247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:29:59.653717 10247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "6f146c4271a3400caa4d6d98aeb34df0"
format_stamp: "Formatted at 2024-05-02 21:29:56 on dist-test-slave-ns1z"
I20240502 21:29:59.654503 10247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:29:59.669112 10247 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:29:59.669986 10247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:29:59.670246 10247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:29:59.671499 10247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:29:59.673142 10247 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:29:59.673228 10247 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:59.673332 10247 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:29:59.673398 10247 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:29:59.703510 10247 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:41381
I20240502 21:29:59.703568 10375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:41381 every 8 connection(s)
I20240502 21:29:59.705096 10247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:29:59.713284 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 10247
W20240502 21:29:59.717687 9976 generic_service.cc:139] {username='slave'} at 127.0.0.1:39986 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data
I20240502 21:29:59.717921 9976 generic_service.cc:175] {username='slave'} at 127.0.0.1:39986 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0'
I20240502 21:29:59.719331 10376 heartbeater.cc:347] Connected to a master server at 127.6.51.254:34849
I20240502 21:29:59.719739 10376 heartbeater.cc:464] Registering TS with master...
I20240502 21:29:59.720696 10376 heartbeater.cc:511] Master 127.6.51.254:34849 requested a full tablet report, sending...
I20240502 21:29:59.722229 10157 ts_manager.cc:194] Registered new tserver with Master: 6f146c4271a3400caa4d6d98aeb34df0 (127.6.51.194:41381)
I20240502 21:29:59.723294 10157 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:46837
I20240502 21:29:59.727720 10381 ts_tablet_manager.cc:902] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Initiating tablet copy from peer a9021e33214d405884be90a0d5fa7a5f (127.6.51.193:36605)
I20240502 21:29:59.729485 10381 tablet_copy_client.cc:308] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:36605
I20240502 21:29:59.734906 9956 tablet_copy_service.cc:140] P a9021e33214d405884be90a0d5fa7a5f: Received BeginTabletCopySession request for tablet 1ee4141dfb0e4e78ac9a107ce84d0a67 from peer 6f146c4271a3400caa4d6d98aeb34df0 ({username='slave'} at 127.6.51.194:35943)
I20240502 21:29:59.735106 9956 tablet_copy_service.cc:161] P a9021e33214d405884be90a0d5fa7a5f: Beginning new tablet copy session on tablet 1ee4141dfb0e4e78ac9a107ce84d0a67 from peer 6f146c4271a3400caa4d6d98aeb34df0 at {username='slave'} at 127.6.51.194:35943: session id = 6f146c4271a3400caa4d6d98aeb34df0-1ee4141dfb0e4e78ac9a107ce84d0a67
I20240502 21:29:59.737709 9956 tablet_copy_source_session.cc:205] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:29:59.742074 10381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee4141dfb0e4e78ac9a107ce84d0a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:29:59.752895 10381 tablet_copy_client.cc:783] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet copy: Starting download of 0 data blocks...
I20240502 21:29:59.753207 10381 tablet_copy_client.cc:647] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet copy: Starting download of 1 WAL segments...
W20240502 21:29:59.754719 9956 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20240502 21:29:59.754839 9956 fault_injection.cc:44] THIS SERVER MAY CRASH!
E20240502 21:29:59.754904 9956 fault_injection.cc:59] injecting fault for kudu (pid 9853): FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit)
W20240502 21:29:59.773587 10381 ts_tablet_manager.cc:980] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Tablet Copy: Unable to fetch data from remote peer a9021e33214d405884be90a0d5fa7a5f (127.6.51.193:36605): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.6.51.193:36605 (error 108)
I20240502 21:29:59.773787 10381 tablet_replica.cc:330] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: stopping tablet replica
I20240502 21:29:59.774008 10381 raft_consensus.cc:2229] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20240502 21:29:59.774185 10381 raft_consensus.cc:2258] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
W20240502 21:29:59.775352 10381 tablet_copy_client.cc:1108] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.6.51.193:36605: connect: Connection refused (error 111)
W20240502 21:29:59.776240 10381 tablet_metadata.cc:476] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 1ee4141dfb0e4e78ac9a107ce84d0a67 but one is already registered
I20240502 21:29:59.776510 10381 ts_tablet_manager.cc:1875] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20240502 21:29:59.781813 10381 ts_tablet_manager.cc:1888] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0
I20240502 21:29:59.781955 10381 log.cc:1196] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Deleting WAL directory at /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-1/wal/wals/1ee4141dfb0e4e78ac9a107ce84d0a67
I20240502 21:29:59.785919 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:36605
--local_ip_for_outbound_sockets=127.6.51.193
--tserver_master_addrs=127.6.51.254:34849
--webserver_port=40181
--webserver_interface=127.6.51.193
--builtin_ntp_servers=127.6.51.212:46411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin with env {}
W20240502 21:30:00.118199 10386 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:30:00.118503 10386 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:30:00.118629 10386 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:30:00.126173 10386 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:30:00.126377 10386 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:30:00.135463 10386 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:36605
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=40181
--tserver_master_addrs=127.6.51.254:34849
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:30:00.136880 10386 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:30:00.138680 10386 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:30:00.152055 10392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:00.152520 10393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:00.152917 10395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:00.153209 10386 server_base.cc:1034] running on GCE node
I20240502 21:30:00.153889 10386 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:30:00.154844 10386 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:30:00.156055 10386 hybrid_clock.cc:648] HybridClock initialized: now 1714685400155983 us; error 59 us; skew 500 ppm
I20240502 21:30:00.156360 10386 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:30:00.158702 10386 webserver.cc:460] Webserver started at http://127.6.51.193:40181/ using document root <none> and password file <none>
I20240502 21:30:00.159462 10386 fs_manager.cc:359] Metadata directory not provided
I20240502 21:30:00.159606 10386 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:30:00.165078 10386 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20240502 21:30:00.167969 10401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:00.169387 10386 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:00.169538 10386 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "a9021e33214d405884be90a0d5fa7a5f"
format_stamp: "Formatted at 2024-05-02 21:29:56 on dist-test-slave-ns1z"
I20240502 21:30:00.170392 10386 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:30:00.191394 10386 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:30:00.192312 10386 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:30:00.192598 10386 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:30:00.193634 10386 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:30:00.195580 10408 ts_tablet_manager.cc:522] Loading tablet metadata (0/1 complete)
I20240502 21:30:00.200949 10386 ts_tablet_manager.cc:559] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20240502 21:30:00.201066 10386 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20240502 21:30:00.201195 10386 ts_tablet_manager.cc:574] Registering tablets (0/1 complete)
I20240502 21:30:00.204123 10386 ts_tablet_manager.cc:590] Registered 1 tablets
I20240502 21:30:00.204201 10386 ts_tablet_manager.cc:569] Time spent register tablets: real 0.003s user 0.000s sys 0.000s
I20240502 21:30:00.204564 10408 tablet_bootstrap.cc:492] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Bootstrap starting.
I20240502 21:30:00.240252 10386 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:36605
I20240502 21:30:00.240309 10515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:36605 every 8 connection(s)
I20240502 21:30:00.241948 10386 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:30:00.247895 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 10386
I20240502 21:30:00.259389 10516 heartbeater.cc:347] Connected to a master server at 127.6.51.254:34849
I20240502 21:30:00.259799 10516 heartbeater.cc:464] Registering TS with master...
I20240502 21:30:00.260985 10516 heartbeater.cc:511] Master 127.6.51.254:34849 requested a full tablet report, sending...
I20240502 21:30:00.263962 10157 ts_manager.cc:194] Re-registered known tserver with Master: a9021e33214d405884be90a0d5fa7a5f (127.6.51.193:36605)
I20240502 21:30:00.265120 10157 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:36267
I20240502 21:30:00.297493 10408 log.cc:824] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Log is configured to *not* fsync() on all Append() calls
I20240502 21:30:00.726519 10376 heartbeater.cc:503] Master 127.6.51.254:34849 was elected leader, sending a full tablet report...
W20240502 21:30:00.728490 10157 catalog_manager.cc:5397] Tablet 1ee4141dfb0e4e78ac9a107ce84d0a67 (table test-workload [id=0ac386090a1e4ff2a749788e048bcfb0]) has failed on TS 6f146c4271a3400caa4d6d98aeb34df0 (127.6.51.194:41381): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: recv got EOF from 127.6.51.193:36605 (error 108)
I20240502 21:30:00.851101 10408 tablet_bootstrap.cc:492] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Bootstrap replayed 1/1 log segments. Stats: ops{read=221 overwritten=0 applied=221 ignored=0} inserts{seen=11000 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:00.851677 10408 tablet_bootstrap.cc:492] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Bootstrap complete.
I20240502 21:30:00.852775 10408 ts_tablet_manager.cc:1367] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Time spent bootstrapping tablet: real 0.649s user 0.579s sys 0.064s
I20240502 21:30:00.857589 10408 raft_consensus.cc:348] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:30:00.858695 10408 raft_consensus.cc:729] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9021e33214d405884be90a0d5fa7a5f, State: Initialized, Role: FOLLOWER
I20240502 21:30:00.859419 10408 consensus_queue.cc:260] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 221, Last appended: 1.221, Last appended by leader: 221, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:30:00.859643 10408 raft_consensus.cc:388] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:00.859742 10408 raft_consensus.cc:482] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:00.859910 10408 raft_consensus.cc:3037] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:00.863734 10408 raft_consensus.cc:504] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:30:00.864259 10408 leader_election.cc:302] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9021e33214d405884be90a0d5fa7a5f; no voters:
I20240502 21:30:00.864907 10408 leader_election.cc:288] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:00.865036 10523 raft_consensus.cc:2781] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:00.865885 10523 raft_consensus.cc:686] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [term 2 LEADER]: Becoming Leader. State: Replica: a9021e33214d405884be90a0d5fa7a5f, State: Running, Role: LEADER
I20240502 21:30:00.866067 10516 heartbeater.cc:503] Master 127.6.51.254:34849 was elected leader, sending a full tablet report...
I20240502 21:30:00.866477 10523 consensus_queue.cc:237] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 221, Committed index: 221, Last appended: 1.221, Last appended by leader: 221, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:30:00.866729 10408 ts_tablet_manager.cc:1398] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20240502 21:30:00.870548 10157 catalog_manager.cc:5484] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "a9021e33214d405884be90a0d5fa7a5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:00.872146 10529 ts_tablet_manager.cc:902] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Initiating tablet copy from peer a9021e33214d405884be90a0d5fa7a5f (127.6.51.193:36605)
I20240502 21:30:00.873689 10529 tablet_copy_client.cc:308] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:36605
I20240502 21:30:00.881382 10491 tablet_copy_service.cc:140] P a9021e33214d405884be90a0d5fa7a5f: Received BeginTabletCopySession request for tablet 1ee4141dfb0e4e78ac9a107ce84d0a67 from peer 6f146c4271a3400caa4d6d98aeb34df0 ({username='slave'} at 127.6.51.194:36015)
I20240502 21:30:00.881644 10491 tablet_copy_service.cc:161] P a9021e33214d405884be90a0d5fa7a5f: Beginning new tablet copy session on tablet 1ee4141dfb0e4e78ac9a107ce84d0a67 from peer 6f146c4271a3400caa4d6d98aeb34df0 at {username='slave'} at 127.6.51.194:36015: session id = 6f146c4271a3400caa4d6d98aeb34df0-1ee4141dfb0e4e78ac9a107ce84d0a67
I20240502 21:30:00.884094 10491 tablet_copy_source_session.cc:205] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P a9021e33214d405884be90a0d5fa7a5f: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:00.885689 10529 ts_tablet_manager.cc:1875] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Deleting tablet data with delete state TABLET_DATA_COPYING
I20240502 21:30:00.890215 10529 ts_tablet_manager.cc:1888] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0
I20240502 21:30:00.890473 10529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1ee4141dfb0e4e78ac9a107ce84d0a67. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:00.892664 10529 tablet_copy_client.cc:783] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:00.892890 10529 tablet_copy_client.cc:647] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:00.897135 10529 tablet_copy_client.cc:523] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:00.899684 10529 tablet_bootstrap.cc:492] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Bootstrap starting.
I20240502 21:30:00.959834 10529 log.cc:824] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Log is configured to *not* fsync() on all Append() calls
I20240502 21:30:01.493952 10529 tablet_bootstrap.cc:492] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Bootstrap replayed 1/1 log segments. Stats: ops{read=222 overwritten=0 applied=222 ignored=0} inserts{seen=11000 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:01.494397 10529 tablet_bootstrap.cc:492] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Bootstrap complete.
I20240502 21:30:01.494869 10529 ts_tablet_manager.cc:1367] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Time spent bootstrapping tablet: real 0.595s user 0.554s sys 0.041s
I20240502 21:30:01.499647 10529 raft_consensus.cc:348] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:30:01.499944 10529 raft_consensus.cc:729] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 6f146c4271a3400caa4d6d98aeb34df0, State: Initialized, Role: NON_PARTICIPANT
I20240502 21:30:01.500371 10529 consensus_queue.cc:260] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 222, Last appended: 2.222, Last appended by leader: 222, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9021e33214d405884be90a0d5fa7a5f" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 36605 } }
I20240502 21:30:01.501891 10529 ts_tablet_manager.cc:1398] T 1ee4141dfb0e4e78ac9a107ce84d0a67 P 6f146c4271a3400caa4d6d98aeb34df0: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20240502 21:30:01.502743 10491 tablet_copy_service.cc:342] P a9021e33214d405884be90a0d5fa7a5f: Request end of tablet copy session 6f146c4271a3400caa4d6d98aeb34df0-1ee4141dfb0e4e78ac9a107ce84d0a67 received from {username='slave'} at 127.6.51.194:36015
I20240502 21:30:01.502880 10491 tablet_copy_service.cc:433] P a9021e33214d405884be90a0d5fa7a5f: ending tablet copy session 6f146c4271a3400caa4d6d98aeb34df0-1ee4141dfb0e4e78ac9a107ce84d0a67 on tablet 1ee4141dfb0e4e78ac9a107ce84d0a67 with peer 6f146c4271a3400caa4d6d98aeb34df0
I20240502 21:30:01.507977 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 10386
I20240502 21:30:01.508906 10511 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:30:01.608616 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 10386
I20240502 21:30:01.626789 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 10247
I20240502 21:30:01.627965 10371 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:30:01.735704 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 10247
I20240502 21:30:01.753243 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 10125
I20240502 21:30:01.754422 10187 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:30:01.857753 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 10125
2024-05-02T21:30:01Z chronyd exiting
[ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (6410 ms)
[ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource
2024-05-02T21:30:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2024-05-02T21:30:01Z Disabled control of system clock
I20240502 21:30:01.925645 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:35019
--webserver_interface=127.6.51.254
--webserver_port=0
--builtin_ntp_servers=127.6.51.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.51.254:35019
--master_tombstone_evicted_tablet_replicas=false with env {}
W20240502 21:30:02.248778 10547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:30:02.249142 10547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:30:02.249275 10547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:30:02.256644 10547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 21:30:02.256758 10547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:30:02.256851 10547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 21:30:02.256933 10547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 21:30:02.265959 10547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.6.51.254:35019
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:35019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.51.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:30:02.267349 10547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:30:02.269172 10547 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:30:02.279673 10552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:02.280237 10555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:02.280619 10553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:02.281081 10547 server_base.cc:1034] running on GCE node
I20240502 21:30:02.281956 10547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:30:02.283445 10547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:30:02.284674 10547 hybrid_clock.cc:648] HybridClock initialized: now 1714685402284607 us; error 40 us; skew 500 ppm
I20240502 21:30:02.285032 10547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:30:02.291271 10547 webserver.cc:460] Webserver started at http://127.6.51.254:34113/ using document root <none> and password file <none>
I20240502 21:30:02.292069 10547 fs_manager.cc:359] Metadata directory not provided
I20240502 21:30:02.292198 10547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:30:02.292511 10547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:30:02.295287 10547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/instance:
uuid: "c81e7db1901044ad8b721ab80370b2a6"
format_stamp: "Formatted at 2024-05-02 21:30:02 on dist-test-slave-ns1z"
I20240502 21:30:02.296080 10547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal/instance:
uuid: "c81e7db1901044ad8b721ab80370b2a6"
format_stamp: "Formatted at 2024-05-02 21:30:02 on dist-test-slave-ns1z"
I20240502 21:30:02.301587 10547 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20240502 21:30:02.305150 10561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:02.306501 10547 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240502 21:30:02.306694 10547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
uuid: "c81e7db1901044ad8b721ab80370b2a6"
format_stamp: "Formatted at 2024-05-02 21:30:02 on dist-test-slave-ns1z"
I20240502 21:30:02.306885 10547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:30:02.333623 10547 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:30:02.334537 10547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:30:02.334817 10547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:30:02.351750 10547 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.254:35019
I20240502 21:30:02.351781 10613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.254:35019 every 8 connection(s)
I20240502 21:30:02.353251 10547 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
I20240502 21:30:02.357220 10614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:02.363626 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 10547
I20240502 21:30:02.363834 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal/instance
I20240502 21:30:02.367105 10614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Bootstrap starting.
I20240502 21:30:02.370317 10614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:02.371399 10614 log.cc:824] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Log is configured to *not* fsync() on all Append() calls
I20240502 21:30:02.374219 10614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: No bootstrap required, opened a new log
I20240502 21:30:02.381460 10614 raft_consensus.cc:348] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } }
I20240502 21:30:02.381807 10614 raft_consensus.cc:374] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:02.381906 10614 raft_consensus.cc:729] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81e7db1901044ad8b721ab80370b2a6, State: Initialized, Role: FOLLOWER
I20240502 21:30:02.382508 10614 consensus_queue.cc:260] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } }
I20240502 21:30:02.382714 10614 raft_consensus.cc:388] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:02.382828 10614 raft_consensus.cc:482] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:02.382972 10614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:02.385269 10614 raft_consensus.cc:504] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } }
I20240502 21:30:02.385751 10614 leader_election.cc:302] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c81e7db1901044ad8b721ab80370b2a6; no voters:
I20240502 21:30:02.386324 10614 leader_election.cc:288] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:02.386466 10619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:02.387077 10619 raft_consensus.cc:686] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 1 LEADER]: Becoming Leader. State: Replica: c81e7db1901044ad8b721ab80370b2a6, State: Running, Role: LEADER
I20240502 21:30:02.387581 10619 consensus_queue.cc:237] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } }
I20240502 21:30:02.388244 10614 sys_catalog.cc:564] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 21:30:02.390630 10621 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c81e7db1901044ad8b721ab80370b2a6. Latest consensus state: current_term: 1 leader_uuid: "c81e7db1901044ad8b721ab80370b2a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } } }
I20240502 21:30:02.391049 10621 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: This master's current role is: LEADER
I20240502 21:30:02.390602 10620 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c81e7db1901044ad8b721ab80370b2a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } } }
I20240502 21:30:02.391673 10620 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: This master's current role is: LEADER
I20240502 21:30:02.393903 10626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 21:30:02.399686 10626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 21:30:02.409121 10626 catalog_manager.cc:1347] Generated new cluster ID: a82c657ebc674b33a51421eda81f43be
I20240502 21:30:02.409257 10626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 21:30:02.419893 10626 catalog_manager.cc:1370] Generated new certificate authority record
I20240502 21:30:02.421373 10626 catalog_manager.cc:1504] Loading token signing keys...
I20240502 21:30:02.428573 10626 catalog_manager.cc:5857] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Generated new TSK 0
I20240502 21:30:02.429484 10626 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 21:30:02.436053 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:0
--local_ip_for_outbound_sockets=127.6.51.193
--webserver_interface=127.6.51.193
--webserver_port=0
--tserver_master_addrs=127.6.51.254:35019
--builtin_ntp_servers=127.6.51.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240502 21:30:02.763072 10638 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:30:02.763386 10638 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:30:02.763537 10638 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:30:02.771080 10638 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:30:02.771291 10638 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:30:02.780689 10638 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=0
--tserver_master_addrs=127.6.51.254:35019
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:30:02.782096 10638 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:30:02.783869 10638 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:30:02.795805 10643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:02.796166 10646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:02.796595 10638 server_base.cc:1034] running on GCE node
W20240502 21:30:02.797096 10644 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:02.797750 10638 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:30:02.798658 10638 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:30:02.799885 10638 hybrid_clock.cc:648] HybridClock initialized: now 1714685402799814 us; error 45 us; skew 500 ppm
I20240502 21:30:02.800158 10638 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:30:02.802407 10638 webserver.cc:460] Webserver started at http://127.6.51.193:45441/ using document root <none> and password file <none>
I20240502 21:30:02.803099 10638 fs_manager.cc:359] Metadata directory not provided
I20240502 21:30:02.803205 10638 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:30:02.803478 10638 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:30:02.806208 10638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/instance:
uuid: "ec9f7fe764cb41c9ae157e0b23300dec"
format_stamp: "Formatted at 2024-05-02 21:30:02 on dist-test-slave-ns1z"
I20240502 21:30:02.806926 10638 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal/instance:
uuid: "ec9f7fe764cb41c9ae157e0b23300dec"
format_stamp: "Formatted at 2024-05-02 21:30:02 on dist-test-slave-ns1z"
I20240502 21:30:02.812126 10638 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20240502 21:30:02.815476 10652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:02.816776 10638 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20240502 21:30:02.816958 10638 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "ec9f7fe764cb41c9ae157e0b23300dec"
format_stamp: "Formatted at 2024-05-02 21:30:02 on dist-test-slave-ns1z"
I20240502 21:30:02.817137 10638 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:30:02.835418 10638 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:30:02.836287 10638 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:30:02.836575 10638 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:30:02.837589 10638 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:30:02.839138 10638 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:30:02.839215 10638 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:02.839334 10638 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:30:02.839391 10638 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:02.870011 10638 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:35971
I20240502 21:30:02.870059 10764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:35971 every 8 connection(s)
I20240502 21:30:02.871336 10638 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:30:02.880628 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 10638
I20240502 21:30:02.880800 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal/instance
I20240502 21:30:02.884389 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:0
--local_ip_for_outbound_sockets=127.6.51.194
--webserver_interface=127.6.51.194
--webserver_port=0
--tserver_master_addrs=127.6.51.254:35019
--builtin_ntp_servers=127.6.51.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
I20240502 21:30:02.884565 10765 heartbeater.cc:347] Connected to a master server at 127.6.51.254:35019
I20240502 21:30:02.884920 10765 heartbeater.cc:464] Registering TS with master...
I20240502 21:30:02.885764 10765 heartbeater.cc:511] Master 127.6.51.254:35019 requested a full tablet report, sending...
I20240502 21:30:02.887975 10579 ts_manager.cc:194] Registered new tserver with Master: ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:02.889997 10579 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:49433
W20240502 21:30:03.216051 10768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:30:03.216329 10768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:30:03.216442 10768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:30:03.223860 10768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:30:03.224043 10768 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:30:03.232769 10768 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=0
--tserver_master_addrs=127.6.51.254:35019
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:30:03.234061 10768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:30:03.235754 10768 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:30:03.246848 10774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:03.247375 10773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:03.247733 10776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:03.247964 10768 server_base.cc:1034] running on GCE node
I20240502 21:30:03.248484 10768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:30:03.249363 10768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:30:03.250617 10768 hybrid_clock.cc:648] HybridClock initialized: now 1714685403250551 us; error 35 us; skew 500 ppm
I20240502 21:30:03.250903 10768 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:30:03.253017 10768 webserver.cc:460] Webserver started at http://127.6.51.194:42937/ using document root <none> and password file <none>
I20240502 21:30:03.253708 10768 fs_manager.cc:359] Metadata directory not provided
I20240502 21:30:03.253823 10768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:30:03.254105 10768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20240502 21:30:03.256600 10768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/instance:
uuid: "bda87e13c35f421a92392a1b5362cc3a"
format_stamp: "Formatted at 2024-05-02 21:30:03 on dist-test-slave-ns1z"
I20240502 21:30:03.257376 10768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal/instance:
uuid: "bda87e13c35f421a92392a1b5362cc3a"
format_stamp: "Formatted at 2024-05-02 21:30:03 on dist-test-slave-ns1z"
I20240502 21:30:03.262192 10768 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20240502 21:30:03.265336 10782 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:03.266607 10768 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20240502 21:30:03.266753 10768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "bda87e13c35f421a92392a1b5362cc3a"
format_stamp: "Formatted at 2024-05-02 21:30:03 on dist-test-slave-ns1z"
I20240502 21:30:03.266921 10768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:30:03.280519 10768 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:30:03.281301 10768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:30:03.281559 10768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:30:03.282418 10768 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:30:03.283799 10768 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:30:03.283872 10768 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:03.283989 10768 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:30:03.284039 10768 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:03.312590 10768 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:40191
I20240502 21:30:03.312634 10894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:40191 every 8 connection(s)
I20240502 21:30:03.313863 10768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:30:03.316103 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 10768
I20240502 21:30:03.316303 6351 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal/instance
I20240502 21:30:03.326815 10895 heartbeater.cc:347] Connected to a master server at 127.6.51.254:35019
I20240502 21:30:03.327119 10895 heartbeater.cc:464] Registering TS with master...
I20240502 21:30:03.327935 10895 heartbeater.cc:511] Master 127.6.51.254:35019 requested a full tablet report, sending...
I20240502 21:30:03.329319 10579 ts_manager.cc:194] Registered new tserver with Master: bda87e13c35f421a92392a1b5362cc3a (127.6.51.194:40191)
I20240502 21:30:03.330163 10579 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:34561
I20240502 21:30:03.332163 6351 external_mini_cluster.cc:930] 2 TS(s) registered with all masters
I20240502 21:30:03.345136 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 10768
I20240502 21:30:03.352913 10890 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:30:03.433851 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 10768
I20240502 21:30:03.449178 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 10547
I20240502 21:30:03.450387 10609 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:30:03.548136 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 10547
I20240502 21:30:03.567373 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:35019
--webserver_interface=127.6.51.254
--webserver_port=34113
--builtin_ntp_servers=127.6.51.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.51.254:35019
--master_tombstone_evicted_tablet_replicas=false with env {}
I20240502 21:30:03.893481 10765 heartbeater.cc:503] Master 127.6.51.254:35019 was elected leader, sending a full tablet report...
W20240502 21:30:03.895334 10765 heartbeater.cc:644] Failed to heartbeat to 127.6.51.254:35019 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.6.51.254:35019: connect: Connection refused (error 111)
W20240502 21:30:03.907457 10907 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:30:03.907805 10907 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:30:03.907935 10907 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:30:03.916188 10907 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20240502 21:30:03.916391 10907 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:30:03.916464 10907 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20240502 21:30:03.916541 10907 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20240502 21:30:03.926640 10907 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
--master_tombstone_evicted_tablet_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.6.51.254:35019
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.51.254:35019
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.51.254
--webserver_port=34113
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:30:03.928174 10907 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:30:03.930130 10907 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:30:03.942888 10914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:03.942487 10913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:03.943768 10907 server_base.cc:1034] running on GCE node
W20240502 21:30:03.944034 10916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:03.945148 10907 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:30:03.947144 10907 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:30:03.948382 10907 hybrid_clock.cc:648] HybridClock initialized: now 1714685403948313 us; error 49 us; skew 500 ppm
I20240502 21:30:03.948693 10907 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:30:03.950893 10907 webserver.cc:460] Webserver started at http://127.6.51.254:34113/ using document root <none> and password file <none>
I20240502 21:30:03.951587 10907 fs_manager.cc:359] Metadata directory not provided
I20240502 21:30:03.951725 10907 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:30:03.957002 10907 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:03.959769 10922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:03.961083 10907 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:03.961241 10907 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
uuid: "c81e7db1901044ad8b721ab80370b2a6"
format_stamp: "Formatted at 2024-05-02 21:30:02 on dist-test-slave-ns1z"
I20240502 21:30:03.962035 10907 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:30:03.980805 10907 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:30:03.981649 10907 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:30:03.981889 10907 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:30:03.998524 10907 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.254:35019
I20240502 21:30:03.998543 10973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.254:35019 every 8 connection(s)
I20240502 21:30:04.000005 10907 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/master-0/data/info.pb
I20240502 21:30:04.006201 10974 sys_catalog.cc:263] Verifying existing consensus state
I20240502 21:30:04.007144 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 10907
I20240502 21:30:04.009792 10974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Bootstrap starting.
I20240502 21:30:04.025444 10974 log.cc:824] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Log is configured to *not* fsync() on all Append() calls
I20240502 21:30:04.033649 10974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:04.034291 10974 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Bootstrap complete.
I20240502 21:30:04.041206 10974 raft_consensus.cc:348] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } }
I20240502 21:30:04.041971 10974 raft_consensus.cc:729] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81e7db1901044ad8b721ab80370b2a6, State: Initialized, Role: FOLLOWER
I20240502 21:30:04.042642 10974 consensus_queue.cc:260] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } }
I20240502 21:30:04.042873 10974 raft_consensus.cc:388] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:04.042985 10974 raft_consensus.cc:482] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:04.043155 10974 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:04.047117 10974 raft_consensus.cc:504] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } }
I20240502 21:30:04.047621 10974 leader_election.cc:302] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c81e7db1901044ad8b721ab80370b2a6; no voters:
I20240502 21:30:04.048164 10974 leader_election.cc:288] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:04.048319 10979 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:04.048969 10979 raft_consensus.cc:686] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [term 2 LEADER]: Becoming Leader. State: Replica: c81e7db1901044ad8b721ab80370b2a6, State: Running, Role: LEADER
I20240502 21:30:04.049470 10979 consensus_queue.cc:237] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } }
I20240502 21:30:04.050119 10974 sys_catalog.cc:564] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: configured and running, proceeding with master startup.
I20240502 21:30:04.051833 10980 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c81e7db1901044ad8b721ab80370b2a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } } }
I20240502 21:30:04.052194 10980 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: This master's current role is: LEADER
I20240502 21:30:04.052987 10981 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c81e7db1901044ad8b721ab80370b2a6. Latest consensus state: current_term: 2 leader_uuid: "c81e7db1901044ad8b721ab80370b2a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81e7db1901044ad8b721ab80370b2a6" member_type: VOTER last_known_addr { host: "127.6.51.254" port: 35019 } } }
I20240502 21:30:04.053365 10981 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6 [sys.catalog]: This master's current role is: LEADER
I20240502 21:30:04.053843 10987 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20240502 21:30:04.059695 10987 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20240502 21:30:04.061040 10987 catalog_manager.cc:1259] Loaded cluster ID: a82c657ebc674b33a51421eda81f43be
I20240502 21:30:04.061126 10987 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20240502 21:30:04.063900 10987 catalog_manager.cc:1504] Loading token signing keys...
I20240502 21:30:04.064990 10987 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c81e7db1901044ad8b721ab80370b2a6: Loaded TSK: 0
I20240502 21:30:04.066287 10987 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20240502 21:30:04.901961 10765 heartbeater.cc:347] Connected to a master server at 127.6.51.254:35019
I20240502 21:30:04.902189 10765 heartbeater.cc:503] Master 127.6.51.254:35019 was elected leader, sending a full tablet report...
I20240502 21:30:04.904039 10939 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" instance_seqno: 1714685402862809) as {username='slave'} at 127.6.51.193:52399; Asking this server to re-register.
I20240502 21:30:04.904860 10765 heartbeater.cc:464] Registering TS with master...
I20240502 21:30:04.905150 10765 heartbeater.cc:511] Master 127.6.51.254:35019 requested a full tablet report, sending...
I20240502 21:30:04.906639 10939 ts_manager.cc:194] Registered new tserver with Master: ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:04.907707 6351 external_mini_cluster.cc:930] 1 TS(s) registered with all masters
I20240502 21:30:04.907909 6351 test_util.cc:268] Using random seed: 1316358512
I20240502 21:30:04.927450 10939 catalog_manager.cc:1904] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41078:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "<redacted>""\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20240502 21:30:04.965176 10700 tablet_service.cc:1467] Processing CreateTablet for tablet 1b4569b2bbff4312995a21a09462d57e (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION VALUES < 107374182
I20240502 21:30:04.965842 10694 tablet_service.cc:1467] Processing CreateTablet for tablet 54d3a4106d5a4e33b3bef170afcba188 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274
I20240502 21:30:04.965978 10683 tablet_service.cc:1467] Processing CreateTablet for tablet 537b30433ac64d6e8868f52955864da0 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276
I20240502 21:30:04.965530 10688 tablet_service.cc:1467] Processing CreateTablet for tablet 22d9d79ecdca4a3790db7c974094bd6a (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366
I20240502 21:30:04.964731 10690 tablet_service.cc:1467] Processing CreateTablet for tablet 9e5102e06f7b4ed8b67348afcd74d900 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002
I20240502 21:30:04.965751 10696 tablet_service.cc:1467] Processing CreateTablet for tablet 181e0390813a452094cd2cedb9a7e58f (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910
I20240502 21:30:04.966240 10699 tablet_service.cc:1467] Processing CreateTablet for tablet 0d5d5360de664753aea86c8b3645dd44 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364
I20240502 21:30:04.964744 10692 tablet_service.cc:1467] Processing CreateTablet for tablet 1655f2b9843240d1ba618646fa4684c1 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638
I20240502 21:30:04.965423 10695 tablet_service.cc:1467] Processing CreateTablet for tablet 958a961b73684b2f902069a9d9098bb0 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092
I20240502 21:30:04.964586 10689 tablet_service.cc:1467] Processing CreateTablet for tablet bb857096a0314b759ceb6664778e0739 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184
I20240502 21:30:04.965574 10693 tablet_service.cc:1467] Processing CreateTablet for tablet 0e7f30b2de5746d69d4cb6f2bc41bd14 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456
I20240502 21:30:04.966967 10700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b4569b2bbff4312995a21a09462d57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.967414 10690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e5102e06f7b4ed8b67348afcd74d900. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.965049 10686 tablet_service.cc:1467] Processing CreateTablet for tablet 6946f83add414078ae7dbddbfed16aa1 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730
I20240502 21:30:04.967689 10693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e7f30b2de5746d69d4cb6f2bc41bd14. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.967909 10699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d5d5360de664753aea86c8b3645dd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.967953 10687 tablet_service.cc:1467] Processing CreateTablet for tablet 3003e2a8df444a1d94d028fd62ed5f2b (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548
I20240502 21:30:04.967324 10697 tablet_service.cc:1467] Processing CreateTablet for tablet 13b3c062533b43bda769b313b2e68e55 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728
I20240502 21:30:04.968360 10687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3003e2a8df444a1d94d028fd62ed5f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.965711 10691 tablet_service.cc:1467] Processing CreateTablet for tablet 6e09bb2ca21a4d15ad9628cad8c039fc (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820
I20240502 21:30:04.968801 10697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13b3c062533b43bda769b313b2e68e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.969310 10688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22d9d79ecdca4a3790db7c974094bd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.969288 10684 tablet_service.cc:1467] Processing CreateTablet for tablet 787abf726bb74fa1a12694126b96dd2b (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094
I20240502 21:30:04.969758 10684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787abf726bb74fa1a12694126b96dd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.969967 10695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 958a961b73684b2f902069a9d9098bb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.970336 10682 tablet_service.cc:1467] Processing CreateTablet for tablet a389e0036e44455597fb46d5e6db4ad4 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458
I20240502 21:30:04.965137 10685 tablet_service.cc:1467] Processing CreateTablet for tablet aac586fb1c8b4f80bcc2f43150806d5c (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912
I20240502 21:30:04.970566 10692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1655f2b9843240d1ba618646fa4684c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.970307 10681 tablet_service.cc:1467] Processing CreateTablet for tablet 70988cb5413a4b0f976e759df1b54d48 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 2040109458 <= VALUES
I20240502 21:30:04.971038 10694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d3a4106d5a4e33b3bef170afcba188. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.971277 10698 tablet_service.cc:1467] Processing CreateTablet for tablet 31e93ab3687d4390b9a8177c2bbf97a7 (DEFAULT_TABLE table=test-workload [id=d07e5c17590642a6bee427225bc62d7b]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546
I20240502 21:30:04.971642 10686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6946f83add414078ae7dbddbfed16aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.971853 10681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70988cb5413a4b0f976e759df1b54d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.972429 10683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 537b30433ac64d6e8868f52955864da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.973845 10691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e09bb2ca21a4d15ad9628cad8c039fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.974381 10682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a389e0036e44455597fb46d5e6db4ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.979872 10685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aac586fb1c8b4f80bcc2f43150806d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.980907 10698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31e93ab3687d4390b9a8177c2bbf97a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.989219 10689 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bb857096a0314b759ceb6664778e0739. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:04.992560 10696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 181e0390813a452094cd2cedb9a7e58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:05.053575 11009 tablet_bootstrap.cc:492] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.057094 11009 tablet_bootstrap.cc:654] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.058130 11009 log.cc:824] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Log is configured to *not* fsync() on all Append() calls
I20240502 21:30:05.060494 11009 tablet_bootstrap.cc:492] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.060740 11009 ts_tablet_manager.cc:1367] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.002s
I20240502 21:30:05.066735 11009 raft_consensus.cc:348] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.067090 11009 raft_consensus.cc:374] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.067188 11009 raft_consensus.cc:729] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.067793 11009 consensus_queue.cc:260] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.067981 11009 raft_consensus.cc:388] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.068099 11009 raft_consensus.cc:482] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.068231 11009 raft_consensus.cc:3037] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.070122 11009 raft_consensus.cc:504] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.070580 11009 leader_election.cc:302] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.071142 11009 leader_election.cc:288] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.071290 11011 raft_consensus.cc:2781] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.071899 11011 raft_consensus.cc:686] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.072434 11011 consensus_queue.cc:237] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.072751 11009 ts_tablet_manager.cc:1398] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20240502 21:30:05.073101 11009 tablet_bootstrap.cc:492] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.074522 11009 tablet_bootstrap.cc:654] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.076490 11009 tablet_bootstrap.cc:492] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.076609 11009 ts_tablet_manager.cc:1367] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20240502 21:30:05.077379 11009 raft_consensus.cc:348] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.077528 11009 raft_consensus.cc:374] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.077606 11009 raft_consensus.cc:729] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.077839 11009 consensus_queue.cc:260] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.078027 11009 raft_consensus.cc:388] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.078114 11009 raft_consensus.cc:482] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.078219 11009 raft_consensus.cc:3037] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.078491 10939 catalog_manager.cc:5484] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.080154 11009 raft_consensus.cc:504] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.080364 11009 leader_election.cc:302] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.080531 11009 leader_election.cc:288] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.080601 11011 raft_consensus.cc:2781] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.080741 11011 raft_consensus.cc:686] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.081027 11009 ts_tablet_manager.cc:1398] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20240502 21:30:05.081054 11011 consensus_queue.cc:237] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.081317 11009 tablet_bootstrap.cc:492] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.083050 11009 tablet_bootstrap.cc:654] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.085052 11009 tablet_bootstrap.cc:492] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.085206 11009 ts_tablet_manager.cc:1367] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 21:30:05.086138 11009 raft_consensus.cc:348] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.086290 11009 raft_consensus.cc:374] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.086359 11009 raft_consensus.cc:729] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.086570 11009 consensus_queue.cc:260] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.086709 11009 raft_consensus.cc:388] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.086805 11009 raft_consensus.cc:482] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.086900 11009 raft_consensus.cc:3037] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.087064 10939 catalog_manager.cc:5484] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.088668 11009 raft_consensus.cc:504] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.088891 11009 leader_election.cc:302] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.089069 11009 leader_election.cc:288] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.089118 11011 raft_consensus.cc:2781] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.089493 11009 ts_tablet_manager.cc:1398] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20240502 21:30:05.089460 11011 raft_consensus.cc:686] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.089802 11009 tablet_bootstrap.cc:492] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.089781 11011 consensus_queue.cc:237] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.091430 11009 tablet_bootstrap.cc:654] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.091841 10939 catalog_manager.cc:5484] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.093153 11009 tablet_bootstrap.cc:492] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.093293 11009 ts_tablet_manager.cc:1367] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20240502 21:30:05.093930 11009 raft_consensus.cc:348] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.094059 11009 raft_consensus.cc:374] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.094153 11009 raft_consensus.cc:729] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.094379 11009 consensus_queue.cc:260] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.094558 11009 raft_consensus.cc:388] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.094641 11009 raft_consensus.cc:482] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.094758 11009 raft_consensus.cc:3037] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.096450 11009 raft_consensus.cc:504] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.096652 11009 leader_election.cc:302] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.096846 11009 leader_election.cc:288] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.096908 11011 raft_consensus.cc:2781] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.097119 11011 raft_consensus.cc:686] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.097297 11009 ts_tablet_manager.cc:1398] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:05.097343 11011 consensus_queue.cc:237] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.097543 11009 tablet_bootstrap.cc:492] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.099121 11009 tablet_bootstrap.cc:654] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.099408 10939 catalog_manager.cc:5484] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.100739 11009 tablet_bootstrap.cc:492] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.100899 11009 ts_tablet_manager.cc:1367] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:05.101518 11009 raft_consensus.cc:348] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.101702 11009 raft_consensus.cc:374] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.101786 11009 raft_consensus.cc:729] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.102056 11009 consensus_queue.cc:260] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.102231 11009 raft_consensus.cc:388] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.102339 11009 raft_consensus.cc:482] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.102432 11009 raft_consensus.cc:3037] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.104665 11009 raft_consensus.cc:504] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.104880 11009 leader_election.cc:302] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.105051 11009 leader_election.cc:288] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.105118 11011 raft_consensus.cc:2781] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.105268 11011 raft_consensus.cc:686] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.105453 11009 ts_tablet_manager.cc:1398] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:05.105518 11011 consensus_queue.cc:237] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.105712 11009 tablet_bootstrap.cc:492] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.107195 11009 tablet_bootstrap.cc:654] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.107472 10939 catalog_manager.cc:5484] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.108902 11009 tablet_bootstrap.cc:492] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.109015 11009 ts_tablet_manager.cc:1367] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:05.109638 11009 raft_consensus.cc:348] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.109797 11009 raft_consensus.cc:374] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.109894 11009 raft_consensus.cc:729] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.110113 11009 consensus_queue.cc:260] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.110265 11009 raft_consensus.cc:388] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.110343 11009 raft_consensus.cc:482] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.110450 11009 raft_consensus.cc:3037] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.112557 11009 raft_consensus.cc:504] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.112771 11009 leader_election.cc:302] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.112962 11009 leader_election.cc:288] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.113021 11011 raft_consensus.cc:2781] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.113195 11011 raft_consensus.cc:686] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.113384 11009 ts_tablet_manager.cc:1398] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:05.113432 11011 consensus_queue.cc:237] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.113628 11009 tablet_bootstrap.cc:492] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.114887 11009 tablet_bootstrap.cc:654] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.115365 10939 catalog_manager.cc:5484] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.116681 11009 tablet_bootstrap.cc:492] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.116863 11009 ts_tablet_manager.cc:1367] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 21:30:05.117550 11009 raft_consensus.cc:348] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.117697 11009 raft_consensus.cc:374] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.117765 11009 raft_consensus.cc:729] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.118139 11009 consensus_queue.cc:260] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.118319 11009 raft_consensus.cc:388] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.118425 11009 raft_consensus.cc:482] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.118521 11009 raft_consensus.cc:3037] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.120417 11009 raft_consensus.cc:504] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.120599 11009 leader_election.cc:302] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.120743 11009 leader_election.cc:288] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.120837 11011 raft_consensus.cc:2781] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.121057 11011 raft_consensus.cc:686] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.121181 11009 ts_tablet_manager.cc:1398] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20240502 21:30:05.121302 11011 consensus_queue.cc:237] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.121402 11009 tablet_bootstrap.cc:492] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.122910 11009 tablet_bootstrap.cc:654] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.123570 10939 catalog_manager.cc:5484] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.124676 11009 tablet_bootstrap.cc:492] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.124801 11009 ts_tablet_manager.cc:1367] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240502 21:30:05.125576 11009 raft_consensus.cc:348] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.125735 11009 raft_consensus.cc:374] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.125830 11009 raft_consensus.cc:729] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.126034 11009 consensus_queue.cc:260] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.126259 11009 raft_consensus.cc:388] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.126343 11009 raft_consensus.cc:482] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.126461 11009 raft_consensus.cc:3037] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.128625 11009 raft_consensus.cc:504] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.128849 11009 leader_election.cc:302] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.129014 11009 leader_election.cc:288] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.129101 11011 raft_consensus.cc:2781] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.129272 11011 raft_consensus.cc:686] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.129411 11009 ts_tablet_manager.cc:1398] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 21:30:05.129499 11011 consensus_queue.cc:237] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.129657 11009 tablet_bootstrap.cc:492] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.131088 11009 tablet_bootstrap.cc:654] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.131556 10939 catalog_manager.cc:5484] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.132615 11009 tablet_bootstrap.cc:492] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.132750 11009 ts_tablet_manager.cc:1367] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20240502 21:30:05.133409 11009 raft_consensus.cc:348] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.133589 11009 raft_consensus.cc:374] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.133672 11009 raft_consensus.cc:729] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.133913 11009 consensus_queue.cc:260] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.134047 11009 raft_consensus.cc:388] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.134137 11009 raft_consensus.cc:482] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.134233 11009 raft_consensus.cc:3037] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.136248 11009 raft_consensus.cc:504] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.136436 11009 leader_election.cc:302] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.136623 11009 leader_election.cc:288] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.136672 11011 raft_consensus.cc:2781] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.136971 11011 raft_consensus.cc:686] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.137094 11009 ts_tablet_manager.cc:1398] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:05.137215 11011 consensus_queue.cc:237] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.137374 11009 tablet_bootstrap.cc:492] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.139019 11009 tablet_bootstrap.cc:654] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.139454 10939 catalog_manager.cc:5484] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.140650 11009 tablet_bootstrap.cc:492] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.140794 11009 ts_tablet_manager.cc:1367] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:05.141427 11009 raft_consensus.cc:348] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.141593 11009 raft_consensus.cc:374] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.141687 11009 raft_consensus.cc:729] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.141902 11009 consensus_queue.cc:260] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.142047 11009 raft_consensus.cc:388] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.142124 11009 raft_consensus.cc:482] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.142236 11009 raft_consensus.cc:3037] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.144384 11009 raft_consensus.cc:504] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.144587 11009 leader_election.cc:302] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.144726 11009 leader_election.cc:288] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.144842 11011 raft_consensus.cc:2781] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.145150 11009 ts_tablet_manager.cc:1398] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.002s sys 0.002s
I20240502 21:30:05.145210 11011 raft_consensus.cc:686] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.145395 11009 tablet_bootstrap.cc:492] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.145428 11011 consensus_queue.cc:237] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.146965 11009 tablet_bootstrap.cc:654] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.147905 10939 catalog_manager.cc:5484] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.148602 11009 tablet_bootstrap.cc:492] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.148746 11009 ts_tablet_manager.cc:1367] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240502 21:30:05.149384 11009 raft_consensus.cc:348] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.149555 11009 raft_consensus.cc:374] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.149634 11009 raft_consensus.cc:729] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.149852 11009 consensus_queue.cc:260] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.150007 11009 raft_consensus.cc:388] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.150110 11009 raft_consensus.cc:482] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.150192 11009 raft_consensus.cc:3037] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.152462 11009 raft_consensus.cc:504] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.152709 11009 leader_election.cc:302] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.152935 11009 leader_election.cc:288] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.153003 11011 raft_consensus.cc:2781] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.153172 11011 raft_consensus.cc:686] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.153352 11009 ts_tablet_manager.cc:1398] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20240502 21:30:05.153452 11011 consensus_queue.cc:237] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.153631 11009 tablet_bootstrap.cc:492] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.155141 11009 tablet_bootstrap.cc:654] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.155834 10939 catalog_manager.cc:5484] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.156744 11009 tablet_bootstrap.cc:492] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.156889 11009 ts_tablet_manager.cc:1367] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:05.157480 11009 raft_consensus.cc:348] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.157657 11009 raft_consensus.cc:374] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.157754 11009 raft_consensus.cc:729] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.157939 11009 consensus_queue.cc:260] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.158108 11009 raft_consensus.cc:388] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.158193 11009 raft_consensus.cc:482] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.158290 11009 raft_consensus.cc:3037] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.160485 11009 raft_consensus.cc:504] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.160727 11009 leader_election.cc:302] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.160915 11009 leader_election.cc:288] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.160998 11011 raft_consensus.cc:2781] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.161237 11011 raft_consensus.cc:686] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.161379 11009 ts_tablet_manager.cc:1398] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:05.161448 11011 consensus_queue.cc:237] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.161614 11009 tablet_bootstrap.cc:492] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.163187 11009 tablet_bootstrap.cc:654] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.163709 10939 catalog_manager.cc:5484] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.164904 11009 tablet_bootstrap.cc:492] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.165037 11009 ts_tablet_manager.cc:1367] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:05.165752 11009 raft_consensus.cc:348] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.165915 11009 raft_consensus.cc:374] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.165993 11009 raft_consensus.cc:729] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.166225 11009 consensus_queue.cc:260] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.166354 11009 raft_consensus.cc:388] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.166424 11009 raft_consensus.cc:482] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.166512 11009 raft_consensus.cc:3037] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.168735 11009 raft_consensus.cc:504] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.169006 11009 leader_election.cc:302] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.169196 11009 leader_election.cc:288] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.169253 11011 raft_consensus.cc:2781] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.169411 11011 raft_consensus.cc:686] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.169646 11009 ts_tablet_manager.cc:1398] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20240502 21:30:05.169679 11011 consensus_queue.cc:237] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.169909 11009 tablet_bootstrap.cc:492] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.171465 11009 tablet_bootstrap.cc:654] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.171864 10939 catalog_manager.cc:5484] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.173606 11009 tablet_bootstrap.cc:492] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.173755 11009 ts_tablet_manager.cc:1367] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 21:30:05.174392 11009 raft_consensus.cc:348] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.174537 11009 raft_consensus.cc:374] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.174638 11009 raft_consensus.cc:729] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.174849 11009 consensus_queue.cc:260] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.175012 11009 raft_consensus.cc:388] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.175091 11009 raft_consensus.cc:482] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.175204 11009 raft_consensus.cc:3037] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.177246 11009 raft_consensus.cc:504] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.177446 11009 leader_election.cc:302] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.177605 11009 leader_election.cc:288] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.177671 11011 raft_consensus.cc:2781] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.177942 11011 raft_consensus.cc:686] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.178086 11009 ts_tablet_manager.cc:1398] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:05.178180 11011 consensus_queue.cc:237] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.178339 11009 tablet_bootstrap.cc:492] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.179848 11009 tablet_bootstrap.cc:654] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.180480 10939 catalog_manager.cc:5484] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.181597 11009 tablet_bootstrap.cc:492] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.181756 11009 ts_tablet_manager.cc:1367] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240502 21:30:05.182312 11009 raft_consensus.cc:348] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.182492 11009 raft_consensus.cc:374] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.182574 11009 raft_consensus.cc:729] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.182801 11009 consensus_queue.cc:260] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.182973 11009 raft_consensus.cc:388] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.183051 11009 raft_consensus.cc:482] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.183115 11009 raft_consensus.cc:3037] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.185055 11009 raft_consensus.cc:504] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.185243 11009 leader_election.cc:302] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.185459 11009 leader_election.cc:288] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.185523 11011 raft_consensus.cc:2781] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.185722 11011 raft_consensus.cc:686] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.185902 11009 ts_tablet_manager.cc:1398] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:05.185967 11011 consensus_queue.cc:237] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.186163 11009 tablet_bootstrap.cc:492] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.187692 11009 tablet_bootstrap.cc:654] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.188102 10939 catalog_manager.cc:5484] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.189208 11009 tablet_bootstrap.cc:492] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.189306 11009 ts_tablet_manager.cc:1367] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20240502 21:30:05.189884 11009 raft_consensus.cc:348] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.189996 11009 raft_consensus.cc:374] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.190057 11009 raft_consensus.cc:729] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.190243 11009 consensus_queue.cc:260] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.190423 11009 raft_consensus.cc:388] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.190511 11009 raft_consensus.cc:482] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.190620 11009 raft_consensus.cc:3037] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.192639 11009 raft_consensus.cc:504] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.192860 11009 leader_election.cc:302] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.193023 11009 leader_election.cc:288] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.193116 11011 raft_consensus.cc:2781] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.193292 11011 raft_consensus.cc:686] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.193444 11009 ts_tablet_manager.cc:1398] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s
I20240502 21:30:05.193548 11011 consensus_queue.cc:237] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.193703 11009 tablet_bootstrap.cc:492] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.195611 10938 catalog_manager.cc:5484] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.209079 11009 tablet_bootstrap.cc:654] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.210983 11009 tablet_bootstrap.cc:492] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.211127 11009 ts_tablet_manager.cc:1367] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.001s
I20240502 21:30:05.211745 11009 raft_consensus.cc:348] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.211923 11009 raft_consensus.cc:374] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.211975 11009 raft_consensus.cc:729] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.212205 11009 consensus_queue.cc:260] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.212349 11009 raft_consensus.cc:388] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.212419 11009 raft_consensus.cc:482] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.212489 11009 raft_consensus.cc:3037] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.214321 11009 raft_consensus.cc:504] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.214545 11009 leader_election.cc:302] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.214701 11009 leader_election.cc:288] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.214824 11011 raft_consensus.cc:2781] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.214996 11011 raft_consensus.cc:686] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.215171 11009 ts_tablet_manager.cc:1398] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20240502 21:30:05.215274 11011 consensus_queue.cc:237] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.215437 11009 tablet_bootstrap.cc:492] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.217109 11009 tablet_bootstrap.cc:654] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.218235 10938 catalog_manager.cc:5484] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.218842 11009 tablet_bootstrap.cc:492] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.218988 11009 ts_tablet_manager.cc:1367] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 21:30:05.219602 11009 raft_consensus.cc:348] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.219727 11009 raft_consensus.cc:374] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.219801 11009 raft_consensus.cc:729] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.220000 11009 consensus_queue.cc:260] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.220141 11009 raft_consensus.cc:388] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.220213 11009 raft_consensus.cc:482] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.220316 11009 raft_consensus.cc:3037] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.222683 11009 raft_consensus.cc:504] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.222935 11009 leader_election.cc:302] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.223140 11009 leader_election.cc:288] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.223222 11011 raft_consensus.cc:2781] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.223439 11011 raft_consensus.cc:686] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.223615 11009 ts_tablet_manager.cc:1398] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20240502 21:30:05.223670 11011 consensus_queue.cc:237] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.223910 11009 tablet_bootstrap.cc:492] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.225545 11009 tablet_bootstrap.cc:654] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.226814 10938 catalog_manager.cc:5484] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.227340 11009 tablet_bootstrap.cc:492] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.227494 11009 ts_tablet_manager.cc:1367] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20240502 21:30:05.228086 11009 raft_consensus.cc:348] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.228231 11009 raft_consensus.cc:374] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.228299 11009 raft_consensus.cc:729] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.228514 11009 consensus_queue.cc:260] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.228678 11009 raft_consensus.cc:388] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.228790 11009 raft_consensus.cc:482] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.228910 11009 raft_consensus.cc:3037] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.230841 11009 raft_consensus.cc:504] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.231032 11009 leader_election.cc:302] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.231177 11009 leader_election.cc:288] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.231246 11011 raft_consensus.cc:2781] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.231416 11011 raft_consensus.cc:686] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.231571 11009 ts_tablet_manager.cc:1398] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20240502 21:30:05.231683 11011 consensus_queue.cc:237] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.231806 11009 tablet_bootstrap.cc:492] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:05.233371 11009 tablet_bootstrap.cc:654] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Neither blocks nor log segments found. Creating new log.
I20240502 21:30:05.234139 10938 catalog_manager.cc:5484] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:05.235045 11009 tablet_bootstrap.cc:492] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: No bootstrap required, opened a new log
I20240502 21:30:05.235163 11009 ts_tablet_manager.cc:1367] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20240502 21:30:05.235812 11009 raft_consensus.cc:348] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.235965 11009 raft_consensus.cc:374] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20240502 21:30:05.236058 11009 raft_consensus.cc:729] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:05.236263 11009 consensus_queue.cc:260] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.236445 11009 raft_consensus.cc:388] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:05.236529 11009 raft_consensus.cc:482] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:05.236631 11009 raft_consensus.cc:3037] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 0 FOLLOWER]: Advancing to term 1
I20240502 21:30:05.238895 11009 raft_consensus.cc:504] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.239104 11009 leader_election.cc:302] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:05.239264 11009 leader_election.cc:288] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 1 election: Requested vote from peers
I20240502 21:30:05.239326 11011 raft_consensus.cc:2781] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Leader election won for term 1
I20240502 21:30:05.239464 11011 raft_consensus.cc:686] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 1 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:05.239694 11011 consensus_queue.cc:237] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:05.239804 11009 ts_tablet_manager.cc:1398] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20240502 21:30:05.241807 10938 catalog_manager.cc:5484] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 0 to 1, leader changed from <none> to ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193). New cstate: current_term: 1 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
W20240502 21:30:05.442171 11031 log.cc:924] Time spent T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Append to log took a long time: real 0.060s user 0.000s sys 0.000s
I20240502 21:30:08.813591 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.194:40191
--local_ip_for_outbound_sockets=127.6.51.194
--tserver_master_addrs=127.6.51.254:35019
--webserver_port=42937
--webserver_interface=127.6.51.194
--builtin_ntp_servers=127.6.51.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20 with env {}
W20240502 21:30:09.150496 11114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:30:09.150833 11114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:30:09.150959 11114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:30:09.158617 11114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:30:09.158803 11114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.194
I20240502 21:30:09.168067 11114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.194:40191
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.51.194
--webserver_port=42937
--tserver_master_addrs=127.6.51.254:35019
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.194
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:30:09.169422 11114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:30:09.171237 11114 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:30:09.183108 11119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:09.183598 11122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:09.183956 11120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:09.184249 11114 server_base.cc:1034] running on GCE node
I20240502 21:30:09.184921 11114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:30:09.185925 11114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:30:09.187170 11114 hybrid_clock.cc:648] HybridClock initialized: now 1714685409187096 us; error 34 us; skew 500 ppm
I20240502 21:30:09.187518 11114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:30:09.189850 11114 webserver.cc:460] Webserver started at http://127.6.51.194:42937/ using document root <none> and password file <none>
I20240502 21:30:09.190567 11114 fs_manager.cc:359] Metadata directory not provided
I20240502 21:30:09.190729 11114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:30:09.196128 11114 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.005s
I20240502 21:30:09.199023 11128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:09.200354 11114 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20240502 21:30:09.200506 11114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
uuid: "bda87e13c35f421a92392a1b5362cc3a"
format_stamp: "Formatted at 2024-05-02 21:30:03 on dist-test-slave-ns1z"
I20240502 21:30:09.201397 11114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:30:09.221417 11114 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:30:09.222259 11114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:30:09.222515 11114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:30:09.223436 11114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:30:09.225076 11114 ts_tablet_manager.cc:559] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20240502 21:30:09.225173 11114 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:09.225276 11114 ts_tablet_manager.cc:590] Registered 0 tablets
I20240502 21:30:09.225342 11114 ts_tablet_manager.cc:569] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:09.255765 11114 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.194:40191
I20240502 21:30:09.255834 11240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.194:40191 every 8 connection(s)
I20240502 21:30:09.257262 11114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-1/data/info.pb
I20240502 21:30:09.266213 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 11114
I20240502 21:30:09.267791 6351 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu pid 10638
I20240502 21:30:09.269791 10760 generic_service.cc:196] Checking for leaks (request via RPC)
I20240502 21:30:09.270618 11241 heartbeater.cc:347] Connected to a master server at 127.6.51.254:35019
I20240502 21:30:09.270903 11241 heartbeater.cc:464] Registering TS with master...
I20240502 21:30:09.271679 11241 heartbeater.cc:511] Master 127.6.51.254:35019 requested a full tablet report, sending...
I20240502 21:30:09.273152 10931 ts_manager.cc:194] Registered new tserver with Master: bda87e13c35f421a92392a1b5362cc3a (127.6.51.194:40191)
I20240502 21:30:09.274653 10931 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.194:60423
I20240502 21:30:09.484091 6351 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu with pid 10638
I20240502 21:30:09.516016 6351 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
/tmp/dist-test-taskVhWBHI/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.51.193:35971
--local_ip_for_outbound_sockets=127.6.51.193
--tserver_master_addrs=127.6.51.254:35019
--webserver_port=45441
--webserver_interface=127.6.51.193
--builtin_ntp_servers=127.6.51.212:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--num_tablets_to_copy_simultaneously=20
--rpc_service_queue_length=1
--rpc_num_service_threads=1 with env {}
W20240502 21:30:09.852137 11246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20240502 21:30:09.852558 11246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20240502 21:30:09.852738 11246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20240502 21:30:09.865164 11246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20240502 21:30:09.865470 11246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.51.193
I20240502 21:30:09.880383 11246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.51.212:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.51.193:35971
--rpc_num_service_threads=1
--rpc_server_allow_ephemeral_ports=true
--rpc_service_queue_length=1
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.51.193
--webserver_port=45441
--tserver_master_addrs=127.6.51.254:35019
--num_tablets_to_copy_simultaneously=20
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.51.193
--log_dir=/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision fdb42489d76098eeca371ac57ae02ea176438c64
build type FASTDEBUG
built by None at 02 May 2024 20:51:32 UTC on 1a15035a6830
build id 95
ASAN enabled
I20240502 21:30:09.882429 11246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20240502 21:30:09.884997 11246 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20240502 21:30:09.901409 11251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:09.902077 11252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20240502 21:30:09.902324 11254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20240502 21:30:09.902904 11246 server_base.cc:1034] running on GCE node
I20240502 21:30:09.903558 11246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20240502 21:30:09.904592 11246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20240502 21:30:09.905843 11246 hybrid_clock.cc:648] HybridClock initialized: now 1714685409905778 us; error 79 us; skew 500 ppm
I20240502 21:30:09.906190 11246 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20240502 21:30:09.908725 11246 webserver.cc:460] Webserver started at http://127.6.51.193:45441/ using document root <none> and password file <none>
I20240502 21:30:09.909507 11246 fs_manager.cc:359] Metadata directory not provided
I20240502 21:30:09.909647 11246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20240502 21:30:09.915031 11246 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20240502 21:30:09.919641 11260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20240502 21:30:09.921088 11246 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20240502 21:30:09.921252 11246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data,/tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
uuid: "ec9f7fe764cb41c9ae157e0b23300dec"
format_stamp: "Formatted at 2024-05-02 21:30:02 on dist-test-slave-ns1z"
I20240502 21:30:09.922120 11246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20240502 21:30:09.944710 11246 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20240502 21:30:09.945688 11246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20240502 21:30:09.945958 11246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20240502 21:30:09.947095 11246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20240502 21:30:09.949627 11267 ts_tablet_manager.cc:522] Loading tablet metadata (0/20 complete)
I20240502 21:30:10.012480 11246 ts_tablet_manager.cc:559] Loaded tablet metadata (20 total tablets, 20 live tablets)
I20240502 21:30:10.012634 11246 ts_tablet_manager.cc:505] Time spent load tablet metadata: real 0.064s user 0.002s sys 0.000s
I20240502 21:30:10.012774 11246 ts_tablet_manager.cc:574] Registering tablets (0/20 complete)
I20240502 21:30:10.016513 11267 tablet_bootstrap.cc:492] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:10.046300 11246 ts_tablet_manager.cc:590] Registered 20 tablets
I20240502 21:30:10.046411 11246 ts_tablet_manager.cc:569] Time spent register tablets: real 0.034s user 0.030s sys 0.003s
I20240502 21:30:10.056308 11246 rpc_server.cc:307] RPC server started. Bound to: 127.6.51.193:35971
I20240502 21:30:10.056341 11278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.51.193:35971 every 8 connection(s)
I20240502 21:30:10.057906 11246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskVhWBHI/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1714685376968067-6351-0/minicluster-data/ts-0/data/info.pb
I20240502 21:30:10.067652 6351 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskVhWBHI/build/asan/bin/kudu as pid 11246
I20240502 21:30:10.094018 11267 log.cc:824] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Log is configured to *not* fsync() on all Append() calls
I20240502 21:30:10.096107 11279 heartbeater.cc:347] Connected to a master server at 127.6.51.254:35019
I20240502 21:30:10.096472 11279 heartbeater.cc:464] Registering TS with master...
I20240502 21:30:10.097699 11279 heartbeater.cc:511] Master 127.6.51.254:35019 requested a full tablet report, sending...
I20240502 21:30:10.101627 10931 ts_manager.cc:194] Re-registered known tserver with Master: ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:10.107507 10931 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.6.51.193:37909
I20240502 21:30:10.259743 11267 tablet_bootstrap.cc:492] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=509 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:10.260329 11267 tablet_bootstrap.cc:492] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:10.261569 11267 ts_tablet_manager.cc:1367] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.246s user 0.181s sys 0.048s
I20240502 21:30:10.266252 11267 raft_consensus.cc:348] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.267010 11267 raft_consensus.cc:729] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:10.267699 11267 consensus_queue.cc:260] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.267901 11267 raft_consensus.cc:388] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:10.267988 11267 raft_consensus.cc:482] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:10.268131 11267 raft_consensus.cc:3037] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:10.271572 11267 raft_consensus.cc:504] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.272027 11267 leader_election.cc:302] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:10.272593 11267 leader_election.cc:288] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:10.272727 11286 raft_consensus.cc:2781] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:10.273758 11279 heartbeater.cc:503] Master 127.6.51.254:35019 was elected leader, sending a full tablet report...
I20240502 21:30:10.274307 11267 ts_tablet_manager.cc:1398] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.013s user 0.008s sys 0.005s
I20240502 21:30:10.274457 11286 raft_consensus.cc:686] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:10.274726 11267 tablet_bootstrap.cc:492] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:10.274960 11286 consensus_queue.cc:237] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.277572 11241 heartbeater.cc:503] Master 127.6.51.254:35019 was elected leader, sending a full tablet report...
I20240502 21:30:10.281558 10931 catalog_manager.cc:5484] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:10.459461 11267 tablet_bootstrap.cc:492] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=522 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:10.459918 11267 tablet_bootstrap.cc:492] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:10.460736 11267 ts_tablet_manager.cc:1367] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.186s user 0.167s sys 0.015s
I20240502 21:30:10.461586 11267 raft_consensus.cc:348] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.461750 11267 raft_consensus.cc:729] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:10.461994 11267 consensus_queue.cc:260] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.462152 11267 raft_consensus.cc:388] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:10.462245 11267 raft_consensus.cc:482] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:10.462333 11267 raft_consensus.cc:3037] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:10.464323 11267 raft_consensus.cc:504] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.464532 11267 leader_election.cc:302] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:10.464733 11267 leader_election.cc:288] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:10.464835 11286 raft_consensus.cc:2781] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:10.465045 11286 raft_consensus.cc:686] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:10.465173 11267 ts_tablet_manager.cc:1398] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:10.465274 11286 consensus_queue.cc:237] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.465423 11267 tablet_bootstrap.cc:492] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:10.467916 10931 catalog_manager.cc:5484] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:10.642887 11267 tablet_bootstrap.cc:492] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=184 overwritten=0 applied=184 ignored=0} inserts{seen=497 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:10.643360 11267 tablet_bootstrap.cc:492] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:10.644205 11267 ts_tablet_manager.cc:1367] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.179s user 0.147s sys 0.028s
I20240502 21:30:10.644865 11267 raft_consensus.cc:348] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.645040 11267 raft_consensus.cc:729] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:10.645296 11267 consensus_queue.cc:260] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.645483 11267 raft_consensus.cc:388] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:10.645573 11267 raft_consensus.cc:482] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:10.645696 11267 raft_consensus.cc:3037] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:10.647735 11267 raft_consensus.cc:504] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.648006 11267 leader_election.cc:302] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:10.648200 11267 leader_election.cc:288] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:10.648298 11286 raft_consensus.cc:2781] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:10.648547 11286 raft_consensus.cc:686] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:10.648835 11267 ts_tablet_manager.cc:1398] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.007s sys 0.001s
I20240502 21:30:10.648859 11286 consensus_queue.cc:237] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 184, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.649103 11267 tablet_bootstrap.cc:492] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:10.651304 10931 catalog_manager.cc:5484] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:10.831390 11267 tablet_bootstrap.cc:492] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=521 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:10.831809 11267 tablet_bootstrap.cc:492] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:10.832634 11267 ts_tablet_manager.cc:1367] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.184s user 0.168s sys 0.011s
I20240502 21:30:10.833261 11267 raft_consensus.cc:348] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.833411 11267 raft_consensus.cc:729] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:10.833614 11267 consensus_queue.cc:260] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.833760 11267 raft_consensus.cc:388] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:10.833823 11267 raft_consensus.cc:482] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:10.833894 11267 raft_consensus.cc:3037] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:10.835628 11267 raft_consensus.cc:504] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.835822 11267 leader_election.cc:302] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:10.835992 11267 leader_election.cc:288] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:10.836061 11286 raft_consensus.cc:2781] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:10.836213 11286 raft_consensus.cc:686] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:10.836516 11267 ts_tablet_manager.cc:1398] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.007s sys 0.000s
I20240502 21:30:10.836442 11286 consensus_queue.cc:237] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:10.836795 11267 tablet_bootstrap.cc:492] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:10.839030 10931 catalog_manager.cc:5484] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:11.018275 11267 tablet_bootstrap.cc:492] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=187 overwritten=0 applied=187 ignored=0} inserts{seen=530 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:11.018745 11267 tablet_bootstrap.cc:492] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:11.019579 11267 ts_tablet_manager.cc:1367] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.183s user 0.152s sys 0.027s
I20240502 21:30:11.020207 11267 raft_consensus.cc:348] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.020390 11267 raft_consensus.cc:729] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:11.020641 11267 consensus_queue.cc:260] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.020848 11267 raft_consensus.cc:388] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:11.020931 11267 raft_consensus.cc:482] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:11.021039 11267 raft_consensus.cc:3037] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:11.022814 11267 raft_consensus.cc:504] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.023053 11267 leader_election.cc:302] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:11.023227 11267 leader_election.cc:288] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:11.023330 11286 raft_consensus.cc:2781] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:11.023550 11286 raft_consensus.cc:686] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:11.023676 11267 ts_tablet_manager.cc:1398] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 21:30:11.023801 11286 consensus_queue.cc:237] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 187, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.023922 11267 tablet_bootstrap.cc:492] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:11.026484 10931 catalog_manager.cc:5484] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:11.209949 11267 tablet_bootstrap.cc:492] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=522 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:11.210399 11267 tablet_bootstrap.cc:492] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:11.211196 11267 ts_tablet_manager.cc:1367] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.187s user 0.173s sys 0.012s
I20240502 21:30:11.211833 11267 raft_consensus.cc:348] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.211987 11267 raft_consensus.cc:729] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:11.212175 11267 consensus_queue.cc:260] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.212306 11267 raft_consensus.cc:388] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:11.212371 11267 raft_consensus.cc:482] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:11.212437 11267 raft_consensus.cc:3037] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:11.214254 11267 raft_consensus.cc:504] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.214449 11267 leader_election.cc:302] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:11.214627 11267 leader_election.cc:288] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:11.214710 11286 raft_consensus.cc:2781] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:11.214913 11286 raft_consensus.cc:686] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:11.215094 11267 ts_tablet_manager.cc:1398] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:11.215188 11286 consensus_queue.cc:237] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.215360 11267 tablet_bootstrap.cc:492] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:11.217733 10931 catalog_manager.cc:5484] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:11.408699 11267 tablet_bootstrap.cc:492] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=542 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:11.409147 11267 tablet_bootstrap.cc:492] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:11.409991 11267 ts_tablet_manager.cc:1367] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.195s user 0.170s sys 0.024s
I20240502 21:30:11.410646 11267 raft_consensus.cc:348] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.410835 11267 raft_consensus.cc:729] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:11.411054 11267 consensus_queue.cc:260] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.411219 11267 raft_consensus.cc:388] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:11.411291 11267 raft_consensus.cc:482] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:11.411396 11267 raft_consensus.cc:3037] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:11.413257 11267 raft_consensus.cc:504] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.413486 11267 leader_election.cc:302] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:11.413676 11267 leader_election.cc:288] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:11.413766 11286 raft_consensus.cc:2781] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:11.413944 11286 raft_consensus.cc:686] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:11.414206 11267 ts_tablet_manager.cc:1398] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:11.414234 11286 consensus_queue.cc:237] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.414467 11267 tablet_bootstrap.cc:492] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:11.416798 10931 catalog_manager.cc:5484] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:11.602473 11267 tablet_bootstrap.cc:492] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=513 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:11.602994 11267 tablet_bootstrap.cc:492] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:11.603850 11267 ts_tablet_manager.cc:1367] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.189s user 0.182s sys 0.004s
I20240502 21:30:11.604532 11267 raft_consensus.cc:348] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.604700 11267 raft_consensus.cc:729] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:11.604966 11267 consensus_queue.cc:260] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.605123 11267 raft_consensus.cc:388] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:11.605226 11267 raft_consensus.cc:482] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:11.605320 11267 raft_consensus.cc:3037] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:11.607185 11267 raft_consensus.cc:504] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.607404 11267 leader_election.cc:302] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:11.607602 11267 leader_election.cc:288] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:11.607652 11286 raft_consensus.cc:2781] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:11.607851 11286 raft_consensus.cc:686] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:11.608057 11267 ts_tablet_manager.cc:1398] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:11.608124 11286 consensus_queue.cc:237] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.608345 11267 tablet_bootstrap.cc:492] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:11.610548 10931 catalog_manager.cc:5484] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:11.776331 11267 tablet_bootstrap.cc:492] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=472 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:11.776777 11267 tablet_bootstrap.cc:492] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:11.777655 11267 ts_tablet_manager.cc:1367] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.169s user 0.141s sys 0.028s
I20240502 21:30:11.778328 11267 raft_consensus.cc:348] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.778558 11267 raft_consensus.cc:729] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:11.778805 11267 consensus_queue.cc:260] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.778991 11267 raft_consensus.cc:388] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:11.779057 11267 raft_consensus.cc:482] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:11.779134 11267 raft_consensus.cc:3037] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:11.780864 11267 raft_consensus.cc:504] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.781066 11267 leader_election.cc:302] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:11.781225 11267 leader_election.cc:288] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:11.781353 11286 raft_consensus.cc:2781] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:11.781576 11286 raft_consensus.cc:686] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:11.781654 11267 ts_tablet_manager.cc:1398] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:11.781883 11267 tablet_bootstrap.cc:492] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:11.781862 11286 consensus_queue.cc:237] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.784359 10931 catalog_manager.cc:5484] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:11.955268 11267 tablet_bootstrap.cc:492] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=522 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:11.955724 11267 tablet_bootstrap.cc:492] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:11.956633 11267 ts_tablet_manager.cc:1367] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.175s user 0.147s sys 0.024s
I20240502 21:30:11.957304 11267 raft_consensus.cc:348] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.957470 11267 raft_consensus.cc:729] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:11.957659 11267 consensus_queue.cc:260] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.957803 11267 raft_consensus.cc:388] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:11.957880 11267 raft_consensus.cc:482] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:11.957945 11267 raft_consensus.cc:3037] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:11.959713 11267 raft_consensus.cc:504] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.959897 11267 leader_election.cc:302] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:11.960067 11267 leader_election.cc:288] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:11.960139 11286 raft_consensus.cc:2781] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:11.960331 11286 raft_consensus.cc:686] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:11.960492 11267 ts_tablet_manager.cc:1398] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 21:30:11.960549 11286 consensus_queue.cc:237] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:11.960752 11267 tablet_bootstrap.cc:492] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:11.963060 10931 catalog_manager.cc:5484] T bb857096a0314b759ceb6664778e0739 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:12.155807 11267 tablet_bootstrap.cc:492] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=198 overwritten=0 applied=198 ignored=0} inserts{seen=552 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:12.156333 11267 tablet_bootstrap.cc:492] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:12.157217 11267 ts_tablet_manager.cc:1367] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.197s user 0.180s sys 0.015s
I20240502 21:30:12.157824 11267 raft_consensus.cc:348] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.157986 11267 raft_consensus.cc:729] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:12.158179 11267 consensus_queue.cc:260] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.158337 11267 raft_consensus.cc:388] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:12.158394 11267 raft_consensus.cc:482] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:12.158478 11267 raft_consensus.cc:3037] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:12.160240 11267 raft_consensus.cc:504] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.160447 11267 leader_election.cc:302] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:12.160593 11267 leader_election.cc:288] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:12.160708 11286 raft_consensus.cc:2781] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:12.160921 11286 raft_consensus.cc:686] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:12.161037 11267 ts_tablet_manager.cc:1398] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 21:30:12.161144 11286 consensus_queue.cc:237] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 198, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.161262 11267 tablet_bootstrap.cc:492] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:12.163646 10931 catalog_manager.cc:5484] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:12.338984 11267 tablet_bootstrap.cc:492] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=513 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:12.339516 11267 tablet_bootstrap.cc:492] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:12.340339 11267 ts_tablet_manager.cc:1367] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.179s user 0.155s sys 0.020s
I20240502 21:30:12.341213 11267 raft_consensus.cc:348] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.341388 11267 raft_consensus.cc:729] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:12.341624 11267 consensus_queue.cc:260] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.341764 11267 raft_consensus.cc:388] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:12.341856 11267 raft_consensus.cc:482] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:12.341939 11267 raft_consensus.cc:3037] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:12.343726 11267 raft_consensus.cc:504] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.343943 11267 leader_election.cc:302] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:12.344151 11267 leader_election.cc:288] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:12.344221 11286 raft_consensus.cc:2781] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:12.344417 11286 raft_consensus.cc:686] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:12.344583 11267 ts_tablet_manager.cc:1398] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:12.344682 11286 consensus_queue.cc:237] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.344861 11267 tablet_bootstrap.cc:492] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:12.347433 10931 catalog_manager.cc:5484] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:12.527612 11267 tablet_bootstrap.cc:492] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=522 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:12.528031 11267 tablet_bootstrap.cc:492] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:12.528980 11267 ts_tablet_manager.cc:1367] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.184s user 0.148s sys 0.036s
I20240502 21:30:12.529661 11267 raft_consensus.cc:348] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.529847 11267 raft_consensus.cc:729] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:12.530071 11267 consensus_queue.cc:260] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.530242 11267 raft_consensus.cc:388] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:12.530330 11267 raft_consensus.cc:482] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:12.530450 11267 raft_consensus.cc:3037] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:12.532384 11267 raft_consensus.cc:504] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.532608 11267 leader_election.cc:302] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:12.532752 11267 leader_election.cc:288] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:12.532920 11286 raft_consensus.cc:2781] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:12.533114 11286 raft_consensus.cc:686] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:12.533208 11267 ts_tablet_manager.cc:1398] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:12.533434 11267 tablet_bootstrap.cc:492] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:12.533386 11286 consensus_queue.cc:237] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.535943 10931 catalog_manager.cc:5484] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:12.716771 11267 tablet_bootstrap.cc:492] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=198 overwritten=0 applied=198 ignored=0} inserts{seen=547 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:12.717249 11267 tablet_bootstrap.cc:492] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:12.718343 11267 ts_tablet_manager.cc:1367] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.185s user 0.167s sys 0.016s
I20240502 21:30:12.718986 11267 raft_consensus.cc:348] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.719141 11267 raft_consensus.cc:729] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:12.719378 11267 consensus_queue.cc:260] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.719532 11267 raft_consensus.cc:388] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:12.719619 11267 raft_consensus.cc:482] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:12.719707 11267 raft_consensus.cc:3037] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:12.721557 11267 raft_consensus.cc:504] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.721760 11267 leader_election.cc:302] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:12.721952 11267 leader_election.cc:288] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:12.722019 11286 raft_consensus.cc:2781] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:12.722396 11267 ts_tablet_manager.cc:1398] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:12.722476 11286 raft_consensus.cc:686] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:12.722658 11267 tablet_bootstrap.cc:492] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:12.722724 11286 consensus_queue.cc:237] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 198, Committed index: 198, Last appended: 1.198, Last appended by leader: 198, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.725209 10931 catalog_manager.cc:5484] T 31e93ab3687d4390b9a8177c2bbf97a7 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:12.890295 11267 tablet_bootstrap.cc:492] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=471 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:12.890748 11267 tablet_bootstrap.cc:492] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:12.891557 11267 ts_tablet_manager.cc:1367] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.169s user 0.146s sys 0.020s
I20240502 21:30:12.892210 11267 raft_consensus.cc:348] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.892387 11267 raft_consensus.cc:729] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:12.892623 11267 consensus_queue.cc:260] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.892794 11267 raft_consensus.cc:388] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:12.892894 11267 raft_consensus.cc:482] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:12.892998 11267 raft_consensus.cc:3037] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:12.894840 11267 raft_consensus.cc:504] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.895056 11267 leader_election.cc:302] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:12.895237 11267 leader_election.cc:288] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:12.895352 11286 raft_consensus.cc:2781] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:12.895560 11286 raft_consensus.cc:686] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:12.895699 11267 ts_tablet_manager.cc:1398] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 21:30:12.895829 11286 consensus_queue.cc:237] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:12.895932 11267 tablet_bootstrap.cc:492] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:12.898496 10931 catalog_manager.cc:5484] T 958a961b73684b2f902069a9d9098bb0 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:13.118122 11267 tablet_bootstrap.cc:492] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=522 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:13.118571 11267 tablet_bootstrap.cc:492] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:13.119351 11267 ts_tablet_manager.cc:1367] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.223s user 0.183s sys 0.016s
I20240502 21:30:13.120149 11267 raft_consensus.cc:348] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.120363 11267 raft_consensus.cc:729] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:13.120656 11267 consensus_queue.cc:260] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.120889 11267 raft_consensus.cc:388] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:13.121011 11267 raft_consensus.cc:482] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:13.121122 11267 raft_consensus.cc:3037] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:13.123708 11267 raft_consensus.cc:504] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.123906 11267 leader_election.cc:302] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:13.124068 11267 leader_election.cc:288] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:13.124137 11286 raft_consensus.cc:2781] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:13.124342 11286 raft_consensus.cc:686] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:13.124517 11267 ts_tablet_manager.cc:1398] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s
I20240502 21:30:13.124598 11286 consensus_queue.cc:237] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.124799 11267 tablet_bootstrap.cc:492] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:13.127219 10931 catalog_manager.cc:5484] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:13.312781 11267 tablet_bootstrap.cc:492] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=518 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:13.313259 11267 tablet_bootstrap.cc:492] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:13.314045 11267 ts_tablet_manager.cc:1367] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.189s user 0.160s sys 0.027s
I20240502 21:30:13.314678 11267 raft_consensus.cc:348] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.314852 11267 raft_consensus.cc:729] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:13.315057 11267 consensus_queue.cc:260] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.315207 11267 raft_consensus.cc:388] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:13.315264 11267 raft_consensus.cc:482] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:13.315356 11267 raft_consensus.cc:3037] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:13.317170 11267 raft_consensus.cc:504] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.317430 11267 leader_election.cc:302] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:13.317647 11267 leader_election.cc:288] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:13.317740 11286 raft_consensus.cc:2781] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:13.317932 11286 raft_consensus.cc:686] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:13.318208 11267 ts_tablet_manager.cc:1398] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20240502 21:30:13.318255 11286 consensus_queue.cc:237] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.318473 11267 tablet_bootstrap.cc:492] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:13.321044 10931 catalog_manager.cc:5484] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:13.511359 11267 tablet_bootstrap.cc:492] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=535 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:13.511845 11267 tablet_bootstrap.cc:492] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:13.512706 11267 ts_tablet_manager.cc:1367] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.194s user 0.174s sys 0.016s
I20240502 21:30:13.513576 11267 raft_consensus.cc:348] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.513805 11267 raft_consensus.cc:729] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:13.514053 11267 consensus_queue.cc:260] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.514233 11267 raft_consensus.cc:388] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:13.514325 11267 raft_consensus.cc:482] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:13.514415 11267 raft_consensus.cc:3037] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:13.516978 11267 raft_consensus.cc:504] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.517238 11267 leader_election.cc:302] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:13.517496 11267 leader_election.cc:288] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:13.517560 11286 raft_consensus.cc:2781] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:13.517730 11286 raft_consensus.cc:686] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:13.517933 11267 ts_tablet_manager.cc:1398] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.005s user 0.001s sys 0.003s
I20240502 21:30:13.518193 11267 tablet_bootstrap.cc:492] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:13.517951 11286 consensus_queue.cc:237] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.525242 10931 catalog_manager.cc:5484] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:13.715292 11267 tablet_bootstrap.cc:492] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=524 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:13.715714 11267 tablet_bootstrap.cc:492] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:13.716498 11267 ts_tablet_manager.cc:1367] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.198s user 0.190s sys 0.004s
I20240502 21:30:13.717175 11267 raft_consensus.cc:348] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.717352 11267 raft_consensus.cc:729] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:13.717554 11267 consensus_queue.cc:260] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.717692 11267 raft_consensus.cc:388] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:13.717748 11267 raft_consensus.cc:482] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:13.717830 11267 raft_consensus.cc:3037] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:13.719619 11267 raft_consensus.cc:504] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.719837 11267 leader_election.cc:302] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:13.719985 11267 leader_election.cc:288] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:13.720103 11286 raft_consensus.cc:2781] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:13.720319 11286 raft_consensus.cc:686] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:13.720429 11267 ts_tablet_manager.cc:1398] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20240502 21:30:13.720685 11267 tablet_bootstrap.cc:492] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap starting.
I20240502 21:30:13.720582 11286 consensus_queue.cc:237] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.723608 10931 catalog_manager.cc:5484] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:13.901908 11267 tablet_bootstrap.cc:492] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=546 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20240502 21:30:13.902360 11267 tablet_bootstrap.cc:492] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Bootstrap complete.
I20240502 21:30:13.903162 11267 ts_tablet_manager.cc:1367] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Time spent bootstrapping tablet: real 0.183s user 0.164s sys 0.016s
I20240502 21:30:13.903954 11267 raft_consensus.cc:348] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.904116 11267 raft_consensus.cc:729] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Initialized, Role: FOLLOWER
I20240502 21:30:13.904359 11267 consensus_queue.cc:260] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.904516 11267 raft_consensus.cc:388] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20240502 21:30:13.904620 11267 raft_consensus.cc:482] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20240502 21:30:13.904712 11267 raft_consensus.cc:3037] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 1 FOLLOWER]: Advancing to term 2
I20240502 21:30:13.906600 11267 raft_consensus.cc:504] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.906824 11267 leader_election.cc:302] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec9f7fe764cb41c9ae157e0b23300dec; no voters:
I20240502 21:30:13.907059 11267 leader_election.cc:288] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [CANDIDATE]: Term 2 election: Requested vote from peers
I20240502 21:30:13.907241 11286 raft_consensus.cc:2781] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 2 FOLLOWER]: Leader election won for term 2
I20240502 21:30:13.907434 11286 raft_consensus.cc:686] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [term 2 LEADER]: Becoming Leader. State: Replica: ec9f7fe764cb41c9ae157e0b23300dec, State: Running, Role: LEADER
I20240502 21:30:13.907593 11267 ts_tablet_manager.cc:1398] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Time spent starting tablet: real 0.004s user 0.006s sys 0.000s
I20240502 21:30:13.907657 11286 consensus_queue.cc:237] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } }
I20240502 21:30:13.910228 10931 catalog_manager.cc:5484] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec9f7fe764cb41c9ae157e0b23300dec" member_type: VOTER last_known_addr { host: "127.6.51.193" port: 35971 } health_report { overall_health: HEALTHY } } }
I20240502 21:30:14.072806 11359 ts_tablet_manager.cc:902] T 181e0390813a452094cd2cedb9a7e58f P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.074164 11367 ts_tablet_manager.cc:902] T 6e09bb2ca21a4d15ad9628cad8c039fc P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.074506 11360 ts_tablet_manager.cc:902] T 787abf726bb74fa1a12694126b96dd2b P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.075155 11357 ts_tablet_manager.cc:902] T 0d5d5360de664753aea86c8b3645dd44 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.098558 11363 ts_tablet_manager.cc:902] T 1b4569b2bbff4312995a21a09462d57e P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.098645 11362 ts_tablet_manager.cc:902] T 1655f2b9843240d1ba618646fa4684c1 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.098887 11368 ts_tablet_manager.cc:902] T 13b3c062533b43bda769b313b2e68e55 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.102562 11366 ts_tablet_manager.cc:902] T a389e0036e44455597fb46d5e6db4ad4 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.103072 11365 ts_tablet_manager.cc:902] T 9e5102e06f7b4ed8b67348afcd74d900 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.103442 11361 ts_tablet_manager.cc:902] T 54d3a4106d5a4e33b3bef170afcba188 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.106649 11361 tablet_copy_client.cc:308] T 54d3a4106d5a4e33b3bef170afcba188 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.110733 11370 ts_tablet_manager.cc:902] T aac586fb1c8b4f80bcc2f43150806d5c P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.111681 11369 ts_tablet_manager.cc:902] T 70988cb5413a4b0f976e759df1b54d48 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.112610 11371 ts_tablet_manager.cc:902] T 3003e2a8df444a1d94d028fd62ed5f2b P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.103782 11364 ts_tablet_manager.cc:902] T 6946f83add414078ae7dbddbfed16aa1 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.115285 11358 ts_tablet_manager.cc:902] T 537b30433ac64d6e8868f52955864da0 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.116209 11356 ts_tablet_manager.cc:902] T 22d9d79ecdca4a3790db7c974094bd6a P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.122390 11372 ts_tablet_manager.cc:902] T 31e93ab3687d4390b9a8177c2bbf97a7 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
F20240502 21:30:14.122880 11372 trace_metrics.cc:68] Check failed: g_intern_map->size() < 100 (100 vs. 100) Too many interned strings: (MaintenanceMgr.queue_time_us, MaintenanceMgr.queue_time_us) (MaintenanceMgr.run_cpu_time_us, MaintenanceMgr.run_cpu_time_us) (MaintenanceMgr.run_wall_time_us, MaintenanceMgr.run_wall_time_us) (apply.queue_time_us, apply.queue_time_us) (apply.run_cpu_time_us, apply.run_cpu_time_us) (apply.run_wall_time_us, apply.run_wall_time_us) (client-negotiator.queue_time_us, client-negotiator.queue_time_us) (client-negotiator.run_cpu_time_us, client-negotiator.run_cpu_time_us) (client-negotiator.run_wall_time_us, client-negotiator.run_wall_time_us) (compiler_manager_pool.queue_time_us, compiler_manager_pool.queue_time_us) (compiler_manager_pool.run_cpu_time_us, compiler_manager_pool.run_cpu_time_us) (compiler_manager_pool.run_wall_time_us, compiler_manager_pool.run_wall_time_us) (dirs.queue_time_us, dirs.queue_time_us) (dirs.run_cpu_time_us, dirs.run_cpu_time_us) (dirs.run_wall_time_us, dirs.run_wall_time_us) (dns-resolver.queue_time_us, dns-resolver.queue_time_us) (dns-resolver.run_cpu_time_us, dns-resolver.run_cpu_time_us) (dns-resolver.run_wall_time_us, dns-resolver.run_wall_time_us) (prepare.queue_time_us, prepare.queue_time_us) (prepare.run_cpu_time_us, prepare.run_cpu_time_us) (prepare.run_wall_time_us, prepare.run_wall_time_us) (raft.queue_time_us, raft.queue_time_us) (raft.run_cpu_time_us, raft.run_cpu_time_us) (raft.run_wall_time_us, raft.run_wall_time_us) (repair_pool.queue_time_us, repair_pool.queue_time_us) (repair_pool.run_cpu_time_us, repair_pool.run_cpu_time_us) (repair_pool.run_wall_time_us, repair_pool.run_wall_time_us) (server-negotiator.queue_time_us, server-negotiator.queue_time_us) (server-negotiator.run_cpu_time_us, server-negotiator.run_cpu_time_us) (server-negotiator.run_wall_time_us, server-negotiator.run_wall_time_us) (tablet-copy.queue_time_us, tablet-copy.queue_time_us) (tablet-copy.run_cpu_time_us, tablet-copy.run_cpu_time_us) (tablet-copy.run_wall_time_us, tablet-copy.run_wall_time_us) (tablet-delete.queue_time_us, tablet-delete.queue_time_us) (tablet-delete.run_cpu_time_us, tablet-delete.run_cpu_time_us) (tablet-delete.run_wall_time_us, tablet-delete.run_wall_time_us) (tablet-download-pool-0d5d5360de664753aea86c8b3645dd44.queue_time_us, tablet-download-pool-0d5d5360de664753aea86c8b3645dd44.queue_time_us) (tablet-download-pool-0d5d5360de664753aea86c8b3645dd44.run_cpu_time_us, tablet-download-pool-0d5d5360de664753aea86c8b3645dd44.run_cpu_time_us) (tablet-download-pool-0d5d5360de664753aea86c8b3645dd44.run_wall_time_us, tablet-download-pool-0d5d5360de664753aea86c8b3645dd44.run_wall_time_us) (tablet-download-pool-13b3c062533b43bda769b313b2e68e55.queue_time_us, tablet-download-pool-13b3c062533b43bda769b313b2e68e55.queue_time_us) (tablet-download-pool-13b3c062533b43bda769b313b2e68e55.run_cpu_time_us, tablet-download-pool-13b3c062533b43bda769b313b2e68e55.run_cpu_time_us) (tablet-download-pool-13b3c062533b43bda769b313b2e68e55.run_wall_time_us, tablet-download-pool-13b3c062533b43bda769b313b2e68e55.run_wall_time_us) (tablet-download-pool-1655f2b9843240d1ba618646fa4684c1.queue_time_us, tablet-download-pool-1655f2b9843240d1ba618646fa4684c1.queue_time_us) (tablet-download-pool-1655f2b9843240d1ba618646fa4684c1.run_cpu_time_us, tablet-download-pool-1655f2b9843240d1ba618646fa4684c1.run_cpu_time_us) (tablet-download-pool-1655f2b9843240d1ba618646fa4684c1.run_wall_time_us, tablet-download-pool-1655f2b9843240d1ba618646fa4684c1.run_wall_time_us) (tablet-download-pool-181e0390813a452094cd2cedb9a7e58f.queue_time_us, tablet-download-pool-181e0390813a452094cd2cedb9a7e58f.queue_time_us) (tablet-download-pool-181e0390813a452094cd2cedb9a7e58f.run_cpu_time_us, tablet-download-pool-181e0390813a452094cd2cedb9a7e58f.run_cpu_time_us) (tablet-download-pool-181e0390813a452094cd2cedb9a7e58f.run_wall_time_us, tablet-download-pool-181e0390813a452094cd2cedb9a7e58f.run_wall_time_us) (tablet-download-pool-1b4569b2bbff4312995a21a09462d57e.queue_time_us, tablet-download-pool-1b4569b2bbff4312995a21a09462d57e.queue_time_us) (tablet-download-pool-1b4569b2bbff4312995a21a09462d57e.run_cpu_time_us, tablet-download-pool-1b4569b2bbff4312995a21a09462d57e.run_cpu_time_us) (tablet-download-pool-1b4569b2bbff4312995a21a09462d57e.run_wall_time_us, tablet-download-pool-1b4569b2bbff4312995a21a09462d57e.run_wall_time_us) (tablet-download-pool-22d9d79ecdca4a3790db7c974094bd6a.queue_time_us, tablet-download-pool-22d9d79ecdca4a3790db7c974094bd6a.queue_time_us) (tablet-download-pool-22d9d79ecdca4a3790db7c974094bd6a.run_cpu_time_us, tablet-download-pool-22d9d79ecdca4a3790db7c974094bd6a.run_cpu_time_us) (tablet-download-pool-22d9d79ecdca4a3790db7c974094bd6a.run_wall_time_us, tablet-download-pool-22d9d79ecdca4a3790db7c974094bd6a.run_wall_time_us) (tablet-download-pool-3003e2a8df444a1d94d028fd62ed5f2b.queue_time_us, tablet-download-pool-3003e2a8df444a1d94d028fd62ed5f2b.queue_time_us) (tablet-download-pool-3003e2a8df444a1d94d028fd62ed5f2b.run_cpu_time_us, tablet-download-pool-3003e2a8df444a1d94d028fd62ed5f2b.run_cpu_time_us) (tablet-download-pool-3003e2a8df444a1d94d028fd62ed5f2b.run_wall_time_us, tablet-download-pool-3003e2a8df444a1d94d028fd62ed5f2b.run_wall_time_us) (tablet-download-pool-31e93ab3687d4390b9a8177c2bbf97a7.queue_time_us, tablet-download-pool-31e93ab3687d4390b9a8177c2bbf97a7.queue_time_us) (tablet-download-pool-537b30433ac64d6e8868f52955864da0.queue_time_us, tablet-download-pool-537b30433ac64d6e8868f52955864da0.queue_time_us) (tablet-download-pool-537b30433ac64d6e8868f52955864da0.run_cpu_time_us, tablet-download-pool-537b30433ac64d6e8868f52955864da0.run_cpu_time_us) (tablet-download-pool-537b30433ac64d6e8868f52955864da0.run_wall_time_us, tablet-download-pool-537b30433ac64d6e8868f52955864da0.run_wall_time_us) (tablet-download-pool-54d3a4106d5a4e33b3bef170afcba188.queue_time_us, tablet-download-pool-54d3a4106d5a4e33b3bef170afcba188.queue_time_us) (tablet-download-pool-54d3a4106d5a4e33b3bef170afcba188.run_cpu_time_us, tablet-download-pool-54d3a4106d5a4e33b3bef170afcba188.run_cpu_time_us) (tablet-download-pool-54d3a4106d5a4e33b3bef170afcba188.run_wall_time_us, tablet-download-pool-54d3a4106d5a4e33b3bef170afcba188.run_wall_time_us) (tablet-download-pool-6946f83add414078ae7dbddbfed16aa1.queue_time_us, tablet-download-pool-6946f83add414078ae7dbddbfed16aa1.queue_time_us) (tablet-download-pool-6946f83add414078ae7dbddbfed16aa1.run_cpu_time_us, tablet-download-pool-6946f83add414078ae7dbddbfed16aa1.run_cpu_time_us) (tablet-download-pool-6946f83add414078ae7dbddbfed16aa1.run_wall_time_us, tablet-download-pool-6946f83add414078ae7dbddbfed16aa1.run_wall_time_us) (tablet-download-pool-6e09bb2ca21a4d15ad9628cad8c039fc.queue_time_us, tablet-download-pool-6e09bb2ca21a4d15ad9628cad8c039fc.queue_time_us) (tablet-download-pool-6e09bb2ca21a4d15ad9628cad8c039fc.run_cpu_time_us, tablet-download-pool-6e09bb2ca21a4d15ad9628cad8c039fc.run_cpu_time_us) (tablet-download-pool-6e09bb2ca21a4d15ad9628cad8c039fc.run_wall_time_us, tablet-download-pool-6e09bb2ca21a4d15ad9628cad8c039fc.run_wall_time_us) (tablet-download-pool-70988cb5413a4b0f976e759df1b54d48.queue_time_us, tablet-download-pool-70988cb5413a4b0f976e759df1b54d48.queue_time_us) (tablet-download-pool-70988cb5413a4b0f976e759df1b54d48.run_cpu_time_us, tablet-download-pool-70988cb5413a4b0f976e759df1b54d48.run_cpu_time_us) (tablet-download-pool-70988cb5413a4b0f976e759df1b54d48.run_wall_time_us, tablet-download-pool-70988cb5413a4b0f976e759df1b54d48.run_wall_time_us) (tablet-download-pool-787abf726bb74fa1a12694126b96dd2b.queue_time_us, tablet-download-pool-787abf726bb74fa1a12694126b96dd2b.queue_time_us) (tablet-download-pool-787abf726bb74fa1a12694126b96dd2b.run_cpu_time_us, tablet-download-pool-787abf726bb74fa1a12694126b96dd2b.run_cpu_time_us) (tablet-download-pool-787abf726bb74fa1a12694126b96dd2b.run_wall_time_us, tablet-download-pool-787abf726bb74fa1a12694126b96dd2b.run_wall_time_us) (tablet-download-pool-9e5102e06f7b4ed8b67348afcd74d900.queue_time_us, tablet-download-pool-9e5102e06f7b4ed8b67348afcd74d900.queue_time_us) (tablet-download-pool-9e5102e06f7b4ed8b67348afcd74d900.run_cpu_time_us, tablet-download-pool-9e5102e06f7b4ed8b67348afcd74d900.run_cpu_time_us) (tablet-download-pool-9e5102e06f7b4ed8b67348afcd74d900.run_wall_time_us, tablet-download-pool-9e5102e06f7b4ed8b67348afcd74d900.run_wall_time_us) (tablet-download-pool-a389e0036e44455597fb46d5e6db4ad4.queue_time_us, tablet-download-pool-a389e0036e44455597fb46d5e6db4ad4.queue_time_us) (tablet-download-pool-a389e0036e44455597fb46d5e6db4ad4.run_cpu_time_us, tablet-download-pool-a389e0036e44455597fb46d5e6db4ad4.run_cpu_time_us) (tablet-download-pool-a389e0036e44455597fb46d5e6db4ad4.run_wall_time_us, tablet-download-pool-a389e0036e44455597fb46d5e6db4ad4.run_wall_time_us) (tablet-download-pool-aac586fb1c8b4f80bcc2f43150806d5c.queue_time_us, tablet-download-pool-aac586fb1c8b4f80bcc2f43150806d5c.queue_time_us) (tablet-download-pool-aac586fb1c8b4f80bcc2f43150806d5c.run_cpu_time_us, tablet-download-pool-aac586fb1c8b4f80bcc2f43150806d5c.run_cpu_time_us) (tablet-download-pool-aac586fb1c8b4f80bcc2f43150806d5c.run_wall_time_us, tablet-download-pool-aac586fb1c8b4f80bcc2f43150806d5c.run_wall_time_us) (tablet-open.queue_time_us, tablet-open.queue_time_us) (tablet-open.run_cpu_time_us, tablet-open.run_cpu_time_us) (tablet-open.run_wall_time_us, tablet-open.run_wall_time_us) (txn-commit.queue_time_us, txn-commit.queue_time_us) (txn-commit.run_cpu_time_us, txn-commit.run_cpu_time_us) (txn-commit.run_wall_time_us, txn-commit.run_wall_time_us) (txn-participant-registration.queue_time_us, txn-participant-registration.queue_time_us) (txn-participant-registration.run_cpu_time_us, txn-participant-registration.run_cpu_time_us) (txn-participant-registration.run_wall_time_us, txn-participant-registration.run_wall_time_us) (txn-status-manager.queue_time_us, txn-status-manager.queue_time_us) (txn-status-manager.run_cpu_time_us, txn-status-manager.run_cpu_time_us) (txn-status-manager.run_wall_time_us, txn-status-manager.run_wall_time_us) (txn-status-tablet-reload.queue_time_us, txn-status-tablet-reload.queue_time_us) (txn-status-tablet-reload.run_cpu_time_us, txn-status-tablet-reload.run_cpu_time_us) (txn-status-tablet-reload.run_wall_time_us, txn-status-tablet-reload.run_wall_time_us)
*** Check failure stack trace: ***
I20240502 21:30:14.125334 11373 ts_tablet_manager.cc:902] T 958a961b73684b2f902069a9d9098bb0 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
@ 0x7effdd9eadcd google::LogMessage::Fail() at ??:0
I20240502 21:30:14.127506 11374 ts_tablet_manager.cc:902] T bb857096a0314b759ceb6664778e0739 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
I20240502 21:30:14.136960 11375 ts_tablet_manager.cc:902] T 0e7f30b2de5746d69d4cb6f2bc41bd14 P bda87e13c35f421a92392a1b5362cc3a: Initiating tablet copy from peer ec9f7fe764cb41c9ae157e0b23300dec (127.6.51.193:35971)
@ 0x7effdd9eeb93 google::LogMessage::SendToLog() at ??:0
@ 0x7effdd9ea7cc google::LogMessage::Flush() at ??:0
@ 0x7effdd9ebf59 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20240502 21:30:14.150151 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 54d3a4106d5a4e33b3bef170afcba188 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.150499 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 54d3a4106d5a4e33b3bef170afcba188 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-54d3a4106d5a4e33b3bef170afcba188
I20240502 21:30:14.154474 11273 tablet_copy_source_session.cc:205] T 54d3a4106d5a4e33b3bef170afcba188 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.160751 11361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54d3a4106d5a4e33b3bef170afcba188. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.169667 11356 tablet_copy_client.cc:308] T 22d9d79ecdca4a3790db7c974094bd6a P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.170509 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 22d9d79ecdca4a3790db7c974094bd6a from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.170702 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 22d9d79ecdca4a3790db7c974094bd6a from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-22d9d79ecdca4a3790db7c974094bd6a
I20240502 21:30:14.173877 11273 tablet_copy_source_session.cc:205] T 22d9d79ecdca4a3790db7c974094bd6a P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.175228 11356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22d9d79ecdca4a3790db7c974094bd6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.183189 11365 tablet_copy_client.cc:308] T 9e5102e06f7b4ed8b67348afcd74d900 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.184995 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 9e5102e06f7b4ed8b67348afcd74d900 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.185173 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 9e5102e06f7b4ed8b67348afcd74d900 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-9e5102e06f7b4ed8b67348afcd74d900
I20240502 21:30:14.188156 11273 tablet_copy_source_session.cc:205] T 9e5102e06f7b4ed8b67348afcd74d900 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.189393 11365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e5102e06f7b4ed8b67348afcd74d900. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.193023 11368 tablet_copy_client.cc:308] T 13b3c062533b43bda769b313b2e68e55 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.196221 11370 tablet_copy_client.cc:308] T aac586fb1c8b4f80bcc2f43150806d5c P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.197942 11366 tablet_copy_client.cc:308] T a389e0036e44455597fb46d5e6db4ad4 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.198446 11358 tablet_copy_client.cc:308] T 537b30433ac64d6e8868f52955864da0 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
W20240502 21:30:14.198701 11264 service_pool.cc:135] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items.
I20240502 21:30:14.199052 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 4)
I20240502 21:30:14.199627 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 4)
I20240502 21:30:14.205186 11371 tablet_copy_client.cc:308] T 3003e2a8df444a1d94d028fd62ed5f2b P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.205343 11364 tablet_copy_client.cc:308] T 6946f83add414078ae7dbddbfed16aa1 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.205855 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 4)
I20240502 21:30:14.208499 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 13b3c062533b43bda769b313b2e68e55 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.208675 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 13b3c062533b43bda769b313b2e68e55 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-13b3c062533b43bda769b313b2e68e55
I20240502 21:30:14.213886 11273 tablet_copy_source_session.cc:205] T 13b3c062533b43bda769b313b2e68e55 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.217085 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 4)
I20240502 21:30:14.217428 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 4)
I20240502 21:30:14.217762 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 4)
I20240502 21:30:14.219086 11368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13b3c062533b43bda769b313b2e68e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.220571 11365 tablet_copy_client.cc:783] T 9e5102e06f7b4ed8b67348afcd74d900 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.220680 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet aac586fb1c8b4f80bcc2f43150806d5c from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.220857 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet aac586fb1c8b4f80bcc2f43150806d5c from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-aac586fb1c8b4f80bcc2f43150806d5c
I20240502 21:30:14.223711 11273 tablet_copy_source_session.cc:205] T aac586fb1c8b4f80bcc2f43150806d5c P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.224860 11370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aac586fb1c8b4f80bcc2f43150806d5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.229176 11369 tablet_copy_client.cc:308] T 70988cb5413a4b0f976e759df1b54d48 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.229825 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 12)
I20240502 21:30:14.236336 11365 tablet_copy_client.cc:647] T 9e5102e06f7b4ed8b67348afcd74d900 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.237847 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 12)
I20240502 21:30:14.239156 11361 tablet_copy_client.cc:783] T 54d3a4106d5a4e33b3bef170afcba188 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.239387 11361 tablet_copy_client.cc:647] T 54d3a4106d5a4e33b3bef170afcba188 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.240886 11356 tablet_copy_client.cc:783] T 22d9d79ecdca4a3790db7c974094bd6a P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.241091 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 3003e2a8df444a1d94d028fd62ed5f2b from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.241282 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 3003e2a8df444a1d94d028fd62ed5f2b from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-3003e2a8df444a1d94d028fd62ed5f2b
I20240502 21:30:14.241607 11360 tablet_copy_client.cc:308] T 787abf726bb74fa1a12694126b96dd2b P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.243891 11273 tablet_copy_source_session.cc:205] T 3003e2a8df444a1d94d028fd62ed5f2b P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.243988 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 12)
I20240502 21:30:14.244391 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 6946f83add414078ae7dbddbfed16aa1 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.244506 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 6946f83add414078ae7dbddbfed16aa1 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-6946f83add414078ae7dbddbfed16aa1
I20240502 21:30:14.244875 11356 tablet_copy_client.cc:647] T 22d9d79ecdca4a3790db7c974094bd6a P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.247442 11273 tablet_copy_source_session.cc:205] T 6946f83add414078ae7dbddbfed16aa1 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.248589 11370 tablet_copy_client.cc:783] T aac586fb1c8b4f80bcc2f43150806d5c P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.251339 11370 tablet_copy_client.cc:647] T aac586fb1c8b4f80bcc2f43150806d5c P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.251752 11356 tablet_copy_client.cc:523] T 22d9d79ecdca4a3790db7c974094bd6a P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.253072 11362 tablet_copy_client.cc:308] T 1655f2b9843240d1ba618646fa4684c1 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
@ 0x7effe072b742 kudu::TraceMetrics::InternName() at ??:0
I20240502 21:30:14.254695 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 1655f2b9843240d1ba618646fa4684c1 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.254854 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 1655f2b9843240d1ba618646fa4684c1 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-1655f2b9843240d1ba618646fa4684c1
I20240502 21:30:14.256217 11371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3003e2a8df444a1d94d028fd62ed5f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.257701 11273 tablet_copy_source_session.cc:205] T 1655f2b9843240d1ba618646fa4684c1 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.259932 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 20)
I20240502 21:30:14.260288 11357 tablet_copy_client.cc:308] T 0d5d5360de664753aea86c8b3645dd44 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.260875 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 20)
I20240502 21:30:14.261134 11363 tablet_copy_client.cc:308] T 1b4569b2bbff4312995a21a09462d57e P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.261276 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 20)
I20240502 21:30:14.261678 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 20)
I20240502 21:30:14.261720 11364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6946f83add414078ae7dbddbfed16aa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.261759 11367 tablet_copy_client.cc:308] T 6e09bb2ca21a4d15ad9628cad8c039fc P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.261739 11359 tablet_copy_client.cc:308] T 181e0390813a452094cd2cedb9a7e58f P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Beginning tablet copy session from remote peer at address 127.6.51.193:35971
I20240502 21:30:14.262621 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 787abf726bb74fa1a12694126b96dd2b from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.262887 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 787abf726bb74fa1a12694126b96dd2b from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-787abf726bb74fa1a12694126b96dd2b
I20240502 21:30:14.265589 11273 tablet_copy_source_session.cc:205] T 787abf726bb74fa1a12694126b96dd2b P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.265946 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet a389e0036e44455597fb46d5e6db4ad4 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.265988 11362 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1655f2b9843240d1ba618646fa4684c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.266086 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet a389e0036e44455597fb46d5e6db4ad4 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-a389e0036e44455597fb46d5e6db4ad4
I20240502 21:30:14.266726 11360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787abf726bb74fa1a12694126b96dd2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.269100 11273 tablet_copy_source_session.cc:205] T a389e0036e44455597fb46d5e6db4ad4 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.269812 11361 tablet_copy_client.cc:523] T 54d3a4106d5a4e33b3bef170afcba188 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.271263 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 181e0390813a452094cd2cedb9a7e58f from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.271765 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 181e0390813a452094cd2cedb9a7e58f from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-181e0390813a452094cd2cedb9a7e58f
I20240502 21:30:14.272279 11264 service_pool.cc:138] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 27)
I20240502 21:30:14.273983 11368 tablet_copy_client.cc:783] T 13b3c062533b43bda769b313b2e68e55 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.274236 11264 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.6.51.194:45001 (request call id 27)
I20240502 21:30:14.274492 11273 tablet_copy_source_session.cc:205] T 181e0390813a452094cd2cedb9a7e58f P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.274860 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 0d5d5360de664753aea86c8b3645dd44 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.275005 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 0d5d5360de664753aea86c8b3645dd44 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-0d5d5360de664753aea86c8b3645dd44
I20240502 21:30:14.277788 11273 tablet_copy_source_session.cc:205] T 0d5d5360de664753aea86c8b3645dd44 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.279668 11366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a389e0036e44455597fb46d5e6db4ad4. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.282421 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 1b4569b2bbff4312995a21a09462d57e from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.282575 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 1b4569b2bbff4312995a21a09462d57e from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-1b4569b2bbff4312995a21a09462d57e
I20240502 21:30:14.282864 11368 tablet_copy_client.cc:647] T 13b3c062533b43bda769b313b2e68e55 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.283214 11370 tablet_copy_client.cc:523] T aac586fb1c8b4f80bcc2f43150806d5c P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.283278 11359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 181e0390813a452094cd2cedb9a7e58f. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.284686 11357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d5d5360de664753aea86c8b3645dd44. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.285218 11273 tablet_copy_source_session.cc:205] T 1b4569b2bbff4312995a21a09462d57e P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.286406 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 6e09bb2ca21a4d15ad9628cad8c039fc from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.286559 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 6e09bb2ca21a4d15ad9628cad8c039fc from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-6e09bb2ca21a4d15ad9628cad8c039fc
I20240502 21:30:14.289106 11273 tablet_copy_source_session.cc:205] T 6e09bb2ca21a4d15ad9628cad8c039fc P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.296634 11364 tablet_copy_client.cc:783] T 6946f83add414078ae7dbddbfed16aa1 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.296995 11365 tablet_copy_client.cc:523] T 9e5102e06f7b4ed8b67348afcd74d900 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.298341 11368 tablet_copy_client.cc:523] T 13b3c062533b43bda769b313b2e68e55 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.300580 11370 tablet_bootstrap.cc:492] T aac586fb1c8b4f80bcc2f43150806d5c P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.300745 11361 tablet_bootstrap.cc:492] T 54d3a4106d5a4e33b3bef170afcba188 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.300649 11356 tablet_bootstrap.cc:492] T 22d9d79ecdca4a3790db7c974094bd6a P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.304131 11364 tablet_copy_client.cc:647] T 6946f83add414078ae7dbddbfed16aa1 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.306856 11363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1b4569b2bbff4312995a21a09462d57e. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.309451 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 537b30433ac64d6e8868f52955864da0 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.309648 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 537b30433ac64d6e8868f52955864da0 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-537b30433ac64d6e8868f52955864da0
I20240502 21:30:14.312477 11273 tablet_copy_source_session.cc:205] T 537b30433ac64d6e8868f52955864da0 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.316056 11273 tablet_copy_service.cc:140] P ec9f7fe764cb41c9ae157e0b23300dec: Received BeginTabletCopySession request for tablet 70988cb5413a4b0f976e759df1b54d48 from peer bda87e13c35f421a92392a1b5362cc3a ({username='slave'} at 127.6.51.194:45001)
I20240502 21:30:14.316371 11273 tablet_copy_service.cc:161] P ec9f7fe764cb41c9ae157e0b23300dec: Beginning new tablet copy session on tablet 70988cb5413a4b0f976e759df1b54d48 from peer bda87e13c35f421a92392a1b5362cc3a at {username='slave'} at 127.6.51.194:45001: session id = bda87e13c35f421a92392a1b5362cc3a-70988cb5413a4b0f976e759df1b54d48
I20240502 21:30:14.317387 11367 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e09bb2ca21a4d15ad9628cad8c039fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.319025 11273 tablet_copy_source_session.cc:205] T 70988cb5413a4b0f976e759df1b54d48 P ec9f7fe764cb41c9ae157e0b23300dec: Tablet Copy: opened 0 blocks and 1 log segments
I20240502 21:30:14.319383 11358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 537b30433ac64d6e8868f52955864da0. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.324056 11369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70988cb5413a4b0f976e759df1b54d48. 1 dirs total, 0 dirs full, 0 dirs failed
I20240502 21:30:14.324486 11365 tablet_bootstrap.cc:492] T 9e5102e06f7b4ed8b67348afcd74d900 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.329074 11371 tablet_copy_client.cc:783] T 3003e2a8df444a1d94d028fd62ed5f2b P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.330837 11364 tablet_copy_client.cc:523] T 6946f83add414078ae7dbddbfed16aa1 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
@ 0x7effe06f7f8b kudu::ThreadPool::ThreadPool() at ??:0
I20240502 21:30:14.332917 11368 tablet_bootstrap.cc:492] T 13b3c062533b43bda769b313b2e68e55 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.333799 11371 tablet_copy_client.cc:647] T 3003e2a8df444a1d94d028fd62ed5f2b P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.345953 11371 tablet_copy_client.cc:523] T 3003e2a8df444a1d94d028fd62ed5f2b P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.355677 11366 tablet_copy_client.cc:783] T a389e0036e44455597fb46d5e6db4ad4 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.366303 11357 tablet_copy_client.cc:783] T 0d5d5360de664753aea86c8b3645dd44 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.367667 11362 tablet_copy_client.cc:783] T 1655f2b9843240d1ba618646fa4684c1 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.367933 11359 tablet_copy_client.cc:783] T 181e0390813a452094cd2cedb9a7e58f P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.368599 11362 tablet_copy_client.cc:647] T 1655f2b9843240d1ba618646fa4684c1 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.372956 11360 tablet_copy_client.cc:783] T 787abf726bb74fa1a12694126b96dd2b P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.373071 11366 tablet_copy_client.cc:647] T a389e0036e44455597fb46d5e6db4ad4 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.373808 11357 tablet_copy_client.cc:647] T 0d5d5360de664753aea86c8b3645dd44 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.375407 11364 tablet_bootstrap.cc:492] T 6946f83add414078ae7dbddbfed16aa1 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.376013 11360 tablet_copy_client.cc:647] T 787abf726bb74fa1a12694126b96dd2b P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.377329 11359 tablet_copy_client.cc:647] T 181e0390813a452094cd2cedb9a7e58f P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.382789 11371 tablet_bootstrap.cc:492] T 3003e2a8df444a1d94d028fd62ed5f2b P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.385790 11357 tablet_copy_client.cc:523] T 0d5d5360de664753aea86c8b3645dd44 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.395382 11366 tablet_copy_client.cc:523] T a389e0036e44455597fb46d5e6db4ad4 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.401793 11362 tablet_copy_client.cc:523] T 1655f2b9843240d1ba618646fa4684c1 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.402532 11358 tablet_copy_client.cc:783] T 537b30433ac64d6e8868f52955864da0 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.404970 11363 tablet_copy_client.cc:783] T 1b4569b2bbff4312995a21a09462d57e P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.405575 11359 tablet_copy_client.cc:523] T 181e0390813a452094cd2cedb9a7e58f P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.408901 11369 tablet_copy_client.cc:783] T 70988cb5413a4b0f976e759df1b54d48 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.410198 11360 tablet_copy_client.cc:523] T 787abf726bb74fa1a12694126b96dd2b P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.410472 11363 tablet_copy_client.cc:647] T 1b4569b2bbff4312995a21a09462d57e P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.410926 11367 tablet_copy_client.cc:783] T 6e09bb2ca21a4d15ad9628cad8c039fc P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 0 data blocks...
I20240502 21:30:14.412009 11369 tablet_copy_client.cc:647] T 70988cb5413a4b0f976e759df1b54d48 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.412586 11358 tablet_copy_client.cc:647] T 537b30433ac64d6e8868f52955864da0 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.418819 11367 tablet_copy_client.cc:647] T 6e09bb2ca21a4d15ad9628cad8c039fc P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Starting download of 1 WAL segments...
I20240502 21:30:14.432201 11362 tablet_bootstrap.cc:492] T 1655f2b9843240d1ba618646fa4684c1 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.435371 11359 tablet_bootstrap.cc:492] T 181e0390813a452094cd2cedb9a7e58f P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.443996 11357 tablet_bootstrap.cc:492] T 0d5d5360de664753aea86c8b3645dd44 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.456766 11264 service_pool.cc:138] FetchData request on kudu.tserver.TabletCopyService from 127.6.51.194:45001 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue:
Call kudu.tserver.TabletCopyService.FetchData from 127.6.51.194:45001 (request call id 45)
I20240502 21:30:14.460112 11369 tablet_copy_client.cc:523] T 70988cb5413a4b0f976e759df1b54d48 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.477685 11366 tablet_bootstrap.cc:492] T a389e0036e44455597fb46d5e6db4ad4 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.479548 11363 tablet_copy_client.cc:523] T 1b4569b2bbff4312995a21a09462d57e P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.480469 11360 tablet_bootstrap.cc:492] T 787abf726bb74fa1a12694126b96dd2b P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.507659 11358 tablet_copy_client.cc:523] T 537b30433ac64d6e8868f52955864da0 P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.521435 11367 tablet_copy_client.cc:523] T 6e09bb2ca21a4d15ad9628cad8c039fc P bda87e13c35f421a92392a1b5362cc3a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20240502 21:30:14.521602 11363 tablet_bootstrap.cc:492] T 1b4569b2bbff4312995a21a09462d57e P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.523782 11369 tablet_bootstrap.cc:492] T 70988cb5413a4b0f976e759df1b54d48 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
@ 0x7effe06f1cd6 kudu::ThreadPoolBuilder::Build() at ??:0
I20240502 21:30:14.544996 11358 tablet_bootstrap.cc:492] T 537b30433ac64d6e8868f52955864da0 P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
I20240502 21:30:14.574234 11367 tablet_bootstrap.cc:492] T 6e09bb2ca21a4d15ad9628cad8c039fc P bda87e13c35f421a92392a1b5362cc3a: Bootstrap starting.
@ 0x7effefb448de kudu::tserver::TabletCopyClient::TabletCopyClient() at ??:0
@ 0x7effefb5cdaf kudu::tserver::RemoteTabletCopyClient::RemoteTabletCopyClient() at ??:0
@ 0x7effefc87480 kudu::tserver::TSTabletManager::RunTabletCopy() at ??:0
@ 0x7effefcbfa8d kudu::tserver::TabletCopyRunnable::Run() at ??:0
@ 0x7effefca2981 kudu::tserver::TSTabletManager::StartTabletCopy()::$_12::operator()() at ??:0
I20240502 21:30:14.697561 11368 log.cc:824] T 13b3c062533b43bda769b313b2e68e55 P bda87e13c35f421a92392a1b5362cc3a: Log is configured to *not* fsync() on all Append() calls
@ 0x7effefca270e std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7effe06fbb75 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7effe06ff19c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7effe06ff019 std::_Function_handler<>::_M_invoke() at ??:0
@ 0xa60bcd std::function<>::operator()() at ??:?
@ 0x7effe06da01e kudu::Thread::SuperviseThread() at ??:0
@ 0x7effe3a5f6db start_thread at ??:0
@ 0x7effdc89d71f clone at ??:0
W20240502 21:30:15.107168 10544 connection.cc:535] client connection to 127.6.51.194:40191 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240502 21:30:15.107868 11355 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
F20240502 21:30:15.107867 11354 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
*** Aborted at 1714685415 (unix time) try "date -d @1714685415" if you are using GNU date ***
*** Check failure stack trace: ***
F20240502 21:30:15.107868 11355 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 21:30:15.108770 11353 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240502 21:30:15.108750 11352 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
F20240502 21:30:15.107868 11355 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)F20240502 21:30:15.108770 11353 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: F20240502 21:30:15.108750 11352 tablet_copy_client_session-itest.cc:314] Check failed: _s.ok() Bad status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e8000018cf) received by PID 6351 (TID 0x7f4991bb4700) from PID 6351; stack trace: ***
@ 0x7f49ad51f980 (unknown) at ??:0
@ 0x7f49a65cafb7 gsignal at ??:0
@ 0x7f49a65cc921 abort at ??:0
@ 0x7f49a92f3dcd google::LogMessage::Fail() at ??:0
@ 0x7f49a92f7b93 google::LogMessage::SendToLog() at ??:0
@ 0x7f49a92f37cc google::LogMessage::Flush() at ??:0
@ 0x7f49a92f4f59 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x3b9874 kudu::TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test::TestBody()::$_3::operator()() at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/integration-tests/tablet_copy_client_session-itest.cc:313
@ 0x3b926e std::__invoke_impl<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:60
@ 0x3b91ee std::__invoke<>() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/bits/invoke.h:95
@ 0x3b91b3 _ZNSt6thread8_InvokerISt5tupleIJZN4kudu62TabletCopyClientSessionITest_TestTabletCopyWithBusySource_Test8TestBodyEvE3$_3EEE9_M_invokeIJLm0EEEEDTclsr3stdE8__invokespcl10_S_declvalIXT_EEEEESt12_Index_tupleIJXspT_EEE at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:234
@ 0x3b917e std::thread::_Invoker<>::operator()() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:243
@ 0x3b9069 std::thread::_State_impl<>::_M_run() at /usr/lib/gcc/x86_64-linux-gnu/7.5.0/../../../../include/c++/7.5.0/thread:186
@ 0x7f49a6c546df (unknown) at ??:0
@ 0x7f49ad5146db start_thread at ??:0
@ 0x7f49a66ad71f clone at ??:0